00000001:02000400:2.0F:1790772898.644411:0:3279:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg219-server.virtnet: executing set_hostid 00000001:02000400:2.0:1790772907.003753:0:3481:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg219-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1790772908.627973:0:3524:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 511 MB/s 00000001:01000000:2.0:1790772908.877425:0:3524:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 427 MB/s 00000001:01000000:2.0:1790772909.127768:0:3524:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 2931 MB/s 00000020:02000000:0.0F:1790772910.342515:0:3572:0:(class_obd.c:846:obdclass_init()) Lustre: Build Version: 2.17.59_4_ge4c1f18 00000400:02000000:2.0:1790772911.418757:0:3587:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.202.119@tcp [8/256/0/180] 00008000:02000000:1.0F:1790772915.584153:0:3737:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0F:1790772981.680681:0:5705:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg219-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1790772994.701185:0:6455:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1790772994.704278:0:6455:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1790772994.704280:0:6455:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1790772994.704412:0:6455:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000ae82dd14 00000080:02000400:1.0:1790772994.704424:0:6455:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' or install '{/usr}/sbin/mount.lustre_tgt' 00000020:01000004:1.0:1790772994.725076:0:6455:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1790772994.725089:0:6455:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1790772994.725117:0:6455:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000002173ee29) 00000020:00000080:1.0:1790772994.725136:0:6455:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1790772994.824884:0:6455:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1790772994.824968:0:6455:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:2.0:1790772994.857661:0:6455:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1790772994.857916:0:6455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1790772994.857923:0:6455:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790772994.857934:0:6455:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xabf1cc0bc784142d 00000020:01000004:2.0:1790772994.857939:0:6455:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1790772994.857943:0:6455:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1790772994.857948:0:6455:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000ae82dd14 from MGS 00000020:01000004:2.0:1790772994.857952:0:6455:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1790772994.857972:0:6455:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000004ca491d) 00000020:00000080:2.0:1790772994.857985:0:6455:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1790772994.858091:0:6455:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ae82dd14 from MGS, refs=2 00080000:01000000:2.0:1790772994.858097:0:6455:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790772994.858103:0:6455:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xabf1cc0bc784143b 00000100:00100000:2.0:1790772994.858194:0:6455:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1790772994.858351:0:6455:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1790772994.858357:0:6455:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1790772994.859196:0:6455:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1790772994.859531:0:6455:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1790772994.864424:0:6455:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790772994.864660:0:6455:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1790772994.865044:0:6455:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1790772994.867174:0:6455:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1790772994.867187:0:6455:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1790772994.867651:0:6455:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1790772994.867658:0:6455:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1790772994.868672:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772994.868683:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772994.868685:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772994.869117:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772994.869120:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790772994.869121:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772994.869827:0:6455:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1790772994.877409:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1790772995.118350:0:6455:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2923 MB/s 00000001:01000000:3.0:1790772995.368309:0:6455:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3383 MB/s 00000001:01000000:0.0:1790772995.620815:0:6455:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 575 MB/s 00000001:01000000:3.0:1790772995.870528:0:6455:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 711 MB/s 00080000:10000000:2.0:1790772995.880084:0:6455:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:2.0:1790772995.893564:0:6455:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1790772995.895795:0:6469:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1790772995.895828:0:6455:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1790772995.895876:0:6455:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1790772995.896069:0:6455:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1790772995.896091:0:6455:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1790772995.897107:0:6455:0:(service.c:173:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790772995.898489:0:6455:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1790772995.898502:0:6455:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1790772995.902028:0:6455:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1790772995.902043:0:6455:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1790772995.902553:0:6455:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1790772995.902559:0:6455:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1790772995.903502:0:6455:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1790772995.903524:0:6455:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.119@tcp' 00000020:01000004:3.0:1790772995.903525:0:6455:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1790772995.903583:0:6455:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.119@tcp (typ=mgc) 00000020:00000080:3.0:1790772995.903604:0:6455:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.119@tcp (00000000acaa37a2) 00000020:00000080:3.0:1790772995.903621:0:6455:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1790772995.903774:0:6455:0:(ldlm_lib.c:102:import_set_conn()) imp 000000003f095e48@MGC192.168.202.119@tcp: add connection 192.168.202.119@tcp at head 00010000:00010000:3.0:1790772995.904556:0:6455:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.119@tcp-0 is initialized 00000040:01000000:3.0:1790772995.904563:0:6455:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.119@tcp ctxt 1 is initialized 00000100:00080000:2.0:1790772995.907475:0:6474:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1790772995.911050:0:6475:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1790772995.911143:0:6455:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.119@tcp (uuid ce0675b4-b0c5-48e7-b182-565e22fed04c) 00000020:00000080:0.0:1790772995.911169:0:6455:0:(genops.c:1384:class_connect()) connect: client ce0675b4-b0c5-48e7-b182-565e22fed04c, cookie 0xabf1cc0bc7841449 00000100:00080000:0.0:1790772995.911182:0:6455:0:(import.c:545:import_select_connection()) MGC192.168.202.119@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790772995.911192:0:6455:0:(import.c:666:import_select_connection()) MGC192.168.202.119@tcp: import 000000003f095e48 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:0.0:1790772995.911279:0:6455:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000001037ac06 x1877761495924864/t0(0) o250->MGC192.168.202.119@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790772995.911374:0:6455:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import ce0675b4-b0c5-48e7-b182-565e22fed04c->MGS 00000020:01000004:0.0:1790772995.911396:0:6455:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1790772995.911420:0:6455:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1790772995.911442:0:6455:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000053620811) 00000020:00000080:0.0:1790772995.911456:0:6455:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1790772995.911700:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001037ac06 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ce0675b4-b0c5-48e7-b182-565e22fed04c:3603:1877761495924864:0@lo:250: 00000100:00100000:3.0:1790772995.911799:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772995.911887:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495924864 00000100:00100000:3.0:1790772995.911895:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495924864 00000100:00100000:3.0:1790772995.911922:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790772995.911927:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000b95f797b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3603:x1877761495924864:12345-0@lo:250: 00010000:00080000:3.0:1790772995.911947:0:6471:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from ce0675b4-b0c5-48e7-b182-565e22fed04c@0@lo t0 exp 0000000000000000 cur 138 last 0 00000020:00000080:3.0:1790772995.911970:0:6471:0:(genops.c:1384:class_connect()) connect: client ce0675b4-b0c5-48e7-b182-565e22fed04c, cookie 0xabf1cc0bc7841457 00000100:00080000:3.0:1790772995.912091:0:6471:0:(import.c:65:import_set_state_nolock()) 0000000036387e8a : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790772995.912143:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000b95f797b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+5:3603:x1877761495924864:12345-0@lo:250: Request processed in 214us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772995.912151:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790772995.912183:0:3603:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.119@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1790772995.912191:0:3603:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.202.119@tcp: connect to target with instance 0 00000100:00080000:3.0:1790772995.912198:0:3603:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.202.119@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1790772995.912201:0:3603:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1790772995.912223:0:3603:0:(import.c:65:import_set_state_nolock()) 000000003f095e48 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1790772995.912225:0:3603:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1790772995.912232:0:3603:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1790772995.912237:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001037ac06 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ce0675b4-b0c5-48e7-b182-565e22fed04c:3603:1877761495924864:0@lo:250: 00010000:00010000:1.0:1790772995.923639:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790772995.934011:0:6455:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790772995.935840:0:6455:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1790772995.935848:0:6455:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1790772995.941898:0:6455:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1790772995.941913:0:6455:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1790772995.951931:0:6455:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1790772995.951970:0:6455:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1790772995.954780:0:6455:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790772995.954960:0:6455:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1790772995.954965:0:6455:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1790772995.956319:0:6455:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1790772995.956327:0:6455:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1790772996.005121:0:6455:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790772996.005807:0:6455:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1790772996.005816:0:6455:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1790772996.008981:0:6455:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1790772996.008995:0:6455:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1790772996.009984:0:6455:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790772996.010176:0:6455:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1790772996.010181:0:6455:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1790772996.011563:0:6455:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790772996.011581:0:6455:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1790772996.020015:0:6455:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790772996.025782:0:6455:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1790772996.025797:0:6455:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1790772996.026961:0:6455:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1790772996.026969:0:6455:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1790772996.027544:0:6455:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790772996.028068:0:6455:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1790772996.028075:0:6455:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1790772996.028840:0:6455:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1790772996.028850:0:6455:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1790772996.055104:0:6455:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790772996.055510:0:6455:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1790772996.055519:0:6455:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1790772996.057135:0:6455:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1790772996.057146:0:6455:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1790772996.058195:0:6455:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1790772996.058304:0:6455:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1790772996.059317:0:6455:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1790772996.059344:0:6455:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1790772996.059351:0:6455:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.119@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1790772996.059459:0:6455:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.119@tcp ctxt 0 is initialized 00000020:01000004:3.0:1790772996.059498:0:6455:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.119@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1790772996.059503:0:6455:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1790772996.059504:0:6455:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790772996.059506:0:6455:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790772996.059507:0:6455:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790772996.059508:0:6455:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790772996.059510:0:6455:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790772996.059516:0:6455:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790772996.059517:0:6455:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790772996.059518:0:6455:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790772996.059519:0:6455:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790772996.059521:0:6455:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790772996.059522:0:6455:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790772996.059524:0:6455:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1790772996.059526:0:6455:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790772996.059527:0:6455:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790772996.059528:0:6455:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790772996.059529:0:6455:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790772996.059530:0:6455:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790772996.059530:0:6455:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790772996.059531:0:6455:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790772996.059532:0:6455:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790772996.059533:0:6455:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790772996.059534:0:6455:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790772996.059535:0:6455:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790772996.059535:0:6455:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790772996.059567:0:6455:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1790772996.059595:0:6455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ccc52149 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:6455:1877761495924992:0@lo:253: 00000100:00100000:3.0:1790772996.060050:0:6455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772996.060157:0:6455:0:(client.c:2716:ptlrpc_set_wait()) set 000000006de28429 going to sleep for 11 seconds 00000100:00100000:2.0:1790772996.060196:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495924992 00000100:00100000:2.0:1790772996.060219:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495924992 00000100:00100000:2.0:1790772996.060267:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790772996.060275:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000006c1c3e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+5:6455:x1877761495924992:12345-0@lo:253: 20000000:01000000:2.0:1790772996.060325:0:6473:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1790772996.060328:0:6473:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1790772996.061876:0:6494:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1790772996.061910:0:6473:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1790772996.062200:0:6473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790772996.067452:0:6495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1790772996.067658:0:6473:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1790772996.067762:0:6473:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1790772996.067769:0:6473:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1790772996.067773:0:6473:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1790772996.067790:0:6473:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1790772996.067981:0:6473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790772996.068167:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1790772996.068181:0:6473:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1790772996.068246:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1790772996.068278:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1790772996.068295:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1790772996.068350:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1790772996.068357:0:6473:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1790772996.068368:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1790772996.068372:0:6473:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1790772996.068382:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1790772996.068386:0:6473:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1790772996.068396:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1790772996.068408:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1790772996.068432:0:6473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1790772996.068437:0:6473:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1790772996.068443:0:6473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790772996.068532:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1790772996.068542:0:6473:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1790772996.068559:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1790772996.068589:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1790772996.068606:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1790772996.068614:0:6473:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1790772996.068639:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1790772996.068648:0:6473:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1790772996.068898:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1790772996.068921:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1790772996.068937:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1790772996.068947:0:6473:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1790772996.068986:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1790772996.068994:0:6473:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1790772996.069009:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1790772996.069024:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1790772996.069083:0:6473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1790772996.069105:0:6473:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1790772996.069120:0:6473:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1790772996.076714:0:6496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1790772996.077313:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1790772996.077342:0:6473:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.119@tcp for mdt 20000000:01000000:0.0:1790772996.077344:0:6473:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.119@tcp (null) (null) (null) 00000040:00080000:0.0:1790772996.077360:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1790772996.077366:0:6473:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1790772996.077378:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1790772996.077384:0:6473:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.119@tcp (null) (null) 00000040:00080000:0.0:1790772996.077396:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1790772996.077403:0:6473:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1790772996.077417:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1790772996.077434:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1790772996.077462:0:6473:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1790772996.077465:0:6473:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1790772996.077470:0:6473:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1790772996.077567:0:6473:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1790772996.077587:0:6473:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1790772996.078936:0:6497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1790772996.079162:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1790772996.082911:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1790772996.082945:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:0.0:1790772996.082964:0:6473:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1790772996.082967:0:6473:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1790772996.083545:0:6498:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1790772996.087514:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1790772996.087551:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1790772996.087581:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:0.0:1790772996.087594:0:6473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790772996.087596:0:6473:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1790772996.087830:0:6473:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1790772996.087834:0:6473:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1790772996.087839:0:6473:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1790772996.087845:0:6473:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1790772996.089686:0:6499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1790772996.090039:0:6473:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1790772996.103511:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1790772996.103548:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1790772996.103565:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1790772996.103595:0:6473:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1790772996.103622:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c31c7ba7/0xabf1cc0bc784145e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772996.103639:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c31c7ba7/0xabf1cc0bc784145e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772996.103647:0:6473:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c31c7ba7/0xabf1cc0bc784145e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772996.103652:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c31c7ba7/0xabf1cc0bc784145e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772996.103658:0:6473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c31c7ba7/0xabf1cc0bc784145e lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772996.103806:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c31c7ba7/0xabf1cc0bc784145e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772996.103813:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c31c7ba7 already unused, calling callback (0000000035eb843c) 00010000:00010000:1.0:1790772996.103816:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c31c7ba7/0xabf1cc0bc784145e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772996.103822:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c31c7ba7/0xabf1cc0bc784145e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772996.103835:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c31c7ba7/0xabf1cc0bc784145e lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772996.103840:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c31c7ba7/0xabf1cc0bc784145e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772996.103845:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c31c7ba7/0xabf1cc0bc784145e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790772996.103873:0:6473:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1790772996.119464:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000006c1c3e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+5:6455:x1877761495924992:12345-0@lo:253: Request processed in 59182us (59407us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772996.119484:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790772996.119514:0:6455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ccc52149 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:6455:1877761495924992:0@lo:253: 10000000:01000000:3.0:1790772996.119529:0:6455:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1790772996.119532:0:6455:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790772996.119534:0:6455:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790772996.119535:0:6455:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790772996.119537:0:6455:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1790772996.119538:0:6455:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790772996.119539:0:6455:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790772996.119540:0:6455:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790772996.119542:0:6455:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790772996.119543:0:6455:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1790772996.119560:0:6455:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790772996.119562:0:6455:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1790772996.119591:0:6455:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000ae82dd14 from lustre-MDT0000 10000000:01000000:3.0:1790772996.119638:0:6455:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1790772996.119641:0:6455:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1790772996.119645:0:6455:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff93d262660000 10000000:01000000:3.0:1790772996.119649:0:6455:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790772996.119657:0:6455:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93d262660000 from 1 10000000:01000000:3.0:1790772996.119660:0:6455:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1790772996.120380:0:6455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: 0000000023bdf60d/0xabf1cc0bc7841465 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772996.120391:0:6455:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: 0000000023bdf60d/0xabf1cc0bc7841465 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772996.120400:0:6455:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: 0000000023bdf60d/0xabf1cc0bc7841465 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790772996.120417:0:6455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ccc52149 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:6455:1877761495925120:0@lo:101: 00000100:00100000:3.0:1790772996.120460:0:6455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772996.120505:0:6455:0:(client.c:2716:ptlrpc_set_wait()) set 000000007880b6bd going to sleep for 11 seconds 00000100:00100000:0.0:1790772996.120586:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495925120 00000100:00100000:0.0:1790772996.120594:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495925120 00000100:00100000:0.0:1790772996.120651:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790772996.120659:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000009a7bf511 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+5:6455:x1877761495925120:12345-0@lo:101: 00010000:00010000:0.0:1790772996.120680:0:6472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772996.120695:0:6472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000079624829/0xabf1cc0bc784146c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7841465 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772996.120717:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000079624829/0xabf1cc0bc784146c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7841465 expref: 6 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772996.120726:0:6472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000079624829/0xabf1cc0bc784146c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7841465 expref: 6 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772996.120734:0:6472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000079624829, rc 0) 00000100:00100000:0.0:1790772996.120780:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000009a7bf511 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+6:6455:x1877761495925120:12345-0@lo:101: Request processed in 122us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772996.120786:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790772996.122249:0:6455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ccc52149 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:6455:1877761495925120:0@lo:101: 00010000:00010000:1.0:1790772996.122285:0:6455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: 0000000023bdf60d/0xabf1cc0bc7841465 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc784146c expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772996.122295:0:6455:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: 0000000023bdf60d/0xabf1cc0bc7841465 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc784146c expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772996.122392:0:6455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000092c253e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:6455:1877761495925248:0@lo:501: 00000100:00100000:1.0:1790772996.122436:0:6455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772996.122461:0:6455:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f81f3330 going to sleep for 11 seconds 00000100:00100000:0.0:1790772996.122592:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495925248 00000100:00100000:0.0:1790772996.122598:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495925248 00000100:00100000:0.0:1790772996.122639:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790772996.122647:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000405b73a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+6:6455:x1877761495925248:12345-0@lo:501: 00000100:00100000:0.0:1790772996.122847:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000405b73a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+6:6455:x1877761495925248:12345-0@lo:501: Request processed in 201us (411us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790772996.122864:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790772996.123168:0:6455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000092c253e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:6455:1877761495925248:0@lo:501: 10000000:01000000:1.0:1790772996.123198:0:6455:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1790772996.123231:0:6455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: 0000000023bdf60d/0xabf1cc0bc7841465 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc784146c expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772996.123240:0:6455:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: 0000000023bdf60d/0xabf1cc0bc7841465 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc784146c expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772996.123249:0:6455:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93d25268e800 10000000:01000000:1.0:1790772996.123254:0:6455:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1790772996.123258:0:6455:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff93d25268e800 10000000:01000000:1.0:1790772996.123327:0:6455:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1790772996.123331:0:6455:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff93d25268e800 from 1 10000000:01000000:1.0:1790772996.123334:0:6455:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1790772996.123358:0:6455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: 000000008d93bd18/0xabf1cc0bc7841473 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772996.123376:0:6455:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: 000000008d93bd18/0xabf1cc0bc7841473 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772996.123385:0:6455:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: 000000008d93bd18/0xabf1cc0bc7841473 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772996.123399:0:6455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000092c253e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:6455:1877761495925376:0@lo:101: 00000100:00100000:1.0:1790772996.123430:0:6455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772996.123505:0:6455:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f81f3330 going to sleep for 11 seconds 00000100:00100000:0.0:1790772996.123566:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495925376 00000100:00100000:0.0:1790772996.123580:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495925376 00000100:00100000:0.0:1790772996.123654:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790772996.123675:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000fafa33f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+6:6455:x1877761495925376:12345-0@lo:101: 00010000:00010000:0.0:1790772996.123686:0:6471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772996.123700:0:6471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ec89c7e8/0xabf1cc0bc784147a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7841473 expref: -99 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772996.123716:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ec89c7e8/0xabf1cc0bc784147a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7841473 expref: 7 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772996.123725:0:6471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ec89c7e8/0xabf1cc0bc784147a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7841473 expref: 7 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772996.123731:0:6471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ec89c7e8, rc 0) 00000100:00100000:0.0:1790772996.123768:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000fafa33f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+7:6455:x1877761495925376:12345-0@lo:101: Request processed in 107us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772996.123774:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790772996.123833:0:6455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000092c253e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:6455:1877761495925376:0@lo:101: 00010000:00010000:1.0:1790772996.123844:0:6455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: 000000008d93bd18/0xabf1cc0bc7841473 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc784147a expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772996.123851:0:6455:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: 000000008d93bd18/0xabf1cc0bc7841473 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc784147a expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772996.123862:0:6455:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1790772996.123879:0:6455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: 000000008d93bd18/0xabf1cc0bc7841473 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc784147a expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772996.123885:0:6455:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: 000000008d93bd18/0xabf1cc0bc7841473 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc784147a expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772996.123891:0:6455:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1790772996.123895:0:6455:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790772996.123898:0:6455:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff93d25268e800 10000000:01000000:1.0:1790772996.123900:0:6455:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1790772996.123903:0:6455:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1790772996.123911:0:6455:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1790772996.123926:0:6455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: 00000000e71fde43/0xabf1cc0bc7841481 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772996.123931:0:6455:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: 00000000e71fde43/0xabf1cc0bc7841481 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772996.123937:0:6455:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: 00000000e71fde43/0xabf1cc0bc7841481 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772996.123947:0:6455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000092c253e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:6455:1877761495925504:0@lo:101: 00000100:00100000:1.0:1790772996.123974:0:6455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772996.129437:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495925504 00000100:00100000:3.0:1790772996.129450:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495925504 00000100:00100000:3.0:1790772996.129540:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790772996.129548:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000f7f89aec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+7:6455:x1877761495925504:12345-0@lo:101: 00010000:00010000:3.0:1790772996.129566:0:6472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790772996.129566:0:6455:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f81f3330 going to sleep for 11 seconds 00010000:00010000:3.0:1790772996.129595:0:6472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003d276718/0xabf1cc0bc7841488 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7841481 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772996.129793:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003d276718/0xabf1cc0bc7841488 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7841481 expref: 8 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772996.129819:0:6472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003d276718/0xabf1cc0bc7841488 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7841481 expref: 8 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772996.129827:0:6472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003d276718, rc 0) 00000100:00100000:3.0:1790772996.129900:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000f7f89aec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+8:6455:x1877761495925504:12345-0@lo:101: Request processed in 353us (5926us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772996.129907:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790772996.129974:0:6455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000092c253e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:6455:1877761495925504:0@lo:101: 00010000:00010000:1.0:1790772996.129990:0:6455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: 00000000e71fde43/0xabf1cc0bc7841481 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841488 expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772996.129998:0:6455:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: 00000000e71fde43/0xabf1cc0bc7841481 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7841488 expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772996.130057:0:6455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000092c253e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:6455:1877761495925632:0@lo:501: 00000100:00100000:1.0:1790772996.130084:0:6455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772996.141938:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495925632 00000100:00100000:0.0:1790772996.141954:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495925632 00000100:00100000:0.0:1790772996.142010:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790772996.142019:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000be089c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+8:6455:x1877761495925632:12345-0@lo:501: 00000100:00100000:0.0:1790772996.142165:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000be089c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+9:6455:x1877761495925632:12345-0@lo:501: Request processed in 147us (12081us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772996.142186:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790772996.142688:0:6455:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f81f3330 going to sleep for 11 seconds 00000100:00100000:1.0:1790772996.142715:0:6455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000092c253e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:6455:1877761495925632:0@lo:501: 00000100:00100000:1.0:1790772996.142763:0:6455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000092c253e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:6455:1877761495925760:0@lo:503: 00000100:00100000:1.0:1790772996.142815:0:6455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772996.142827:0:6455:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f81f3330 going to sleep for 11 seconds 00000100:00100000:0.0:1790772996.143122:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495925760 00000100:00100000:0.0:1790772996.143128:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495925760 00000100:00100000:0.0:1790772996.143159:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790772996.143175:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000003d19b97b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+9:6455:x1877761495925760:12345-0@lo:503: 00000100:00100000:0.0:1790772996.143498:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000003d19b97b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+9:6455:x1877761495925760:12345-0@lo:503: Request processed in 323us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772996.143506:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790772996.143608:0:6455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000092c253e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:6455:1877761495925760:0@lo:503: 00000100:00100000:1.0:1790772996.144157:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000092c253e9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:6500:1877761495925888:0@lo:502: 00000100:00100000:1.0:1790772996.144514:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772996.144538:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 0000000094b12c2f going to sleep for 11 seconds 00000100:00100000:0.0:1790772996.144598:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495925888 00000100:00100000:0.0:1790772996.144614:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495925888 00000100:00100000:0.0:1790772996.144755:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790772996.144764:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000002dede131 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+9:6500:x1877761495925888:12345-0@lo:502: 00000100:00100000:0.0:1790772996.144858:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000002dede131 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+9:6500:x1877761495925888:12345-0@lo:502: Request processed in 95us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772996.144866:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790772996.144959:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000092c253e9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:6500:1877761495925888:0@lo:502: 00000020:01000000:1.0:1790772996.144981:0:6500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790772996.144993:0:6500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772996.144995:0:6500:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1790772996.145001:0:6500:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1790772996.145004:0:6500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790772996.145019:0:6500:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000004a8b5316) 00000020:00000080:1.0:1790772996.145037:0:6500:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1790772996.145042:0:6500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1790772996.145125:0:6500:0:(osd_handler.c:8931:osd_obd_connect()) connect #2 00000020:00000080:1.0:1790772996.145132:0:6500:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xabf1cc0bc7841496 00000020:00000080:1.0:1790772996.145844:0:6500:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1790772996.145850:0:6500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790772996.145855:0:6500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772996.145856:0:6500:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1790772996.145859:0:6500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790772996.145862:0:6500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772996.145863:0:6500:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1790772996.145866:0:6500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790772996.145874:0:6500:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000002d856c2f) 00000020:00000080:1.0:1790772996.145896:0:6500:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1790772996.145900:0:6500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1790772996.145901:0:6500:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1790772996.145905:0:6500:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1790772996.145910:0:6500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1790772996.145954:0:6500:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ae82dd14 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1790772996.145966:0:6500:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000a4391dd5) 00000020:00000080:1.0:1790772996.145975:0:6500:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1790772996.146055:0:6500:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1790772996.146067:0:6500:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xabf1cc0bc78414ab 00000020:00000080:1.0:1790772996.146157:0:6500:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1790772996.146163:0:6500:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1790772996.146167:0:6500:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xabf1cc0bc78414b2 00080000:01000000:1.0:1790772996.146186:0:6500:0:(osd_handler.c:8931:osd_obd_connect()) connect #3 00000020:00000080:1.0:1790772996.146190:0:6500:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xabf1cc0bc78414b9 00080000:10000000:1.0:1790772996.147073:0:6500:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1790772996.148010:0:6500:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1790772996.156560:0:6500:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1790772996.267901:0:6500:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1790772996.268241:0:6500:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1790772996.285766:0:6500:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1790772996.286860:0:6500:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1790772996.291775:0:6500:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000aec893eb) 00000020:00000080:1.0:1790772996.291803:0:6500:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1790772996.292108:0:6500:0:(osd_handler.c:8931:osd_obd_connect()) connect #4 00000020:00000080:1.0:1790772996.292117:0:6500:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xabf1cc0bc78414c7 00000020:00000080:0.0:1790772996.305583:0:6500:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1790772996.308109:0:6500:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:0.0:1790772996.317017:0:6500:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:0.0:1790772996.318788:0:6500:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:1.0:1790772996.321151:0:6500:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:1.0:1790772996.324034:0:6500:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:1.0:1790772996.326056:0:6500:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:1.0:1790772996.333734:0:6500:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xabf1cc0bc78414ce 00000020:00000080:1.0:1790772996.334149:0:6500:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1790772996.334160:0:6500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790772996.334166:0:6500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772996.334168:0:6500:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1790772996.334171:0:6500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790772996.334175:0:6500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772996.334176:0:6500:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790772996.334178:0:6500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790772996.334180:0:6500:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1790772996.334182:0:6500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790772996.334185:0:6500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772996.334186:0:6500:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:1.0:1790772996.334188:0:6500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790772996.334191:0:6500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772996.334193:0:6500:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1790772996.334197:0:6500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1790772996.334282:0:6500:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1790772996.334333:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000092c253e9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:6500:1877761495926016:0@lo:502: 00000100:00100000:1.0:1790772996.334407:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772996.334449:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 0000000094b12c2f going to sleep for 11 seconds 00000100:00100000:0.0:1790772996.334524:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495926016 00000100:00100000:0.0:1790772996.334531:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495926016 00000100:00100000:0.0:1790772996.334578:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790772996.334586:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000580e3572 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+9:6500:x1877761495926016:12345-0@lo:502: 00000100:00100000:0.0:1790772996.334704:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000580e3572 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+9:6500:x1877761495926016:12345-0@lo:502: Request processed in 119us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772996.334712:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790772996.335946:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000092c253e9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:6500:1877761495926016:0@lo:502: 00000020:01000000:1.0:1790772996.335985:0:6500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790772996.335993:0:6500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790772996.335995:0:6500:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1790772996.335999:0:6500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1790772996.336156:0:6455:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1790772996.336176:0:6455:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1790772996.336228:0:6455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: 00000000e71fde43/0xabf1cc0bc7841481 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841488 expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772996.336252:0:6455:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: 00000000e71fde43/0xabf1cc0bc7841481 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841488 expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772996.336272:0:6455:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93d25268e800 from 1 10000000:01000000:0.0:1790772996.336275:0:6455:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790772996.336307:0:6455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: 00000000240212df/0xabf1cc0bc78414d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772996.336314:0:6455:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: 00000000240212df/0xabf1cc0bc78414d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772996.336323:0:6455:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: 00000000240212df/0xabf1cc0bc78414d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772996.336337:0:6455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f8e84006 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:6455:1877761495926144:0@lo:101: 00000100:00100000:0.0:1790772996.336388:0:6455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772996.336415:0:6455:0:(client.c:2716:ptlrpc_set_wait()) set 000000000d011612 going to sleep for 11 seconds 00000100:00100000:2.0:1790772996.336555:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495926144 00000100:00100000:2.0:1790772996.336562:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495926144 00000100:00100000:2.0:1790772996.336609:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790772996.336617:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000b5aeb722 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+9:6455:x1877761495926144:12345-0@lo:101: 00010000:00010000:2.0:1790772996.336630:0:6473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790772996.336643:0:6473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007a03afa9/0xabf1cc0bc78414dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc78414d5 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772996.336672:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007a03afa9/0xabf1cc0bc78414dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc78414d5 expref: 10 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772996.336682:0:6473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007a03afa9/0xabf1cc0bc78414dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78414d5 expref: 10 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772996.336690:0:6473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007a03afa9, rc 0) 00000100:00100000:2.0:1790772996.336725:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000b5aeb722 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+10:6455:x1877761495926144:12345-0@lo:101: Request processed in 108us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772996.336731:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790772996.336814:0:6455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f8e84006 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:6455:1877761495926144:0@lo:101: 00010000:00010000:0.0:1790772996.336826:0:6455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: 00000000240212df/0xabf1cc0bc78414d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78414dc expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772996.336841:0:6455:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: 00000000240212df/0xabf1cc0bc78414d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc78414dc expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772996.338589:0:6455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f8e84006 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:6455:1877761495926272:0@lo:256: 00000100:00100000:0.0:1790772996.338655:0:6455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772996.338693:0:6455:0:(client.c:2716:ptlrpc_set_wait()) set 000000000d011612 going to sleep for 11 seconds 00000100:00100000:2.0:1790772996.339601:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495926272 00000100:00100000:2.0:1790772996.339613:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495926272 00000100:00100000:2.0:1790772996.339670:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790772996.339679:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000010d24bd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+10:6455:x1877761495926272:12345-0@lo:256: 20000000:01000000:2.0:1790772996.339700:0:6473:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1790772996.339706:0:6473:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1790772996.339802:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000010d24bd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+10:6455:x1877761495926272:12345-0@lo:256: Request processed in 125us (1147us total) trans 0 rc 0/0 00000100:00100000:2.0:1790772996.339810:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790772996.339903:0:6455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f8e84006 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:6455:1877761495926272:0@lo:256: 10000000:01000000:1.0:1790772996.340519:0:6455:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790772996.340540:0:6455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: 00000000240212df/0xabf1cc0bc78414d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78414dc expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772996.340552:0:6455:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: 00000000240212df/0xabf1cc0bc78414d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78414dc expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790772996.340560:0:6455:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d25268e800 from 1 10000000:01000000:1.0:1790772996.340563:0:6455:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790772996.340602:0:6455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: 00000000c31c7ba7/0xabf1cc0bc78414e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772996.340610:0:6455:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: 00000000c31c7ba7/0xabf1cc0bc78414e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772996.340619:0:6455:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: 00000000c31c7ba7/0xabf1cc0bc78414e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772996.340636:0:6455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000092c253e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:6455:1877761495926400:0@lo:101: 00000100:00100000:1.0:1790772996.340682:0:6455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772996.340706:0:6455:0:(client.c:2716:ptlrpc_set_wait()) set 0000000094b12c2f going to sleep for 11 seconds 00000100:00100000:0.0:1790772996.340830:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495926400 00000100:00100000:0.0:1790772996.340835:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495926400 00000100:00100000:0.0:1790772996.340874:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790772996.340881:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000007b7b6e21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+10:6455:x1877761495926400:12345-0@lo:101: 00010000:00010000:0.0:1790772996.340890:0:6472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790772996.340903:0:6472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000072ca5c93/0xabf1cc0bc78414ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc78414e3 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772996.340922:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000072ca5c93/0xabf1cc0bc78414ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc78414e3 expref: 11 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772996.340931:0:6472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000072ca5c93/0xabf1cc0bc78414ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78414e3 expref: 11 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772996.340939:0:6472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000072ca5c93, rc 0) 00000100:00100000:0.0:1790772996.340970:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000007b7b6e21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+11:6455:x1877761495926400:12345-0@lo:101: Request processed in 90us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772996.340976:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790772996.342550:0:6455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000092c253e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:6455:1877761495926400:0@lo:101: 00010000:00010000:1.0:1790772996.342585:0:6455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: 00000000c31c7ba7/0xabf1cc0bc78414e3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78414ea expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772996.342597:0:6455:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: 00000000c31c7ba7/0xabf1cc0bc78414e3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc78414ea expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772996.342671:0:6455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000092c253e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:6455:1877761495926528:0@lo:501: 00000100:00100000:1.0:1790772996.342717:0:6455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790772996.342752:0:6455:0:(client.c:2716:ptlrpc_set_wait()) set 0000000094b12c2f going to sleep for 11 seconds 00000100:00100000:0.0:1790772996.342861:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495926528 00000100:00100000:0.0:1790772996.342867:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495926528 00000100:00100000:0.0:1790772996.342911:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790772996.342920:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000c85c5a02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+11:6455:x1877761495926528:12345-0@lo:501: 00000100:00100000:0.0:1790772996.343072:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000c85c5a02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+11:6455:x1877761495926528:12345-0@lo:501: Request processed in 154us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772996.343079:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790772996.343451:0:6455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000092c253e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:6455:1877761495926528:0@lo:501: 00000100:00100000:2.0:1790772996.343494:0:6455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e37f58a6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:6455:1877761495926656:0@lo:503: 00000100:00100000:2.0:1790772996.343529:0:6455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772996.343555:0:6455:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a6a0ccdb going to sleep for 11 seconds 00000100:00100000:1.0:1790772996.343717:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495926656 00000100:00100000:1.0:1790772996.343721:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495926656 00000100:00100000:1.0:1790772996.343754:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790772996.343760:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000c10ef5dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+11:6455:x1877761495926656:12345-0@lo:503: 00000040:00080000:1.0:1790772996.343791:0:6473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790772996.343880:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000c10ef5dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+11:6455:x1877761495926656:12345-0@lo:503: Request processed in 120us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772996.343887:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790772996.350585:0:6455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e37f58a6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:6455:1877761495926656:0@lo:503: 00000040:00080000:1.0:1790772996.354852:0:6504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1790772996.357038:0:6455:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1790772996.357080:0:6455:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790772996.357157:0:6455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: 00000000c31c7ba7/0xabf1cc0bc78414e3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78414ea expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772996.357171:0:6455:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: 00000000c31c7ba7/0xabf1cc0bc78414e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78414ea expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790772996.358067:0:6455:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1790772996.358072:0:6455:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93d25268e800 10000000:01000000:0.0:1790772996.358076:0:6455:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93d25268e800 10000000:01000000:0.0:1790772996.358080:0:6455:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790772996.358101:0:6455:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93d25268e800 from 1 10000000:01000000:0.0:1790772996.358104:0:6455:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790772996.358145:0:6455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: 0000000031c9ebac/0xabf1cc0bc78414f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772996.358156:0:6455:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: 0000000031c9ebac/0xabf1cc0bc78414f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772996.358167:0:6455:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: 0000000031c9ebac/0xabf1cc0bc78414f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772996.358187:0:6455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ced2e35a pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:6455:1877761495926784:0@lo:101: 00000100:00100000:0.0:1790772996.358300:0:6455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772996.358348:0:6455:0:(client.c:2716:ptlrpc_set_wait()) set 00000000931c4d9a going to sleep for 11 seconds 00000100:00100000:1.0:1790772996.359241:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495926784 00000100:00100000:1.0:1790772996.359253:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495926784 00000100:00100000:1.0:1790772996.359321:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790772996.359330:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000ecc7d63f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+11:6455:x1877761495926784:12345-0@lo:101: 00010000:00010000:1.0:1790772996.359346:0:6471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790772996.359360:0:6471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000070f63d9f/0xabf1cc0bc78414f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc78414f1 expref: -99 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772996.359401:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000070f63d9f/0xabf1cc0bc78414f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc78414f1 expref: 12 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772996.359411:0:6471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000070f63d9f/0xabf1cc0bc78414f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78414f1 expref: 12 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790772996.359419:0:6471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000070f63d9f, rc 0) 00000100:00100000:1.0:1790772996.359467:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000ecc7d63f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+12:6455:x1877761495926784:12345-0@lo:101: Request processed in 139us (1168us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772996.359473:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790772996.359681:0:6455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ced2e35a pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:6455:1877761495926784:0@lo:101: 00010000:00010000:0.0:1790772996.359699:0:6455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: 0000000031c9ebac/0xabf1cc0bc78414f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78414f8 expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772996.359707:0:6455:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: 0000000031c9ebac/0xabf1cc0bc78414f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc78414f8 expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772996.359771:0:6455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ced2e35a pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:6455:1877761495926912:0@lo:501: 00000100:00100000:0.0:1790772996.359800:0:6455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772996.359832:0:6455:0:(client.c:2716:ptlrpc_set_wait()) set 00000000931c4d9a going to sleep for 11 seconds 00000100:00100000:3.0:1790772996.359896:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495926912 00000100:00100000:3.0:1790772996.359901:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495926912 00000100:00100000:3.0:1790772996.359932:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790772996.359938:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000e4ca9aaa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+12:6455:x1877761495926912:12345-0@lo:501: 00000100:00100000:3.0:1790772996.360048:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000e4ca9aaa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+12:6455:x1877761495926912:12345-0@lo:501: Request processed in 111us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772996.360054:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790772996.360158:0:6455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ced2e35a pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:6455:1877761495926912:0@lo:501: 00000100:00100000:0.0:1790772996.360183:0:6455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ced2e35a pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:6455:1877761495927040:0@lo:503: 00000100:00100000:0.0:1790772996.360239:0:6455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772996.360265:0:6455:0:(client.c:2716:ptlrpc_set_wait()) set 00000000931c4d9a going to sleep for 11 seconds 00000100:00100000:3.0:1790772996.360368:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495927040 00000100:00100000:3.0:1790772996.360378:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495927040 00000100:00100000:3.0:1790772996.360410:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790772996.360415:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000003664110f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+12:6455:x1877761495927040:12345-0@lo:503: 00000100:00100000:3.0:1790772996.360484:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000003664110f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+12:6455:x1877761495927040:12345-0@lo:503: Request processed in 69us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1790772996.360490:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790772996.360793:0:6455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ced2e35a pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:6455:1877761495927040:0@lo:503: 00000100:00100000:3.0:1790772996.361308:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000a078cf8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:6505:1877761495927168:0@lo:502: 00000100:00100000:3.0:1790772996.361356:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772996.361388:0:6505:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e9fc012a going to sleep for 11 seconds 00000100:00100000:0.0:1790772996.361508:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495927168 00000100:00100000:0.0:1790772996.361514:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495927168 00000100:00100000:0.0:1790772996.361552:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790772996.361559:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000ae10aa79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+12:6505:x1877761495927168:12345-0@lo:502: 00000100:00100000:0.0:1790772996.361680:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000ae10aa79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+12:6505:x1877761495927168:12345-0@lo:502: Request processed in 122us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772996.361688:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790772996.362014:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000a078cf8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:6505:1877761495927168:0@lo:502: 00000020:01000004:2.0:1790772996.362069:0:6505:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1790772996.362084:0:6505:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000f6b5ca0b) 00000020:00000080:2.0:1790772996.362108:0:6505:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1790772996.362185:0:6505:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ae82dd14 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1790772996.362189:0:6505:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000ae82dd14 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1790772996.362192:0:6505:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000ae82dd14 4 00010000:00080000:2.0:1790772996.362326:0:6505:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000035470fb9@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.119@tcp at head 00010000:00010000:2.0:1790772996.364919:0:6505:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1790772996.365162:0:6505:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1790772996.365230:0:6505:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790772996.365242:0:6505:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xabf1cc0bc7841506 00000100:00080000:2.0:1790772996.365253:0:6505:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790772996.365279:0:6505:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000035470fb9 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:2.0:1790772996.365315:0:6505:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000cf7f2200 x1877761495927296/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790772996.365344:0:6505:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1790772996.367955:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cf7f2200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3603:1877761495927296:0@lo:38: 00000100:00100000:0.0:1790772996.368044:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772996.368344:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d76d4dec pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:6505:1877761495927424:0@lo:502: 00000100:00100000:2.0:1790772996.368390:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772996.368405:0:6505:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a6a0ccdb going to sleep for 11 seconds 00000100:00100000:0.0:1790772996.368765:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495927424 00000100:00100000:0.0:1790772996.368775:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495927424 00000100:00100000:0.0:1790772996.368818:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790772996.368826:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000022aa1804 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+12:6505:x1877761495927424:12345-0@lo:502: 00000100:00100000:0.0:1790772996.368959:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000022aa1804 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+12:6505:x1877761495927424:12345-0@lo:502: Request processed in 133us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772996.368967:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790772996.369192:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d76d4dec pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:6505:1877761495927424:0@lo:502: 00000040:00080000:2.0:1790772996.369252:0:6505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000100:00100000:3.0:1790772996.369662:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495927296 00000100:00100000:3.0:1790772996.369669:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495927296 00000100:00100000:3.0:1790772996.369695:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790772996.369699:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000ced2e35a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3603:x1877761495927296:12345-0@lo:38: 00000100:00100000:3.0:1790772996.369761:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000ced2e35a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3603:x1877761495927296:12345-0@lo:38: Request processed in 60us (1718us total) trans 0 rc -11/-11 00000100:00100000:3.0:1790772996.369767:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000000:0.0:1790772996.375434:0:6455:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1790772996.375472:0:6455:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790772996.375565:0:6455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: 0000000031c9ebac/0xabf1cc0bc78414f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78414f8 expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772996.375587:0:6455:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: 0000000031c9ebac/0xabf1cc0bc78414f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78414f8 expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1790772996.375642:0:6455:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1790772996.375644:0:6455:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790772996.375646:0:6455:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790772996.375651:0:6455:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790772996.375652:0:6455:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790772996.375654:0:6455:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790772996.375655:0:6455:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790772996.375656:0:6455:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790772996.375657:0:6455:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790772996.375658:0:6455:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790772996.375659:0:6455:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790772996.375660:0:6455:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790772996.375664:0:6455:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1790772996.375666:0:6455:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790772996.375666:0:6455:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790772996.375667:0:6455:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790772996.375668:0:6455:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790772996.375669:0:6455:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790772996.375670:0:6455:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790772996.375670:0:6455:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790772996.375671:0:6455:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790772996.375672:0:6455:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790772996.375672:0:6455:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790772996.375673:0:6455:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790772996.375674:0:6455:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790772996.375698:0:6455:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1790772996.375715:0:6455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000053ae89d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:6455:1877761495927552:0@lo:253: 00000100:00100000:0.0:1790772996.375787:0:6455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790772996.375845:0:6455:0:(client.c:2716:ptlrpc_set_wait()) set 00000000969b2d3f going to sleep for 11 seconds 00000100:00100000:0.0:1790772996.375884:0:3603:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790772996.375890:0:3603:0:(import.c:65:import_set_state_nolock()) 0000000035470fb9 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790772996.375894:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1790772996.375898:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cf7f2200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3603:1877761495927296:0@lo:38: 00000100:00100000:1.0:1790772996.375961:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495927552 00000100:00100000:1.0:1790772996.375968:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495927552 00000100:00100000:1.0:1790772996.376014:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790772996.376023:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000474c41a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+12:6455:x1877761495927552:12345-0@lo:253: 20000000:01000000:1.0:1790772996.376049:0:6473:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1790772996.376061:0:6473:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1790772996.395695:0:6473:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1790772996.395717:0:6473:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1790772996.395826:0:6494:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1790772996.395832:0:6494:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1790772996.395858:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000964dff0e/0xabf1cc0bc784150d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772996.395875:0:6494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007a03afa9/0xabf1cc0bc78414dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78414d5 expref: 12 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772996.395883:0:6494:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000964dff0e/0xabf1cc0bc784150d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772996.395931:0:6494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007a03afa9/0xabf1cc0bc78414dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc78414d5 expref: 12 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790772996.395945:0:6494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007a03afa9/0xabf1cc0bc78414dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc78414d5 expref: 12 pid: 6473 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790772996.395957:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d76d4dec pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6494:1877761495927680:0@lo:104: 00000100:00100000:2.0:1790772996.396018:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790772996.396075:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set 000000001252ad07 going to sleep for 11 seconds 00000100:00100000:0.0:1790772996.396289:0:6461:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495927680 00000100:00100000:0.0:1790772996.396297:0:6461:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495927680 00000100:00100000:0.0:1790772996.396340:0:6461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790772996.396348:0:6461:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000937a6955 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce0675b4-b0c5-48e7-b182-565e22fed04c+3:6494:x1877761495927680:12345-0@lo:104: 00010000:00010000:0.0:1790772996.396368:0:6461:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: 00000000240212df/0xabf1cc0bc78414d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc78414dc expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772996.396421:0:6461:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790772996.396426:0:6461:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000937a6955 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce0675b4-b0c5-48e7-b182-565e22fed04c+3:6494:x1877761495927680:12345-0@lo:104: Request processed in 79us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772996.396434:0:6461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1790772996.396538:0:6466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790772996.396544:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: 00000000240212df/0xabf1cc0bc78414d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc78414dc expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772996.396550:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000240212df already unused, calling callback (000000000c3d7381) 10000000:00010000:3.0:1790772996.396553:0:6466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: 00000000240212df/0xabf1cc0bc78414d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc78414dc expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772996.396561:0:6466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: 00000000240212df/0xabf1cc0bc78414d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc78414dc expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790772996.396578:0:6466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: 00000000240212df/0xabf1cc0bc78414d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc78414dc expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790772996.396595:0:6466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790772996.396630:0:6466:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: 00000000240212df/0xabf1cc0bc78414d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78414dc expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772996.396637:0:6466:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790772996.396653:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: 00000000240212df/0xabf1cc0bc78414d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78414dc expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772996.396658:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: 00000000240212df/0xabf1cc0bc78414d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78414dc expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790772996.396674:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772996.396676:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790772996.396677:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790772996.396732:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000455ef0e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce0675b4-b0c5-48e7-b182-565e22fed04c:3605:1877761495927808:0@lo:103: 00000100:00100000:3.0:1790772996.396762:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790772996.396838:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d76d4dec pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6494:1877761495927680:0@lo:104: 00010000:00010000:3.0:1790772996.396857:0:6494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000964dff0e/0xabf1cc0bc784150d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790772996.396965:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000474c41a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+12:6455:x1877761495927552:12345-0@lo:253: Request processed in 20943us (21178us total) trans 0 rc 0/0 00000100:00100000:1.0:1790772996.396973:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790772996.397043:0:6455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000053ae89d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:6455:1877761495927552:0@lo:253: 10000000:01000000:3.0:1790772996.397053:0:6455:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1790772996.397056:0:6455:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790772996.397057:0:6455:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790772996.397058:0:6455:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790772996.397059:0:6455:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790772996.397060:0:6455:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790772996.397061:0:6455:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790772996.397062:0:6455:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790772996.397070:0:6455:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790772996.397072:0:6455:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790772996.397073:0:6455:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790772996.397074:0:6455:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790772996.397075:0:6455:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1790772996.397084:0:6455:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1790772996.401107:0:6463:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495927808 00000100:00100000:0.0:1790772996.401120:0:6463:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495927808 00010000:00010000:0.0:1790772996.401151:0:6463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007a03afa9/0xabf1cc0bc78414dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc78414d5 expref: 12 pid: 6473 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790772996.401192:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790772996.401199:0:6463:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000006247cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce0675b4-b0c5-48e7-b182-565e22fed04c+12:3605:x1877761495927808:12345-0@lo:103: 00010000:00010000:0.0:1790772996.401232:0:6463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790772996.401237:0:6463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007a03afa9/0xabf1cc0bc78414dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc78414d5 expref: 12 pid: 6473 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772996.401249:0:6463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007a03afa9/0xabf1cc0bc78414dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc78414d5 expref: 12 pid: 6473 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772996.401274:0:6463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007a03afa9/0xabf1cc0bc78414dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc78414d5 expref: 12 pid: 6473 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772996.401288:0:6463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000964dff0e/0xabf1cc0bc784150d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772996.401296:0:6463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000964dff0e/0xabf1cc0bc784150d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790772996.401321:0:6463:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005490034s 00010000:00010000:0.0:1790772996.401325:0:6463:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000964dff0e/0xabf1cc0bc784150d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772996.401331:0:6463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000964dff0e/0xabf1cc0bc784150d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772996.401336:0:6463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000964dff0e/0xabf1cc0bc784150d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772996.401341:0:6463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000964dff0e/0xabf1cc0bc784150d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772996.401346:0:6463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000964dff0e already unused, calling callback (0000000035eb843c) 00010000:00010000:0.0:1790772996.401349:0:6463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000964dff0e/0xabf1cc0bc784150d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772996.401356:0:6463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000964dff0e/0xabf1cc0bc784150d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772996.401370:0:6463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000964dff0e/0xabf1cc0bc784150d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772996.401379:0:6463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790772996.401443:0:6463:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000006247cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce0675b4-b0c5-48e7-b182-565e22fed04c+11:3605:x1877761495927808:12345-0@lo:103: Request processed in 245us (4680us total) trans 0 rc 0/0 00000100:00100000:0.0:1790772996.401451:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790772996.401726:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000455ef0e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce0675b4-b0c5-48e7-b182-565e22fed04c:3605:1877761495927808:0@lo:103: 00010000:00010000:0.0:1790772996.401767:0:6494:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000964dff0e/0xabf1cc0bc784150d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772996.401780:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000964dff0e/0xabf1cc0bc784150d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790772996.401785:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000964dff0e/0xabf1cc0bc784150d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1790772996.404585:0:6455:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:3.0:1790772996.404766:0:6455:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1790772996.404997:0:6455:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:3.0:1790772996.405175:0:6455:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1790772996.405757:0:6455:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:2.0:1790772996.405936:0:6455:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1790772996.412770:0:6455:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:0.0:1790772996.413023:0:6455:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1790772996.413189:0:6455:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:0.0:1790772996.413633:0:6455:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1790772996.413828:0:6455:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:0.0:1790772996.414169:0:6455:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:0.0:1790772996.424470:0:6455:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1790772996.435749:0:6455:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1790772996.436091:0:6510:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1790772996.436095:0:6510:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1790772996.436431:0:6511:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1790772996.438078:0:6455:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1790772996.438174:0:6455:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1790772996.438758:0:6455:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1790772996.438789:0:6455:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1790772996.439020:0:6455:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790772996.441866:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790772996.442594:0:6455:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1790772996.443401:0:6455:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1790772996.443447:0:6455:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1790772996.447158:0:6455:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1790772996.447493:0:6455:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:2.0:1790772996.448267:0:6455:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1790772996.448406:0:6455:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1790772996.448543:0:6455:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1790772996.448687:0:6455:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1790772996.448821:0:6455:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1790772996.448979:0:6455:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1790772996.449121:0:6455:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1790772996.449291:0:6455:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1790772996.449428:0:6455:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1790772996.449558:0:6455:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00000040:00080000:0.0:1790772996.449983:0:6511:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1790772996.450039:0:6511:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1790772996.450042:0:6511:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:2.0:1790772996.451608:0:6455:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1790772996.451749:0:6455:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1790772996.451974:0:6455:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1790772996.452132:0:6455:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1790772996.452300:0:6455:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1790772996.452424:0:6455:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1790772996.452753:0:6455:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1790772996.455963:0:6455:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1790772996.456157:0:6455:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1790772996.456442:0:6455:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1790772996.456604:0:6455:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1790772996.456784:0:6455:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1790772996.456933:0:6455:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1790772996.457075:0:6455:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1790772996.458162:0:6455:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1790772996.458793:0:6455:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1790772996.459003:0:6455:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1790772996.459163:0:6455:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1790772996.459502:0:6455:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1790772996.459827:0:6455:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1790772996.460070:0:6455:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1790772996.460199:0:6455:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1790772996.460601:0:6455:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:3.0:1790772996.464493:0:6455:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1790772996.464535:0:6455:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb21f01c63988 00100000:10000000:3.0:1790772996.464544:0:6455:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1790772996.465940:0:6455:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790772996.465959:0:6455:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.119@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790772996.465980:0:6455:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=45 00000080:00000004:3.0:1790772996.465999:0:6455:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1790772996.467140:0:6455:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790772996.467451:0:6455:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1790772996.942357:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790772997.966438:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790772998.997918:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773000.013345:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790773000.770765:0:6756:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg219-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1790773001.037575:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790773001.555407:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1790773001.555418:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790773001.555421:0:38:0:(import.c:65:import_set_state_nolock()) 0000000035470fb9 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790773001.555438:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000035470fb9 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:2.0:1790773001.555459:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000004884a81c x1877761495928064/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790773001.555505:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004884a81c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3603:1877761495928064:0@lo:38: 00000100:00100000:2.0:1790773001.555708:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773001.555895:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c2fa125d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce0675b4-b0c5-48e7-b182-565e22fed04c:3606:1877761495927936:0@lo:400: 00000100:00100000:3.0:1790773001.555931:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773001.555969:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495928064 00000100:00100000:3.0:1790773001.555977:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495928064 00000100:00100000:3.0:1790773001.556017:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790773001.556023:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000fcbc87e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3603:x1877761495928064:12345-0@lo:38: 00010000:00080000:3.0:1790773001.556047:0:6480:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 144 last 0 00000020:00000080:3.0:1790773001.556083:0:6480:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xabf1cc0bc7841514 00000004:00100000:3.0:1790773001.556118:0:6480:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1790773001.557380:0:6480:0:(import.c:65:import_set_state_nolock()) 000000005046a704 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790773001.557462:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000fcbc87e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3603:x1877761495928064:12345-0@lo:38: Request processed in 1437us (1754us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773001.557471:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790773001.557504:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495927936 00000100:00100000:3.0:1790773001.557509:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495927936 00000100:00100000:3.0:1790773001.557620:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790773001.557628:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000f1323549 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+11:3606:x1877761495927936:12345-0@lo:400: 00000100:00100000:3.0:1790773001.557671:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000f1323549 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+11:3606:x1877761495927936:12345-0@lo:400: Request processed in 45us (1740us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773001.557678:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790773001.557911:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c2fa125d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce0675b4-b0c5-48e7-b182-565e22fed04c:3606:1877761495927936:0@lo:400: 00010000:00080000:2.0:1790773001.558427:0:3603:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000004884a81c x1877761495928064/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790773011 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790773001.558445:0:3603:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1790773001.558452:0:3603:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1790773001.558457:0:3603:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790773001.558459:0:3603:0:(import.c:65:import_set_state_nolock()) 0000000035470fb9 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790773001.558465:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004884a81c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3603:1877761495928064:0@lo:38: 00000020:00000004:1.0:1790773001.642779:0:6808:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790773001.642969:0:6808:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790773002.067875:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773003.085451:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1790773003.764612:0:6909:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790773003.764791:0:6909:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790773004.109363:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790773004.109506:0:6475:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790773004.109511:0:6475:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93d25268e800 from 3 10000000:01000000:0.0:1790773004.109516:0:6475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790773004.109561:0:6475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: 0000000012431c86/0xabf1cc0bc784151b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773004.109574:0:6475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: 0000000012431c86/0xabf1cc0bc784151b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773004.109597:0:6475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: 0000000012431c86/0xabf1cc0bc784151b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773004.109622:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000958bbb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495928192:0@lo:101: 00000100:00100000:0.0:1790773004.109712:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773004.109768:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e23c77e4 going to sleep for 11 seconds 00000100:00100000:1.0:1790773004.110283:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495928192 00000100:00100000:1.0:1790773004.110291:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495928192 00000100:00100000:1.0:1790773004.110341:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790773004.110348:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000000c375b6c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+11:6475:x1877761495928192:12345-0@lo:101: 00010000:00010000:1.0:1790773004.110367:0:6473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773004.110380:0:6473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000125e892/0xabf1cc0bc7841522 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc784151b expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773004.110401:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000125e892/0xabf1cc0bc7841522 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc784151b expref: 12 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773004.110410:0:6473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000125e892/0xabf1cc0bc7841522 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc784151b expref: 12 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773004.110419:0:6473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000125e892, rc 0) 00000100:00100000:1.0:1790773004.110458:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000000c375b6c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+12:6475:x1877761495928192:12345-0@lo:101: Request processed in 110us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773004.110464:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790773004.111087:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000958bbb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495928192:0@lo:101: 00010000:00010000:0.0:1790773004.111102:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: 0000000012431c86/0xabf1cc0bc784151b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841522 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773004.111110:0:6475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: 0000000012431c86/0xabf1cc0bc784151b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7841522 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773004.111158:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000958bbb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495928320:0@lo:256: 00000100:00100000:0.0:1790773004.111191:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773004.111248:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e23c77e4 going to sleep for 11 seconds 00000100:00100000:3.0:1790773004.111314:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495928320 00000100:00100000:3.0:1790773004.111319:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495928320 00000100:00100000:3.0:1790773004.111342:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790773004.111348:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000007951c74b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+12:6475:x1877761495928320:12345-0@lo:256: 20000000:01000000:3.0:1790773004.111361:0:6472:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790773004.111375:0:6472:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790773004.111377:0:6472:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1790773004.111461:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000007951c74b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+12:6475:x1877761495928320:12345-0@lo:256: Request processed in 114us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773004.111469:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790773004.111582:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000958bbb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495928320:0@lo:256: 10000000:01000000:0.0:1790773004.111620:0:6475:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790773004.111626:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: 0000000012431c86/0xabf1cc0bc784151b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841522 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773004.111634:0:6475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: 0000000012431c86/0xabf1cc0bc784151b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841522 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773005.133659:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773006.160627:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773006.670882:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000958bbb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce0675b4-b0c5-48e7-b182-565e22fed04c:3607:1877761495928448:0@lo:400: 00000100:00100000:1.0:1790773006.670975:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773006.671090:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495928448 00000100:00100000:3.0:1790773006.671098:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495928448 00000100:00100000:3.0:1790773006.671149:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790773006.671157:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000000fd8731f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+12:3607:x1877761495928448:12345-0@lo:400: 00000100:00100000:0.0:1790773006.671435:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000095dfa49c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3604:1877761495928576:0@lo:400: 00000100:00100000:0.0:1790773006.671466:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773006.671573:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495928576 00000100:00100000:0.0:1790773006.671578:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495928576 00000100:00100000:0.0:1790773006.671618:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790773006.671624:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000025c1f132 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3604:x1877761495928576:12345-0@lo:400: 00000100:00100000:0.0:1790773006.671661:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000025c1f132 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3604:x1877761495928576:12345-0@lo:400: Request processed in 38us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773006.671668:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1790773006.671710:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000095dfa49c x1877761495928576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773022 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773006.671723:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000095dfa49c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3604:1877761495928576:0@lo:400: 00000100:00100000:3.0:1790773006.672228:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000000fd8731f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+12:3607:x1877761495928448:12345-0@lo:400: Request processed in 1047us (1229us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773006.672236:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790773006.672453:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000958bbb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce0675b4-b0c5-48e7-b182-565e22fed04c:3607:1877761495928448:0@lo:400: 00010000:00010000:2.0:1790773007.182367:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773008.206326:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773009.233122:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773010.253422:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773011.279789:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773011.794505:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790773011.794536:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000095dfa49c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce0675b4-b0c5-48e7-b182-565e22fed04c:3604:1877761495928704:0@lo:400: 00000100:00100000:2.0:1790773011.794617:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773011.794679:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007fce24e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3606:1877761495928832:0@lo:400: 00000100:00100000:2.0:1790773011.794709:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773011.794747:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495928832 00000100:00100000:2.0:1790773011.794754:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495928832 00000100:00100000:2.0:1790773011.794798:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790773011.794806:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000004884a81c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1877761495928832:12345-0@lo:400: 00000100:00100000:2.0:1790773011.794852:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000004884a81c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1877761495928832:12345-0@lo:400: Request processed in 46us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773011.794859:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790773011.794909:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000007fce24e3 x1877761495928832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773027 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773011.794923:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007fce24e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3606:1877761495928832:0@lo:400: 00000100:00100000:0.0:1790773011.798409:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495928704 00000100:00100000:0.0:1790773011.798437:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495928704 00000100:00100000:0.0:1790773011.798494:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790773011.798503:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000005a8a7f59 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+12:3604:x1877761495928704:12345-0@lo:400: 00000100:00100000:0.0:1790773011.798599:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000005a8a7f59 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+12:3604:x1877761495928704:12345-0@lo:400: Request processed in 97us (3983us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773011.798606:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790773011.798726:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000095dfa49c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce0675b4-b0c5-48e7-b182-565e22fed04c:3604:1877761495928704:0@lo:400: 00010000:00010000:2.0:1790773012.306244:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773013.326540:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790773013.492174:0:7408:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790773013.492180:0:7408:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1790773013.492181:0:7408:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1790773013.492430:0:7408:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000007aca9f9c 00000020:01000004:2.0:1790773013.492449:0:7408:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:2.0:1790773013.492462:0:7408:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1790773013.492476:0:7408:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000f723c77c) 00000020:00000080:2.0:1790773013.492490:0:7408:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1790773013.557063:0:7408:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:0.0:1790773013.557160:0:7408:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:3.0:1790773013.608594:0:7408:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1790773013.608973:0:7408:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1790773013.608988:0:7408:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:3.0:1790773013.609006:0:7408:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xabf1cc0bc7841530 00000020:01000004:3.0:1790773013.609013:0:7408:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1790773013.609040:0:7408:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.119@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1790773013.609045:0:7408:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.119@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1790773013.609052:0:7408:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1790773013.609089:0:7408:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1790773013.609107:0:7408:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.119@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1790773013.664798:0:7408:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.119@tcp ctxt 0 is initialized 00000020:01000004:3.0:1790773013.664854:0:7408:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.119@tcp, index=0001, flags=0x20061 00000020:01000004:3.0:1790773013.664860:0:7408:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1790773013.664862:0:7408:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1790773013.664864:0:7408:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790773013.664865:0:7408:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790773013.664866:0:7408:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790773013.664868:0:7408:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790773013.664869:0:7408:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790773013.664871:0:7408:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790773013.664872:0:7408:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790773013.664875:0:7408:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790773013.664876:0:7408:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790773013.664881:0:7408:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:3.0:1790773013.664884:0:7408:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790773013.664885:0:7408:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1790773013.664886:0:7408:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790773013.664887:0:7408:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790773013.664888:0:7408:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790773013.664889:0:7408:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790773013.664890:0:7408:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790773013.664892:0:7408:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790773013.664893:0:7408:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790773013.664969:0:7408:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790773013.664970:0:7408:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790773013.665006:0:7408:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1790773013.665029:0:7408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008769d7f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:7408:1877761495928960:0@lo:253: 00000100:00100000:3.0:1790773013.665198:0:7408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773013.665446:0:7408:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c614e168 going to sleep for 11 seconds 00000100:00100000:0.0:1790773013.665567:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495928960 00000100:00100000:0.0:1790773013.665578:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495928960 00000100:00100000:0.0:1790773013.665737:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790773013.665747:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000000628f057 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+12:7408:x1877761495928960:12345-0@lo:253: 20000000:01000000:0.0:1790773013.665790:0:6471:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1790773013.665796:0:6471:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:0.0:1790773013.665801:0:6471:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:0.0:1790773013.665805:0:6471:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:0.0:1790773013.665860:0:6471:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:0.0:1790773013.666143:0:6471:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790773013.666393:0:6471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1790773013.666418:0:6471:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1790773013.666438:0:6471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1790773013.666474:0:6471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1790773013.666493:0:6471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1790773013.666557:0:6471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:0.0:1790773013.666566:0:6471:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:0.0:1790773013.666579:0:6471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:0.0:1790773013.666585:0:6471:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:0.0:1790773013.666595:0:6471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:0.0:1790773013.666599:0:6471:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:0.0:1790773013.666610:0:6471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1790773013.666624:0:6471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1790773013.666750:0:6471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:0.0:1790773013.666760:0:6471:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.119@tcp (null) (null) (null) 00000040:00080000:0.0:1790773013.666773:0:6471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:0.0:1790773013.666779:0:6471:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1790773013.666794:0:6471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:0.0:1790773013.666799:0:6471:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.202.119@tcp (null) (null) 00000040:00080000:0.0:1790773013.666809:0:6471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:0.0:1790773013.666814:0:6471:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1790773013.666825:0:6471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1790773013.666839:0:6471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1790773013.666849:0:6471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1790773013.666948:0:6471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:0.0:1790773013.666958:0:6471:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:0.0:1790773013.666972:0:6471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1790773013.667012:0:6471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1790773013.667040:0:6471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:0.0:1790773013.667057:0:6471:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:0.0:1790773013.667076:0:6471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1790773013.667100:0:6471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1790773013.667107:0:6471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:0.0:1790773013.667138:0:6471:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1790773013.667146:0:6471:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:0.0:1790773013.668480:0:7414:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1790773013.668989:0:6471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1790773013.669024:0:6471:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.119@tcp for mdt 20000000:01000000:3.0:1790773013.669027:0:6471:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.119@tcp (null) (null) (null) 00000040:00080000:3.0:1790773013.669045:0:6471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1790773013.669052:0:6471:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1790773013.669154:0:6471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1790773013.669162:0:6471:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.202.119@tcp (null) (null) 00000040:00080000:3.0:1790773013.669194:0:6471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1790773013.669235:0:6471:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:3.0:1790773013.669254:0:6471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:3.0:1790773013.669273:0:6471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:3.0:1790773013.669357:0:6471:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:3.0:1790773013.669369:0:6471:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:2.0:1790773013.670175:0:7415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:3.0:1790773013.670542:0:6471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1790773013.670570:0:6471:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.202.119@tcp for mdt 20000000:01000000:3.0:1790773013.670573:0:6471:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.119@tcp (null) (null) (null) 00000040:00080000:3.0:1790773013.670588:0:6471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1790773013.670594:0:6471:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1790773013.670606:0:6471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1790773013.670611:0:6471:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.202.119@tcp (null) (null) 00000040:00080000:3.0:1790773013.670622:0:6471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1790773013.670873:0:6471:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:3.0:1790773013.671133:0:6471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1790773013.671160:0:6471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:3.0:1790773013.671192:0:6471:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1790773013.671196:0:6471:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1790773013.671201:0:6471:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1790773013.671816:0:6471:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1790773013.671819:0:6471:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1790773013.673145:0:7416:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1790773013.673530:0:7416:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1790773013.673562:0:7416:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:0.0:1790773013.673995:0:6471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1790773013.674025:0:6471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1790773013.674043:0:6471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:0.0:1790773013.674141:0:6471:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1790773013.674145:0:6471:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1790773013.675600:0:7417:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1790773013.675725:0:7417:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1790773013.675745:0:7417:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1790773013.676144:0:6471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:3.0:1790773013.676173:0:6471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:3.0:1790773013.676190:0:6471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:3.0:1790773013.676448:0:6471:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1790773013.676453:0:6471:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1790773013.676883:0:7418:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1790773013.677186:0:7418:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1790773013.677525:0:7418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1790773013.677890:0:6471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1790773013.678466:0:6471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1790773013.678513:0:6471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1790773013.678536:0:6471:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1790773013.678540:0:6471:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1790773013.678548:0:6471:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1790773013.678576:0:6471:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1790773013.679544:0:7419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:1.0:1790773013.679793:0:6471:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:1.0:1790773013.687915:0:6471:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1790773013.687993:0:6471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000006f10e4a7/0xabf1cc0bc7841537 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.688017:0:6471:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000079624829/0xabf1cc0bc784146c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7841465 expref: 12 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.688024:0:6471:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003d276718/0xabf1cc0bc7841488 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7841481 expref: 12 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.688030:0:6471:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000070f63d9f/0xabf1cc0bc78414f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78414f1 expref: 12 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.688037:0:6471:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000006f10e4a7/0xabf1cc0bc7841537 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.688084:0:6471:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000070f63d9f/0xabf1cc0bc78414f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc78414f1 expref: 12 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.688100:0:6471:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000070f63d9f/0xabf1cc0bc78414f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc78414f1 expref: 12 pid: 6471 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773013.688113:0:6471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f08e2b00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6471:1877761495929088:0@lo:104: 00000100:00100000:1.0:1790773013.688176:0:6471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790773013.688283:0:6471:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003d276718/0xabf1cc0bc7841488 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc7841481 expref: 12 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.688291:0:6471:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003d276718/0xabf1cc0bc7841488 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc7841481 expref: 12 pid: 6472 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773013.688313:0:6471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f8c10e51 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6471:1877761495929216:0@lo:104: 00000100:00100000:1.0:1790773013.688333:0:6471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790773013.688356:0:6471:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000079624829/0xabf1cc0bc784146c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc7841465 expref: 12 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.688363:0:6471:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000079624829/0xabf1cc0bc784146c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc7841465 expref: 12 pid: 6472 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773013.688370:0:6471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008901b1de pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6471:1877761495929344:0@lo:104: 00000100:00100000:1.0:1790773013.688386:0:6471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773013.688394:0:6471:0:(client.c:2716:ptlrpc_set_wait()) set 00000000631480e7 going to sleep for 11 seconds 00000100:00100000:0.0:1790773013.688596:0:6461:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495929088 00000100:00100000:0.0:1790773013.688613:0:6461:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495929088 00000100:00100000:0.0:1790773013.688691:0:6461:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495929216 00000100:00100000:0.0:1790773013.688694:0:6461:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495929216 00000100:00100000:0.0:1790773013.688706:0:6461:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495929344 00000100:00100000:0.0:1790773013.688709:0:6461:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495929344 00000100:00100000:0.0:1790773013.688726:0:6461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790773013.688736:0:6461:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000a0e9fa33 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce0675b4-b0c5-48e7-b182-565e22fed04c+5:6471:x1877761495929088:12345-0@lo:104: 00010000:00010000:0.0:1790773013.688756:0:6461:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: 0000000031c9ebac/0xabf1cc0bc78414f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc78414f8 expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773013.688882:0:6461:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790773013.688911:0:6461:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000a0e9fa33 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce0675b4-b0c5-48e7-b182-565e22fed04c+5:6471:x1877761495929088:12345-0@lo:104: Request processed in 176us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773013.688920:0:6461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790773013.688943:0:6461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790773013.688948:0:6461:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000b69eb200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce0675b4-b0c5-48e7-b182-565e22fed04c+4:6471:x1877761495929216:12345-0@lo:104: 00010000:00010000:0.0:1790773013.688956:0:6461:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: 00000000e71fde43/0xabf1cc0bc7841481 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7841488 expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773013.688992:0:6461:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790773013.688995:0:6461:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000b69eb200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce0675b4-b0c5-48e7-b182-565e22fed04c+4:6471:x1877761495929216:12345-0@lo:104: Request processed in 48us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773013.689001:0:6461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790773013.689013:0:6461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790773013.689018:0:6461:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000094f749cb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce0675b4-b0c5-48e7-b182-565e22fed04c+3:6471:x1877761495929344:12345-0@lo:104: 00010000:00010000:0.0:1790773013.689025:0:6461:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: 0000000023bdf60d/0xabf1cc0bc7841465 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc784146c expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773013.689052:0:6461:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1790773013.689067:0:6461:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000094f749cb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce0675b4-b0c5-48e7-b182-565e22fed04c+3:6471:x1877761495929344:12345-0@lo:104: Request processed in 50us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773013.689073:0:6461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1790773013.689091:0:6466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790773013.689097:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: 0000000031c9ebac/0xabf1cc0bc78414f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc78414f8 expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773013.689105:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000031c9ebac already unused, calling callback (000000000c3d7381) 10000000:00010000:0.0:1790773013.689108:0:6466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: 0000000031c9ebac/0xabf1cc0bc78414f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc78414f8 expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773013.689128:0:6466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: 0000000031c9ebac/0xabf1cc0bc78414f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc78414f8 expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790773013.689135:0:6466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: 0000000031c9ebac/0xabf1cc0bc78414f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc78414f8 expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790773013.689141:0:6466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790773013.689180:0:6466:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: 0000000031c9ebac/0xabf1cc0bc78414f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78414f8 expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773013.689187:0:6466:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790773013.689237:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: 0000000031c9ebac/0xabf1cc0bc78414f1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78414f8 expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773013.689245:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: 0000000031c9ebac/0xabf1cc0bc78414f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78414f8 expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773013.689261:0:6466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790773013.689263:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: 00000000e71fde43/0xabf1cc0bc7841481 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7841488 expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773013.689269:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e71fde43 already unused, calling callback (000000000c3d7381) 10000000:00010000:0.0:1790773013.689271:0:6466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: 00000000e71fde43/0xabf1cc0bc7841481 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc7841488 expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773013.689277:0:6466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: 00000000e71fde43/0xabf1cc0bc7841481 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc7841488 expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790773013.689283:0:6466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: 00000000e71fde43/0xabf1cc0bc7841481 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc7841488 expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790773013.689295:0:6466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790773013.689309:0:6466:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: 00000000e71fde43/0xabf1cc0bc7841481 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841488 expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773013.689315:0:6466:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790773013.689338:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: 00000000e71fde43/0xabf1cc0bc7841481 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841488 expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773013.689345:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: 00000000e71fde43/0xabf1cc0bc7841481 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841488 expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773013.689360:0:6466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790773013.689364:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: 0000000023bdf60d/0xabf1cc0bc7841465 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc784146c expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773013.689370:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000023bdf60d already unused, calling callback (000000000c3d7381) 10000000:00010000:0.0:1790773013.689372:0:6466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: 0000000023bdf60d/0xabf1cc0bc7841465 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc784146c expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773013.689379:0:6466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: 0000000023bdf60d/0xabf1cc0bc7841465 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc784146c expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790773013.689385:0:6466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: 0000000023bdf60d/0xabf1cc0bc7841465 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc784146c expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773013.689389:0:6471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f08e2b00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6471:1877761495929088:0@lo:104: 10000000:01000000:0.0:1790773013.689414:0:6466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1790773013.689428:0:6471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f8c10e51 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6471:1877761495929216:0@lo:104: 00010000:00010000:0.0:1790773013.689437:0:6466:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: 0000000023bdf60d/0xabf1cc0bc7841465 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc784146c expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773013.689442:0:6471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008901b1de pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6471:1877761495929344:0@lo:104: 00010000:00010000:0.0:1790773013.689458:0:6466:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790773013.689472:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: 0000000023bdf60d/0xabf1cc0bc7841465 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc784146c expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773013.689478:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: 0000000023bdf60d/0xabf1cc0bc7841465 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc784146c expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773013.689494:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773013.689496:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773013.689497:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773013.689507:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790773013.689518:0:6475:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1790773013.689522:0:6475:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93d25268e800 from 21 10000000:01000000:0.0:1790773013.689526:0:6475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790773013.689550:0:6475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: 00000000ce3d9e0a/0xabf1cc0bc784153e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773013.689558:0:6475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: 00000000ce3d9e0a/0xabf1cc0bc784153e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773013.689567:0:6475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: 00000000ce3d9e0a/0xabf1cc0bc784153e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773013.689585:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c165b51c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495929856:0@lo:101: 00000100:00100000:0.0:1790773013.689637:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790773013.689659:0:6471:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000006f10e4a7/0xabf1cc0bc7841537 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773013.689690:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set 000000003791fe28 going to sleep for 11 seconds 00000100:00100000:0.0:1790773013.689715:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c2bb6c0d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce0675b4-b0c5-48e7-b182-565e22fed04c:3607:1877761495929472:0@lo:103: 00000100:00100000:0.0:1790773013.689744:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773013.689793:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001bd7dd57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce0675b4-b0c5-48e7-b182-565e22fed04c:3604:1877761495929600:0@lo:103: 00000100:00100000:0.0:1790773013.689817:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773013.689837:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790773013.689849:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fc955ea7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce0675b4-b0c5-48e7-b182-565e22fed04c:3604:1877761495929728:0@lo:103: 00000100:00100000:0.0:1790773013.689869:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773013.689901:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495929856 00000100:00100000:0.0:1790773013.689906:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495929856 00000100:00100000:0.0:1790773013.689947:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790773013.689954:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000000c4cb96e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+13:6475:x1877761495929856:12345-0@lo:101: 00000100:00100000:1.0:1790773013.689974:0:6463:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495929472 00010000:00010000:0.0:1790773013.689975:0:6472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790773013.689988:0:6463:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495929472 00010000:00010000:0.0:1790773013.689997:0:6472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bb30bf7b/0xabf1cc0bc7841545 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc784153e expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773013.690026:0:6472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000006f10e4a7/0xabf1cc0bc7841537 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.690033:0:6463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000070f63d9f/0xabf1cc0bc78414f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc78414f1 expref: 15 pid: 6471 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773013.690046:0:6472:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000bb30bf7b/0xabf1cc0bc7841545 lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc784153e expref: 15 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773013.690079:0:6472:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: MGS lock: 000000006f10e4a7/0xabf1cc0bc7841537 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773013.690085:0:6463:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495929600 00010000:00010000:0.0:1790773013.690099:0:6472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bb30bf7b/0xabf1cc0bc7841545 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc784153e expref: 15 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773013.690111:0:6472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bb30bf7b, rc 0) 00000100:00100000:0.0:1790773013.690141:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000000c4cb96e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:6475:x1877761495929856:12345-0@lo:101: Request processed in 189us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773013.690148:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790773013.690181:0:6464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495929728 00000100:00100000:0.0:1790773013.690185:0:6464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495929728 00010000:00010000:0.0:1790773013.690197:0:6464:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000079624829/0xabf1cc0bc784146c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7841465 expref: 15 pid: 6472 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773013.690256:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790773013.690262:0:6464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000005b0ed42 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:3607:x1877761495929472:12345-0@lo:103: 00010000:00010000:0.0:1790773013.690272:0:6464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773013.690276:0:6464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000070f63d9f/0xabf1cc0bc78414f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc78414f1 expref: 15 pid: 6471 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773013.690287:0:6464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000070f63d9f/0xabf1cc0bc78414f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc78414f1 expref: 15 pid: 6471 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773013.690300:0:6464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000070f63d9f/0xabf1cc0bc78414f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc78414f1 expref: 15 pid: 6471 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773013.690312:0:6464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790773013.690338:0:6464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000005b0ed42 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+14:3607:x1877761495929472:12345-0@lo:103: Request processed in 78us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773013.690344:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790773013.690358:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790773013.690363:0:6464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000012d57a8f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+13:3604:x1877761495929728:12345-0@lo:103: 00010000:00010000:0.0:1790773013.690371:0:6464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773013.690374:0:6464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000079624829/0xabf1cc0bc784146c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7841465 expref: 13 pid: 6472 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773013.690382:0:6464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000079624829/0xabf1cc0bc784146c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc7841465 expref: 13 pid: 6472 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773013.690390:0:6464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000079624829/0xabf1cc0bc784146c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc7841465 expref: 13 pid: 6472 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773013.690423:0:6464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790773013.690449:0:6464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000012d57a8f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+12:3604:x1877761495929728:12345-0@lo:103: Request processed in 87us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773013.690456:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790773013.690520:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c2bb6c0d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce0675b4-b0c5-48e7-b182-565e22fed04c:3607:1877761495929472:0@lo:103: 00000100:00100000:0.0:1790773013.690549:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fc955ea7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce0675b4-b0c5-48e7-b182-565e22fed04c:3604:1877761495929728:0@lo:103: 00000100:00100000:0.0:1790773013.690569:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c165b51c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495929856:0@lo:101: 00010000:00010000:0.0:1790773013.690583:0:6475:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGC192.168.202.119@tcp lock: 00000000ce3d9e0a/0xabf1cc0bc784153e lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841545 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773013.690592:0:6475:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGC192.168.202.119@tcp lock: 00000000ce3d9e0a/0xabf1cc0bc784153e lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7841545 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773013.691899:0:6463:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495929600 00010000:00010000:1.0:1790773013.691946:0:6463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003d276718/0xabf1cc0bc7841488 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7841481 expref: 12 pid: 6472 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773013.691988:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790773013.692009:0:6463:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000008086c044 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce0675b4-b0c5-48e7-b182-565e22fed04c+12:3604:x1877761495929600:12345-0@lo:103: 00010000:00010000:1.0:1790773013.692022:0:6463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790773013.692027:0:6463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003d276718/0xabf1cc0bc7841488 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7841481 expref: 12 pid: 6472 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.692037:0:6463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003d276718/0xabf1cc0bc7841488 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc7841481 expref: 12 pid: 6472 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.692054:0:6463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003d276718/0xabf1cc0bc7841488 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc7841481 expref: 12 pid: 6472 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.692074:0:6463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000006f10e4a7/0xabf1cc0bc7841537 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.692081:0:6463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006f10e4a7/0xabf1cc0bc7841537 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.692360:0:6463:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006f10e4a7/0xabf1cc0bc7841537 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.692369:0:6463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006f10e4a7/0xabf1cc0bc7841537 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.692375:0:6463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000006f10e4a7/0xabf1cc0bc7841537 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.692382:0:6463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000006f10e4a7/0xabf1cc0bc7841537 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.692389:0:6463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006f10e4a7 already unused, calling callback (0000000035eb843c) 00010000:00010000:1.0:1790773013.692392:0:6463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000006f10e4a7/0xabf1cc0bc7841537 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.692590:0:6463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000006f10e4a7/0xabf1cc0bc7841537 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000020 nid: local remote: 0x0 expref: -99 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773013.692877:0:6471:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000006f10e4a7/0xabf1cc0bc7841537 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773013.692896:0:6471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000006f10e4a7/0xabf1cc0bc7841537 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790773013.692907:0:6471:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00010000:00010000:1.0:1790773013.694902:0:6463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000bb30bf7b/0xabf1cc0bc7841545 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 0@lo remote: 0xabf1cc0bc784153e expref: 11 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.694922:0:6463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bb30bf7b/0xabf1cc0bc7841545 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 0@lo remote: 0xabf1cc0bc784153e expref: 11 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.694974:0:6463:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: MGS lock: 00000000bb30bf7b/0xabf1cc0bc7841545 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc784153e expref: 11 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773013.694992:0:6463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008901b1de pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:MGS:6463:1877761495929984:0@lo:105: 00000100:00100000:1.0:1790773013.695067:0:6463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773013.695124:0:6463:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e0aac9b9 going to sleep for 11 seconds 00000100:00100000:3.0:1790773013.695187:0:6461:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495929984 00000100:00100000:3.0:1790773013.695197:0:6461:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495929984 00000100:00100000:3.0:1790773013.695277:0:6461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790773013.695289:0:6461:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000f8c10e51 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce0675b4-b0c5-48e7-b182-565e22fed04c+3:6463:x1877761495929984:12345-0@lo:105: 00010000:00010000:3.0:1790773013.695299:0:6461:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: MGC192.168.202.119@tcp lock: 00000000ce3d9e0a/0xabf1cc0bc784153e lrc: 5/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7841545 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773013.695310:0:6461:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: MGC192.168.202.119@tcp lock: 00000000ce3d9e0a/0xabf1cc0bc784153e lrc: 5/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7841545 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773013.695319:0:6461:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGC192.168.202.119@tcp lock: 00000000ce3d9e0a/0xabf1cc0bc784153e lrc: 5/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11080000000000 nid: local remote: 0xabf1cc0bc7841545 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773013.695324:0:6461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: 00000000ce3d9e0a/0xabf1cc0bc784153e lrc: 6/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11080000000000 nid: local remote: 0xabf1cc0bc7841545 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773013.695330:0:6461:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: MGC192.168.202.119@tcp lock: 00000000ce3d9e0a/0xabf1cc0bc784153e lrc: 6/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1080000000000 nid: local remote: 0xabf1cc0bc7841545 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773013.695348:0:6461:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock 00000000ce3d9e0a) 00000100:00100000:3.0:1790773013.695391:0:6461:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000f8c10e51 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce0675b4-b0c5-48e7-b182-565e22fed04c+3:6463:x1877761495929984:12345-0@lo:105: Request processed in 107us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773013.695398:0:6461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790773013.695532:0:6463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008901b1de pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:MGS:6463:1877761495929984:0@lo:105: 00010000:00010000:1.0:1790773013.695554:0:6463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000006f10e4a7/0xabf1cc0bc7841537 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.695563:0:6463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006f10e4a7/0xabf1cc0bc7841537 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.695575:0:6463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790773013.695623:0:6463:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000008086c044 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce0675b4-b0c5-48e7-b182-565e22fed04c+11:3604:x1877761495929600:12345-0@lo:103: Request processed in 3615us (5806us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773013.695630:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790773013.695694:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001bd7dd57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce0675b4-b0c5-48e7-b182-565e22fed04c:3604:1877761495929600:0@lo:103: 00010000:00010000:0.0:1790773013.697887:0:6475:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGC192.168.202.119@tcp lock: 00000000ce3d9e0a/0xabf1cc0bc784153e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7841545 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773013.697991:0:6475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: 00000000ce3d9e0a/0xabf1cc0bc784153e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7841545 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773013.697994:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000000628f057 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+10:7408:x1877761495928960:12345-0@lo:253: Request processed in 32241us (32789us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773013.698026:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790773013.701077:0:7408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008769d7f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:7408:1877761495928960:0@lo:253: 10000000:01000000:1.0:1790773013.701105:0:7408:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1790773013.701127:0:7408:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790773013.701129:0:7408:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1790773013.701131:0:7408:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790773013.701132:0:7408:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:1.0:1790773013.701133:0:7408:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790773013.701134:0:7408:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790773013.701135:0:7408:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790773013.701137:0:7408:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1790773013.701138:0:7408:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790773013.701140:0:7408:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1790773013.701163:0:7408:0:(tgt_mount.c:101:server_register_mount()) register mount 000000007aca9f9c from lustre-MDT0001 10000000:01000000:1.0:1790773013.701195:0:7408:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1790773013.701197:0:7408:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1790773013.701226:0:7408:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93d262660000 local copy 10000000:01000000:1.0:1790773013.701231:0:7408:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1790773013.701273:0:7408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: 00000000ae043cb9/0xabf1cc0bc784154c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.701285:0:7408:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.119@tcp lock: 00000000ae043cb9/0xabf1cc0bc784154c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.701293:0:7408:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: 00000000ae043cb9/0xabf1cc0bc784154c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773013.701311:0:7408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008901b1de pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:7408:1877761495930112:0@lo:101: 00000100:00100000:1.0:1790773013.701376:0:7408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773013.701443:0:7408:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e0aac9b9 going to sleep for 11 seconds 00000100:00100000:0.0:1790773013.703706:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c165b51c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495930240:0@lo:501: 00000100:00100000:0.0:1790773013.703816:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773013.703891:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set 0000000003080f03 going to sleep for 11 seconds 00000100:00100000:1.0:1790773013.703952:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495930112 00000100:00100000:1.0:1790773013.703970:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495930112 00000100:00100000:1.0:1790773013.704037:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495930240 00000100:00100000:1.0:1790773013.704040:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495930240 00000100:00100000:1.0:1790773013.704058:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790773013.704064:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000bad74dec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+11:7408:x1877761495930112:12345-0@lo:101: 00010000:00010000:1.0:1790773013.704101:0:6473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773013.704120:0:6473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a6358dbf/0xabf1cc0bc7841553 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc784154c expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.704148:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a6358dbf/0xabf1cc0bc7841553 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc784154c expref: 12 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.704158:0:6473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a6358dbf/0xabf1cc0bc7841553 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc784154c expref: 12 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.704167:0:6473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a6358dbf, rc 0) 00000100:00100000:1.0:1790773013.704282:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000bad74dec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+12:7408:x1877761495930112:12345-0@lo:101: Request processed in 217us (2906us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773013.704289:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790773013.704320:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790773013.704324:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000006bf5112 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+11:6475:x1877761495930240:12345-0@lo:501: 00000100:00100000:1.0:1790773013.704446:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000006bf5112 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+11:6475:x1877761495930240:12345-0@lo:501: Request processed in 122us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773013.704452:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790773013.705257:0:7408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008901b1de pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:7408:1877761495930112:0@lo:101: 00010000:00010000:0.0:1790773013.705298:0:7408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: 00000000ae043cb9/0xabf1cc0bc784154c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0xabf1cc0bc7841553 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773013.705337:0:7408:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: 00000000ae043cb9/0xabf1cc0bc784154c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0xabf1cc0bc7841553 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773013.705813:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c165b51c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495930240:0@lo:501: 00000100:00100000:0.0:1790773013.706191:0:7408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fc955ea7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:7408:1877761495930368:0@lo:501: 00000100:00100000:1.0:1790773013.706535:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f08e2b00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495930496:0@lo:503: 00000100:00100000:1.0:1790773013.707328:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773013.707388:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set 0000000045c13dee going to sleep for 11 seconds 00000100:00100000:2.0:1790773013.707588:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495930496 00000100:00100000:2.0:1790773013.707598:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495930496 00000100:00100000:2.0:1790773013.707689:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790773013.707697:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000001ca9e420 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+11:6475:x1877761495930496:12345-0@lo:503: 00000100:00100000:2.0:1790773013.707846:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000001ca9e420 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+11:6475:x1877761495930496:12345-0@lo:503: Request processed in 150us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773013.707854:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790773013.707936:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f08e2b00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495930496:0@lo:503: 00000100:00100000:1.0:1790773013.708182:0:7420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f08e2b00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:7420:1877761495930624:0@lo:502: 00000100:00100000:1.0:1790773013.708254:0:7420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773013.709137:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495930624 00000100:00100000:3.0:1790773013.709146:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495930624 00000100:00100000:3.0:1790773013.709178:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790773013.709184:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000007c8437af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+11:7420:x1877761495930624:12345-0@lo:502: 00000100:00100000:3.0:1790773013.709316:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000007c8437af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+11:7420:x1877761495930624:12345-0@lo:502: Request processed in 132us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773013.709322:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790773013.710559:0:7420:0:(client.c:2716:ptlrpc_set_wait()) set 00000000382cfa7d going to sleep for 11 seconds 00000100:00100000:1.0:1790773013.710588:0:7420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f08e2b00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:7420:1877761495930624:0@lo:502: 00000100:00100000:1.0:1790773013.710661:0:7420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f08e2b00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:7420:1877761495930752:0@lo:502: 00000100:00100000:1.0:1790773013.710709:0:7420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773013.710788:0:7420:0:(client.c:2716:ptlrpc_set_wait()) set 00000000382cfa7d going to sleep for 11 seconds 00000100:00100000:3.0:1790773013.710988:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495930752 00000100:00100000:3.0:1790773013.710993:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495930752 00000100:00100000:3.0:1790773013.712393:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790773013.712421:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000000b46961f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+11:7420:x1877761495930752:12345-0@lo:502: 00000100:00100000:3.0:1790773013.712621:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000000b46961f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+11:7420:x1877761495930752:12345-0@lo:502: Request processed in 207us (1911us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773013.712629:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790773013.713640:0:7420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f08e2b00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:7420:1877761495930752:0@lo:502: 00000040:00080000:1.0:1790773013.713683:0:7420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1790773013.713760:0:6475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1790773013.713782:0:6475:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790773013.713791:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: 00000000ce3d9e0a/0xabf1cc0bc784153e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841545 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.713802:0:6475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: 00000000ce3d9e0a/0xabf1cc0bc784153e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841545 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790773013.713813:0:6475:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1790773013.713816:0:6475:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1790773013.713818:0:6475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1790773013.713852:0:6475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: 000000006f10e4a7/0xabf1cc0bc784155a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.713859:0:6475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: 000000006f10e4a7/0xabf1cc0bc784155a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.713868:0:6475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: 000000006f10e4a7/0xabf1cc0bc784155a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773013.713887:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f08e2b00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495930880:0@lo:101: 00000100:00100000:1.0:1790773013.713928:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773013.713955:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set 00000000382cfa7d going to sleep for 11 seconds 00000100:00100000:1.0:1790773013.713970:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495930880 00000100:00100000:1.0:1790773013.713985:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495930880 00000100:00100000:1.0:1790773013.714025:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790773013.714031:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000125d96ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+11:6475:x1877761495930880:12345-0@lo:101: 00010000:00010000:1.0:1790773013.714042:0:6473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773013.714052:0:6473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000004c4a35f/0xabf1cc0bc7841561 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc784155a expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.714072:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000004c4a35f/0xabf1cc0bc7841561 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc784155a expref: 12 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.714080:0:6473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000004c4a35f/0xabf1cc0bc7841561 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc784155a expref: 12 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.714089:0:6473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000004c4a35f, rc 0) 00000100:00100000:1.0:1790773013.714115:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000125d96ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+12:6475:x1877761495930880:12345-0@lo:101: Request processed in 84us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773013.714122:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790773013.714153:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f08e2b00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495930880:0@lo:101: 00010000:00010000:1.0:1790773013.714163:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: 000000006f10e4a7/0xabf1cc0bc784155a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841561 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.714170:0:6475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: 000000006f10e4a7/0xabf1cc0bc784155a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7841561 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773013.714227:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f08e2b00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495931008:0@lo:501: 00000100:00100000:1.0:1790773013.714248:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773013.714259:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set 00000000382cfa7d going to sleep for 11 seconds 00000100:00100000:1.0:1790773013.714268:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495931008 00000100:00100000:1.0:1790773013.714270:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495931008 00000100:00100000:1.0:1790773013.714289:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790773013.714293:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000654288c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+12:6475:x1877761495931008:12345-0@lo:501: 00000100:00100000:1.0:1790773013.714381:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000654288c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+12:6475:x1877761495931008:12345-0@lo:501: Request processed in 88us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773013.714387:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790773013.714432:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f08e2b00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495931008:0@lo:501: 00000100:00100000:1.0:1790773013.714452:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f08e2b00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495931136:0@lo:503: 00000100:00100000:1.0:1790773013.716855:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773013.716946:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set 00000000382cfa7d going to sleep for 11 seconds 00000100:00100000:1.0:1790773013.716974:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495931136 00000100:00100000:1.0:1790773013.716982:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495931136 00000100:00100000:1.0:1790773013.717025:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790773013.717031:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000a2276983 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+12:6475:x1877761495931136:12345-0@lo:503: 00000100:00100000:1.0:1790773013.717145:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000a2276983 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+12:6475:x1877761495931136:12345-0@lo:503: Request processed in 114us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773013.717151:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790773013.717197:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f08e2b00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495931136:0@lo:503: 00000100:00100000:0.0:1790773013.717596:0:7408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773013.717842:0:7408:0:(client.c:2716:ptlrpc_set_wait()) set 000000003791fe28 going to sleep for 11 seconds 00000100:00100000:3.0:1790773013.718756:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495930368 00000100:00100000:3.0:1790773013.718769:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495930368 00000100:00100000:3.0:1790773013.718812:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790773013.718820:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000007d8ab4ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+12:7408:x1877761495930368:12345-0@lo:501: 00000100:00100000:3.0:1790773013.721777:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000007d8ab4ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+12:7408:x1877761495930368:12345-0@lo:501: Request processed in 2950us (5484us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790773013.721792:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790773013.723326:0:7421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007e1e382e pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:7421:1877761495931264:0@lo:502: 00000100:00100000:2.0:1790773013.723673:0:7421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773013.723778:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495931264 00000100:00100000:1.0:1790773013.723789:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495931264 00000100:00100000:1.0:1790773013.723852:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790773013.723860:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000000b0810d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+12:7421:x1877761495931264:12345-0@lo:502: 00000100:00100000:1.0:1790773013.723978:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000000b0810d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+12:7421:x1877761495931264:12345-0@lo:502: Request processed in 118us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773013.723985:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790773013.724146:0:7408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fc955ea7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:7408:1877761495930368:0@lo:501: 10000000:01000000:3.0:1790773013.724168:0:7408:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.119@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1790773013.724238:0:7408:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.119@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1790773013.724246:0:7408:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: 00000000ae043cb9/0xabf1cc0bc784154c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0xabf1cc0bc7841553 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773013.724256:0:7408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: 00000000ae043cb9/0xabf1cc0bc784154c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000400000000 nid: local remote: 0xabf1cc0bc7841553 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773013.724262:0:7408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: 00000000ae043cb9/0xabf1cc0bc784154c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000400000000 nid: local remote: 0xabf1cc0bc7841553 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773013.724281:0:7408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1790773013.724308:0:7408:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93d26ed89000 10000000:01000000:3.0:1790773013.724314:0:7408:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790773013.724320:0:7408:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff93d262660000 10000000:01000000:3.0:1790773013.724323:0:7408:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1790773013.724326:0:7408:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff93d262660000 from 1 10000000:01000000:3.0:1790773013.724329:0:7408:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1790773013.724356:0:7408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: 0000000086c2bb83/0xabf1cc0bc7841568 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773013.724364:0:7408:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: 0000000086c2bb83/0xabf1cc0bc7841568 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773013.724374:0:7408:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: 0000000086c2bb83/0xabf1cc0bc7841568 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773013.724387:0:7408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005590c511 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:7408:1877761495931392:0@lo:101: 00000100:00100000:3.0:1790773013.724429:0:7408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773013.724478:0:7408:0:(client.c:2716:ptlrpc_set_wait()) set 00000000def05499 going to sleep for 11 seconds 00000100:00100000:1.0:1790773013.724716:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495931392 00000100:00100000:1.0:1790773013.724721:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495931392 00000100:00100000:1.0:1790773013.724759:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790773013.724764:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000044b2f90e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+12:7408:x1877761495931392:12345-0@lo:101: 00010000:00010000:1.0:1790773013.724773:0:6472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773013.724785:0:6472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006a75ffa3/0xabf1cc0bc784156f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7841568 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.724806:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006a75ffa3/0xabf1cc0bc784156f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7841568 expref: 13 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.724816:0:6472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006a75ffa3/0xabf1cc0bc784156f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7841568 expref: 13 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.724823:0:6472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006a75ffa3, rc 0) 00000100:00100000:1.0:1790773013.724851:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000044b2f90e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+13:7408:x1877761495931392:12345-0@lo:101: Request processed in 88us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773013.724856:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790773013.724886:0:7408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005590c511 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:7408:1877761495931392:0@lo:101: 00010000:00010000:1.0:1790773013.724897:0:7408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: 0000000086c2bb83/0xabf1cc0bc7841568 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc784156f expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.724905:0:7408:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: 0000000086c2bb83/0xabf1cc0bc7841568 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc784156f expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790773013.724920:0:7408:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1790773013.724923:0:7408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: 0000000086c2bb83/0xabf1cc0bc7841568 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc784156f expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.724929:0:7408:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: 0000000086c2bb83/0xabf1cc0bc7841568 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc784156f expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790773013.724945:0:7408:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff93d26ed89000 10000000:01000000:1.0:1790773013.724948:0:7408:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1790773013.724951:0:7408:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff93d26ed89000 from 1 10000000:01000000:1.0:1790773013.724953:0:7408:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1790773013.724966:0:7408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: 0000000070f63d9f/0xabf1cc0bc7841576 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.724972:0:7408:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: 0000000070f63d9f/0xabf1cc0bc7841576 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.724978:0:7408:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: 0000000070f63d9f/0xabf1cc0bc7841576 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773013.724990:0:7408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f08e2b00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:7408:1877761495931520:0@lo:101: 00010000:00010000:0.0:1790773013.725001:0:6466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1790773013.725020:0:7408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773013.725037:0:7408:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ec729688 going to sleep for 11 seconds 00000100:00100000:1.0:1790773013.725051:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495931520 00000100:00100000:1.0:1790773013.725054:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495931520 00000100:00100000:1.0:1790773013.725074:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790773013.725078:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000004eb8fe54 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+13:7408:x1877761495931520:12345-0@lo:101: 00010000:00010000:1.0:1790773013.725084:0:6472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773013.725089:0:6472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e71fde43/0xabf1cc0bc784157d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7841576 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.725100:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e71fde43/0xabf1cc0bc784157d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7841576 expref: 14 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.725107:0:6472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e71fde43/0xabf1cc0bc784157d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7841576 expref: 14 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.725117:0:6472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e71fde43, rc 0) 00000100:00100000:1.0:1790773013.725139:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000004eb8fe54 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+14:7408:x1877761495931520:12345-0@lo:101: Request processed in 61us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773013.725144:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:0.0:1790773013.725170:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: 00000000ae043cb9/0xabf1cc0bc784154c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0xabf1cc0bc7841553 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773013.725176:0:7408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f08e2b00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:7408:1877761495931520:0@lo:101: 00010000:00010000:1.0:1790773013.725196:0:7408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: 0000000070f63d9f/0xabf1cc0bc7841576 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc784157d expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773013.725198:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ae043cb9 already unused, calling callback (000000000c3d7381) 10000000:00010000:0.0:1790773013.725240:0:6466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: 00000000ae043cb9/0xabf1cc0bc784154c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0xabf1cc0bc7841553 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.725245:0:7408:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: 0000000070f63d9f/0xabf1cc0bc7841576 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc784157d expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790773013.725256:0:7408:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1790773013.725259:0:7408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: 0000000070f63d9f/0xabf1cc0bc7841576 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc784157d expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.725264:0:7408:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: 0000000070f63d9f/0xabf1cc0bc7841576 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc784157d expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790773013.725270:0:7408:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1790773013.725273:0:7408:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790773013.725278:0:7408:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff93d26ed89000 10000000:01000000:1.0:1790773013.725280:0:7408:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1790773013.725283:0:7408:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1790773013.725284:0:7408:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1790773013.725305:0:7408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: 000000007cd642b5/0xabf1cc0bc7841584 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.725311:0:7408:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: 000000007cd642b5/0xabf1cc0bc7841584 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.725323:0:7408:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: 000000007cd642b5/0xabf1cc0bc7841584 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773013.725333:0:7408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f08e2b00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:7408:1877761495931648:0@lo:101: 00000100:00100000:1.0:1790773013.725353:0:7408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773013.725369:0:7408:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ec729688 going to sleep for 11 seconds 00000100:00100000:1.0:1790773013.725379:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495931648 00000100:00100000:1.0:1790773013.725382:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495931648 00000100:00100000:1.0:1790773013.725396:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790773013.725400:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000c7538c03 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+14:7408:x1877761495931648:12345-0@lo:101: 00010000:00010000:1.0:1790773013.725418:0:6472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773013.725424:0:6472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000037a5f5ad/0xabf1cc0bc784158b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7841584 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.725435:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000037a5f5ad/0xabf1cc0bc784158b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7841584 expref: 15 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.725442:0:6472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000037a5f5ad/0xabf1cc0bc784158b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7841584 expref: 15 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.725448:0:6472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000037a5f5ad, rc 0) 00000100:00100000:1.0:1790773013.725677:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000c7538c03 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:7408:x1877761495931648:12345-0@lo:101: Request processed in 276us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773013.725682:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:0.0:1790773013.725722:0:6466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: 00000000ae043cb9/0xabf1cc0bc784154c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x8400000000 nid: local remote: 0xabf1cc0bc7841553 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790773013.725731:0:6466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: 00000000ae043cb9/0xabf1cc0bc784154c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x9400000000 nid: local remote: 0xabf1cc0bc7841553 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790773013.725739:0:6466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1790773013.725759:0:7421:0:(client.c:2716:ptlrpc_set_wait()) set 000000005521e2e9 going to sleep for 11 seconds 00000100:00100000:3.0:1790773013.725788:0:7421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007e1e382e pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:7421:1877761495931264:0@lo:502: 00010000:00010000:0.0:1790773013.725795:0:6466:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: 00000000ae043cb9/0xabf1cc0bc784154c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x4809400000020 nid: local remote: 0xabf1cc0bc7841553 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773013.725805:0:6466:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:01000000:3.0:1790773013.725829:0:7421:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00010000:00010000:0.0:1790773013.725849:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: 00000000ae043cb9/0xabf1cc0bc784154c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x4809400000020 nid: local remote: 0xabf1cc0bc7841553 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1790773013.725859:0:7421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00010000:00010000:0.0:1790773013.725860:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: 00000000ae043cb9/0xabf1cc0bc784154c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x4809400000020 nid: local remote: 0xabf1cc0bc7841553 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1790773013.725865:0:7421:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1790773013.725871:0:7421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1790773013.725876:0:7421:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.119@tcp to nid 0x20000c0a8ca77 (192.168.202.119@tcp) 00000020:00000080:3.0:1790773013.725908:0:7421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790773013.725924:0:7421:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (000000000d53b779) 00000020:00000080:3.0:1790773013.725945:0:7421:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1790773013.725950:0:7421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790773013.726049:0:7421:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1790773013.726056:0:7421:0:(osd_handler.c:8931:osd_obd_connect()) connect #5 00000020:00000080:3.0:1790773013.726064:0:7421:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xabf1cc0bc7841599 00010000:00080000:3.0:1790773013.726108:0:7421:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000cd64ad0c@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.119@tcp at head 00010000:00010000:0.0:1790773013.726777:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773013.726783:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773013.726786:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773013.726811:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790773013.726834:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c2bb6c0d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce0675b4-b0c5-48e7-b182-565e22fed04c:3607:1877761495931776:0@lo:103: 00000100:00100000:0.0:1790773013.726930:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773013.727014:0:6465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495931776 00000100:00100000:0.0:1790773013.727023:0:6465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495931776 00000100:00100000:0.0:1790773013.727177:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790773013.727189:0:6465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000c0136772 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:3607:x1877761495931776:12345-0@lo:103: 00010000:00010000:0.0:1790773013.727232:0:6465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773013.727262:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a6358dbf/0xabf1cc0bc7841553 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xabf1cc0bc784154c expref: 15 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773013.727278:0:6465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790773013.727328:0:6465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000c0136772 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+14:3607:x1877761495931776:12345-0@lo:103: Request processed in 142us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773013.727336:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790773013.727860:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c2bb6c0d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce0675b4-b0c5-48e7-b182-565e22fed04c:3607:1877761495931776:0@lo:103: 00010000:00010000:3.0:1790773013.730991:0:7421:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-2 is initialized 00000100:00100000:2.0:1790773013.731425:0:7408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f08e2b00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:7408:1877761495931648:0@lo:101: 00010000:00010000:2.0:1790773013.731744:0:7408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: 000000007cd642b5/0xabf1cc0bc7841584 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc784158b expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773013.731758:0:7408:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: 000000007cd642b5/0xabf1cc0bc7841584 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc784158b expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773013.731887:0:7408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000097d5cf85 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:7408:1877761495931904:0@lo:501: 00000100:00100000:2.0:1790773013.731960:0:7408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773013.732040:0:7408:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a86f5513 going to sleep for 11 seconds 00000020:00000080:3.0:1790773013.732545:0:7421:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790773013.732558:0:7421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1790773013.732588:0:7421:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1790773013.732607:0:7421:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xabf1cc0bc78415a0 00000100:00080000:3.0:1790773013.732614:0:7421:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790773013.732622:0:7421:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000cd64ad0c using connection 192.168.202.119@tcp/0@lo 00000100:00100000:3.0:1790773013.732644:0:7421:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ee4d1af8 x1877761495932032/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790773013.732670:0:7421:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:3.0:1790773013.732712:0:7421:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:0.0:1790773013.732829:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c2bb6c0d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3607:1877761495932160:0@lo:400: 00000100:00100000:2.0:1790773013.733077:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ee4d1af8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761495932032:0@lo:38: 00000100:00100000:1.0:1790773013.733263:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495931904 00000100:00100000:1.0:1790773013.733271:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495931904 00000100:00100000:1.0:1790773013.733312:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790773013.733321:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000032a7c299 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+14:7408:x1877761495931904:12345-0@lo:501: 00000100:00100000:1.0:1790773013.734013:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000032a7c299 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+14:7408:x1877761495931904:12345-0@lo:501: Request processed in 691us (2051us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773013.734023:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790773013.734056:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773013.734160:0:6483:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495932032 00000100:00100000:2.0:1790773013.734165:0:6483:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495932032 00000100:00100000:2.0:1790773013.734235:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790773013.734240:0:6483:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000006851cfbd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3603:x1877761495932032:12345-0@lo:38: 00010000:00020000:2.0:1790773013.734255:0:6483:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790773013.734289:0:6483:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000006851cfbd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3603:x1877761495932032:12345-0@lo:38: Request processed in 49us (235us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790773013.734295:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790773013.734487:0:7408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000097d5cf85 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:7408:1877761495931904:0@lo:501: 00000100:00100000:1.0:1790773013.734543:0:7408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c7946659 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:7408:1877761495932288:0@lo:503: 00000100:00100000:0.0:1790773013.734545:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773013.734619:0:7408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773013.734659:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495932160 00000100:00100000:1.0:1790773013.734664:0:7408:0:(client.c:2716:ptlrpc_set_wait()) set 000000001f29d135 going to sleep for 11 seconds 00000100:00100000:0.0:1790773013.734669:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495932160 00000100:00100000:1.0:1790773013.734693:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495932288 00000100:00100000:1.0:1790773013.734702:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495932288 00000100:00100000:0.0:1790773013.734738:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790773013.734750:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000003439326e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1877761495932160:12345-0@lo:400: 00000100:00100000:1.0:1790773013.734759:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790773013.734773:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000006ab90ced pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+14:7408:x1877761495932288:12345-0@lo:503: 00000100:00100000:0.0:1790773013.734828:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000003439326e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1877761495932160:12345-0@lo:400: Request processed in 81us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773013.734851:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790773013.734895:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000006ab90ced pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+14:7408:x1877761495932288:12345-0@lo:503: Request processed in 126us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773013.734906:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790773013.734968:0:7408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c7946659 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:7408:1877761495932288:0@lo:503: 00000040:00080000:1.0:1790773013.735417:0:7408:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790773013.735494:0:7408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c7946659 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:7408:1877761495932416:0@lo:502: 00010000:00080000:0.0:1790773013.735509:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c2bb6c0d x1877761495932160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773013.735527:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c2bb6c0d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3607:1877761495932160:0@lo:400: 00000100:00100000:1.0:1790773013.735544:0:7408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773013.735591:0:7408:0:(client.c:2716:ptlrpc_set_wait()) set 000000001f29d135 going to sleep for 11 seconds 00000100:00100000:1.0:1790773013.735618:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495932416 00000100:00100000:1.0:1790773013.735623:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495932416 00000100:00100000:1.0:1790773013.735662:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790773013.735668:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000a58bb065 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+14:7408:x1877761495932416:12345-0@lo:502: 00000100:00100000:1.0:1790773013.735758:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000a58bb065 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+14:7408:x1877761495932416:12345-0@lo:502: Request processed in 91us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773013.735777:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790773013.735805:0:7408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c7946659 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:7408:1877761495932416:0@lo:502: 00000100:00080000:1.0:1790773013.735942:0:7424:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@000000000f96c86d x1877761495932544/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773013.735954:0:7424:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b4d05e43 going to sleep for 0 seconds 00000020:01000000:1.0:1790773013.736020:0:7421:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790773013.736027:0:7421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790773013.736029:0:7421:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1790773013.736032:0:7421:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790773013.736036:0:7421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790773013.736038:0:7421:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790773013.736041:0:7421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790773013.736043:0:7421:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1790773013.736060:0:7421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003bb5ede5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:7421:1877761495932672:0@lo:502: 00000100:00100000:1.0:1790773013.736094:0:7421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773013.736314:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495932672 00000100:00100000:1.0:1790773013.736319:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495932672 00000100:00100000:1.0:1790773013.736342:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790773013.736347:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000273cdd22 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+14:7421:x1877761495932672:12345-0@lo:502: 00000100:00100000:1.0:1790773013.736434:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000273cdd22 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+14:7421:x1877761495932672:12345-0@lo:502: Request processed in 86us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773013.736441:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790773013.736471:0:7421:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e65eef18 going to sleep for 11 seconds 00000100:00100000:1.0:1790773013.736486:0:7421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003bb5ede5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:7421:1877761495932672:0@lo:502: 00000020:01000000:1.0:1790773013.736506:0:7421:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790773013.736510:0:7421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790773013.736511:0:7421:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1790773013.736515:0:7421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1790773013.736565:0:6475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1790773013.736594:0:6475:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1790773013.736603:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: 000000006f10e4a7/0xabf1cc0bc784155a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841561 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.736613:0:6475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: 000000006f10e4a7/0xabf1cc0bc784155a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841561 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790773013.736624:0:6475:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1790773013.736626:0:6475:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93d262660000 from 1 10000000:01000000:1.0:1790773013.736629:0:6475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1790773013.736654:0:6475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: 0000000060df18b3/0xabf1cc0bc78415a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.736661:0:6475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: 0000000060df18b3/0xabf1cc0bc78415a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.736669:0:6475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: 0000000060df18b3/0xabf1cc0bc78415a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773013.736679:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003bb5ede5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495932800:0@lo:101: 00000100:00100000:1.0:1790773013.736705:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773013.736723:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e65eef18 going to sleep for 11 seconds 00000100:00100000:1.0:1790773013.736740:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495932800 00000100:00100000:1.0:1790773013.736744:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495932800 00000100:00100000:1.0:1790773013.736776:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790773013.736783:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000dcacd17f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+14:6475:x1877761495932800:12345-0@lo:101: 00010000:00010000:1.0:1790773013.736795:0:6473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773013.736809:0:6473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009ad13755/0xabf1cc0bc78415ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc78415a7 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.736847:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009ad13755/0xabf1cc0bc78415ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc78415a7 expref: 15 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.736860:0:6473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009ad13755/0xabf1cc0bc78415ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78415a7 expref: 15 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.736870:0:6473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009ad13755, rc 0) 00000100:00100000:1.0:1790773013.736915:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000dcacd17f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:6475:x1877761495932800:12345-0@lo:101: Request processed in 134us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773013.736921:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000040:00080000:0.0:1790773013.737069:0:7408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000100:00100000:3.0:1790773013.737275:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003bb5ede5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495932800:0@lo:101: 00010000:00010000:3.0:1790773013.737290:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: 0000000060df18b3/0xabf1cc0bc78415a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78415ae expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773013.737310:0:6475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: 0000000060df18b3/0xabf1cc0bc78415a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc78415ae expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773013.737377:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006a6cee92 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495932928:0@lo:501: 00000100:00080000:2.0:1790773013.737381:0:3603:0:(import.c:65:import_set_state_nolock()) 00000000cd64ad0c lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790773013.737389:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790773013.737394:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ee4d1af8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761495932032:0@lo:38: 00000100:00100000:3.0:1790773013.737422:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773013.737447:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b0457bc4 going to sleep for 11 seconds 00000100:00100000:1.0:1790773013.737483:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495932928 00000100:00100000:1.0:1790773013.737488:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495932928 00000100:00100000:1.0:1790773013.737518:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790773013.737524:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000008a082a1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:6475:x1877761495932928:12345-0@lo:501: 00000100:00100000:1.0:1790773013.737609:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000008a082a1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:6475:x1877761495932928:12345-0@lo:501: Request processed in 85us (187us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790773013.737617:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000040:00080000:0.0:1790773013.737674:0:7408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:0.0:1790773013.737701:0:7408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:0.0:1790773013.737719:0:7408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:0.0:1790773013.737733:0:7408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:0.0:1790773013.737746:0:7408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:0.0:1790773013.737758:0:7408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:0.0:1790773013.737771:0:7408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:0.0:1790773013.737784:0:7408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:0.0:1790773013.737798:0:7408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:0.0:1790773013.737813:0:7408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:0.0:1790773013.737825:0:7408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:0.0:1790773013.737837:0:7408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:0.0:1790773013.737851:0:7408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:0.0:1790773013.737864:0:7408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:0.0:1790773013.737880:0:7408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:0.0:1790773013.737905:0:7408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:0.0:1790773013.737932:0:7408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:0.0:1790773013.737947:0:7408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:0.0:1790773013.737960:0:7408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:0.0:1790773013.737972:0:7408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:0.0:1790773013.737984:0:7408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000100:00100000:3.0:1790773013.738093:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006a6cee92 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495932928:0@lo:501: 10000000:01000000:3.0:1790773013.738121:0:6475:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1790773013.738127:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: 0000000060df18b3/0xabf1cc0bc78415a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78415ae expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773013.738135:0:6475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: 0000000060df18b3/0xabf1cc0bc78415a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78415ae expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790773013.740540:0:7408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:1.0:1790773013.740633:0:7408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e31ac968 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:7408:1877761495933056:0@lo:502: 00000100:00100000:1.0:1790773013.740741:0:7408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773013.740800:0:7408:0:(client.c:2716:ptlrpc_set_wait()) set 00000000562d54eb going to sleep for 11 seconds 00000100:00100000:2.0:1790773013.740834:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495933056 00000100:00100000:2.0:1790773013.740851:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495933056 00000100:00100000:2.0:1790773013.740948:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790773013.740959:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000007c0a7284 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:7408:x1877761495933056:12345-0@lo:502: 00000100:00100000:2.0:1790773013.742867:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000007c0a7284 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:7408:x1877761495933056:12345-0@lo:502: Request processed in 1901us (2119us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773013.742886:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790773013.743712:0:7408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e31ac968 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:7408:1877761495933056:0@lo:502: 00000040:00080000:1.0:1790773013.743876:0:7408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:1.0:1790773013.743972:0:7408:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:3.0:1790773013.764874:0:7425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790773013.765182:0:7425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773013.765185:0:7425:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1790773013.765194:0:7425:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1790773013.765197:0:7425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790773013.765258:0:7425:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000e4034edc) 00000020:00000080:3.0:1790773013.765287:0:7425:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lod with refcount 2 00000020:00000080:3.0:1790773013.765294:0:7425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1790773013.765381:0:7425:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:3.0:1790773013.765388:0:7425:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xabf1cc0bc78415bc 00000020:00000080:3.0:1790773013.766316:0:7425:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1790773013.766325:0:7425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790773013.766330:0:7425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773013.766331:0:7425:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1790773013.766343:0:7425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790773013.766347:0:7425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773013.766348:0:7425:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1790773013.766351:0:7425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790773013.766360:0:7425:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (0000000050569a49) 00000020:00000080:3.0:1790773013.766374:0:7425:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdt with refcount 2 00000020:00000080:3.0:1790773013.766377:0:7425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1790773013.766379:0:7425:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1790773013.766382:0:7425:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1790773013.766387:0:7425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1790773013.766459:0:7425:0:(tgt_mount.c:153:server_get_mount()) get mount 000000007aca9f9c from lustre-MDT0001, refs=2 00000020:00000080:3.0:1790773013.766488:0:7425:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (000000001694a327) 00000020:00000080:3.0:1790773013.766497:0:7425:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdd with refcount 2 00000004:01000000:3.0:1790773013.766566:0:7425:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1790773013.766571:0:7425:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xabf1cc0bc78415d1 00000020:00000080:3.0:1790773013.766693:0:7425:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1790773013.766709:0:7425:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1790773013.766713:0:7425:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xabf1cc0bc78415d8 00080000:01000000:3.0:1790773013.766720:0:7425:0:(osd_handler.c:8931:osd_obd_connect()) connect #2 00000020:00000080:3.0:1790773013.766723:0:7425:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xabf1cc0bc78415df 00080000:10000000:3.0:1790773013.768075:0:7425:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1790773013.768531:0:7425:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:3.0:1790773013.841513:0:7425:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:3.0:1790773013.841821:0:7425:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:3.0:1790773013.843724:0:7425:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1790773013.844066:0:7425:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1790773013.861126:0:7425:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1790773013.861145:0:7425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790773013.861168:0:7425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773013.861170:0:7425:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1790773013.861174:0:7425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790773013.861182:0:7425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773013.861184:0:7425:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1790773013.861187:0:7425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1790773013.861194:0:7425:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.119@tcp to nid 0x20000c0a8ca77 (192.168.202.119@tcp) 00000020:00000080:0.0:1790773013.861278:0:7425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790773013.861298:0:7425:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (000000004d0fc158) 00000020:00000080:0.0:1790773013.861329:0:7425:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osp with refcount 2 00000020:00000080:0.0:1790773013.861335:0:7425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1790773013.861444:0:7425:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1790773013.861452:0:7425:0:(osd_handler.c:8931:osd_obd_connect()) connect #3 00000020:00000080:0.0:1790773013.861461:0:7425:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xabf1cc0bc78415ed 00010000:00080000:0.0:1790773013.861632:0:7425:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000d8782417@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.119@tcp at head 00010000:00010000:0.0:1790773013.875743:0:7425:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-3 is initialized 00000020:00000080:3.0:1790773013.876901:0:7425:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1790773013.876919:0:7425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1790773013.877150:0:7425:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1790773013.877174:0:7425:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xabf1cc0bc78415f4 00000100:00080000:3.0:1790773013.877187:0:7425:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790773013.877199:0:7425:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000d8782417 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:3.0:1790773013.877341:0:7425:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000006a6cee92 x1877761495933184/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790773013.877397:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006a6cee92 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761495933184:0@lo:38: 00000100:00100000:2.0:1790773013.877482:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790773013.877555:0:7425:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1790773013.877621:0:6484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495933184 00000100:00100000:1.0:1790773013.877630:0:6484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495933184 00000020:01000000:3.0:1790773013.877654:0:7425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790773013.877660:0:7425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773013.877662:0:7425:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1790773013.877666:0:7425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000100:00100000:1.0:1790773013.877668:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000020:01000000:3.0:1790773013.877671:0:7425:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1790773013.877674:0:7425:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000100:00100000:1.0:1790773013.877677:0:6484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000945186bb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3603:x1877761495933184:12345-0@lo:38: 00000020:01000000:3.0:1790773013.877678:0:7425:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790773013.877681:0:7425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1790773013.877686:0:7425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773013.877687:0:7425:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1790773013.877690:0:7425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790773013.877694:0:7425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773013.877696:0:7425:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1790773013.877700:0:7425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00010000:00080000:1.0:1790773013.877703:0:6484:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 156 last 0 00000004:01000000:3.0:1790773013.877744:0:7425:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:00000080:1.0:1790773013.877749:0:6484:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xabf1cc0bc78415fb 00000020:01000000:3.0:1790773013.877759:0:7425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790773013.877763:0:7425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000004:00100000:1.0:1790773013.877764:0:6484:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:00000080:3.0:1790773013.877767:0:7425:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1790773013.877770:0:7425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000001:00000004:1.0:1790773013.877770:0:6484:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000020:00000080:3.0:1790773013.877774:0:7425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773013.877777:0:7425:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790773013.877780:0:7425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790773013.877782:0:7425:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1790773013.877815:0:7425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790773013.877818:0:7425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773013.877820:0:7425:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:3.0:1790773013.877823:0:7425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:1.0:1790773013.877894:0:7408:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:1.0:1790773013.877928:0:7408:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1790773013.877940:0:7408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: 000000007cd642b5/0xabf1cc0bc7841584 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc784158b expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.877948:0:7408:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: 000000007cd642b5/0xabf1cc0bc7841584 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc784158b expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790773013.877955:0:7408:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93d26ed89000 from 1 10000000:01000000:1.0:1790773013.877957:0:7408:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790773013.877980:0:7408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: 000000008bec46ce/0xabf1cc0bc7841602 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.877985:0:7408:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: 000000008bec46ce/0xabf1cc0bc7841602 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.877992:0:7408:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: 000000008bec46ce/0xabf1cc0bc7841602 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773013.878002:0:7408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e31ac968 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:7408:1877761495933312:0@lo:101: 00000100:00100000:1.0:1790773013.878033:0:7408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773013.878053:0:7408:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a2de87cc going to sleep for 11 seconds 00000100:00100000:2.0:1790773013.878076:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495933312 00000100:00100000:2.0:1790773013.878081:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495933312 00000100:00100000:2.0:1790773013.878129:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790773013.878141:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000034cd3e57 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:7408:x1877761495933312:12345-0@lo:101: 00010000:00010000:2.0:1790773013.878153:0:6473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773013.878166:0:6473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000069b63a9c/0xabf1cc0bc7841609 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7841602 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773013.878191:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000069b63a9c/0xabf1cc0bc7841609 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7841602 expref: 16 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773013.878229:0:6473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000069b63a9c/0xabf1cc0bc7841609 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7841602 expref: 16 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773013.878239:0:6473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000069b63a9c, rc 0) 00000100:00100000:2.0:1790773013.878288:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000034cd3e57 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:7408:x1877761495933312:12345-0@lo:101: Request processed in 148us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773013.878295:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790773013.878485:0:7408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e31ac968 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:7408:1877761495933312:0@lo:101: 00010000:00010000:1.0:1790773013.878505:0:7408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: 000000008bec46ce/0xabf1cc0bc7841602 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841609 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.878514:0:7408:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: 000000008bec46ce/0xabf1cc0bc7841602 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7841609 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773013.879013:0:7408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e31ac968 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:7408:1877761495933440:0@lo:256: 00000100:00100000:1.0:1790773013.879051:0:7408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773013.879152:0:7408:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a2de87cc going to sleep for 11 seconds 00000100:00100000:2.0:1790773013.879457:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495933440 00000100:00100000:2.0:1790773013.879463:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495933440 00000100:00100000:2.0:1790773013.879505:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790773013.879512:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000007dd256ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:7408:x1877761495933440:12345-0@lo:256: 20000000:01000000:2.0:1790773013.879528:0:6471:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1790773013.880690:0:6471:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1790773013.880699:0:6471:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1790773013.880826:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000007dd256ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:7408:x1877761495933440:12345-0@lo:256: Request processed in 1312us (1772us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773013.880838:0:7408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e31ac968 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:7408:1877761495933440:0@lo:256: 00000100:00100000:2.0:1790773013.880839:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 10000000:01000000:1.0:1790773013.881602:0:7408:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790773013.881619:0:7408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: 000000008bec46ce/0xabf1cc0bc7841602 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841609 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.881628:0:7408:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: 000000008bec46ce/0xabf1cc0bc7841602 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841609 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790773013.881634:0:7408:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d26ed89000 from 1 10000000:01000000:1.0:1790773013.881636:0:7408:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790773013.881668:0:7408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: 000000006ff3bd0f/0xabf1cc0bc7841610 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.881673:0:7408:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: 000000006ff3bd0f/0xabf1cc0bc7841610 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.881680:0:7408:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: 000000006ff3bd0f/0xabf1cc0bc7841610 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773013.881692:0:7408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e31ac968 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:7408:1877761495933568:0@lo:101: 00000100:00100000:1.0:1790773013.881733:0:7408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773013.881762:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495933568 00000100:00100000:1.0:1790773013.881767:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495933568 00000100:00100000:1.0:1790773013.881802:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790773013.881808:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000001c287383 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:7408:x1877761495933568:12345-0@lo:101: 00010000:00010000:1.0:1790773013.881821:0:6472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773013.881831:0:6472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000b8f81d9/0xabf1cc0bc7841617 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7841610 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773013.881843:0:7408:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a2de87cc going to sleep for 11 seconds 00010000:00010000:1.0:1790773013.881856:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000b8f81d9/0xabf1cc0bc7841617 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7841610 expref: 17 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.881866:0:6472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000b8f81d9/0xabf1cc0bc7841617 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7841610 expref: 17 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.881874:0:6472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000b8f81d9, rc 0) 00000100:00100000:1.0:1790773013.881903:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000001c287383 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:7408:x1877761495933568:12345-0@lo:101: Request processed in 95us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773013.881909:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790773013.881952:0:7408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e31ac968 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:7408:1877761495933568:0@lo:101: 00010000:00010000:0.0:1790773013.881966:0:7408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: 000000006ff3bd0f/0xabf1cc0bc7841610 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841617 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773013.881975:0:7408:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: 000000006ff3bd0f/0xabf1cc0bc7841610 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7841617 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773013.882075:0:7408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c2bb6c0d pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:7408:1877761495933696:0@lo:501: 00000100:00100000:0.0:1790773013.882118:0:7408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773013.882145:0:7408:0:(client.c:2716:ptlrpc_set_wait()) set 0000000043b1deb4 going to sleep for 11 seconds 00000100:00100000:1.0:1790773013.882314:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495933696 00000100:00100000:1.0:1790773013.882318:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495933696 00000100:00100000:1.0:1790773013.882385:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790773013.882392:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000df6df2df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:7408:x1877761495933696:12345-0@lo:501: 00000100:00100000:1.0:1790773013.882486:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000df6df2df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:7408:x1877761495933696:12345-0@lo:501: Request processed in 95us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773013.882494:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790773013.882586:0:7408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c2bb6c0d pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:7408:1877761495933696:0@lo:501: 00000100:00100000:0.0:1790773013.882613:0:7408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c2bb6c0d pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:7408:1877761495933824:0@lo:503: 00000100:00100000:0.0:1790773013.882654:0:7408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773013.882793:0:7408:0:(client.c:2716:ptlrpc_set_wait()) set 0000000043b1deb4 going to sleep for 11 seconds 00000100:00100000:3.0:1790773013.882851:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495933824 00000100:00100000:3.0:1790773013.882857:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495933824 00000100:00100000:3.0:1790773013.882884:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790773013.882899:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000e4389a20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:7408:x1877761495933824:12345-0@lo:503: 00000040:00080000:3.0:1790773013.882940:0:6472:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790773013.883004:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000e4389a20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:7408:x1877761495933824:12345-0@lo:503: Request processed in 106us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773013.883011:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790773013.883115:0:7408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c2bb6c0d pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:7408:1877761495933824:0@lo:503: 00000040:00080000:0.0:1790773013.883497:0:7408:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790773013.883547:0:7408:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:0.0:1790773013.883615:0:7408:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:1.0:1790773013.884823:0:6484:0:(import.c:65:import_set_state_nolock()) 0000000054fb5949 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790773013.884902:0:6484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000945186bb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3603:x1877761495933184:12345-0@lo:38: Request processed in 7226us (7419us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773013.884915:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790773013.884958:0:3603:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790773013.884968:0:3603:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1790773013.884976:0:3603:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1790773013.884982:0:3603:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790773013.884991:0:3603:0:(import.c:65:import_set_state_nolock()) 00000000d8782417 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790773013.885008:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006a6cee92 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761495933184:0@lo:38: 00000100:00100000:1.0:1790773013.885053:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790773013.885078:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bb6a629a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761495933952:0@lo:41: 00000100:00100000:1.0:1790773013.885167:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773013.885369:0:6483:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495933952 00000100:00100000:2.0:1790773013.885377:0:6483:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495933952 00000100:00100000:2.0:1790773013.885434:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790773013.885442:0:6483:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000005a9113bb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3605:x1877761495933952:12345-0@lo:41: 00000004:00000024:2.0:1790773013.885465:0:6483:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1790773013.885517:0:6483:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000005a9113bb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3605:x1877761495933952:12345-0@lo:41: Request processed in 76us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773013.885525:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790773013.885597:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bb6a629a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761495933952:0@lo:41: 00000040:00080000:3.0:1790773013.886454:0:7430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:0.0:1790773013.886662:0:7408:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1790773013.886695:0:7408:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790773013.886746:0:7408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: 000000006ff3bd0f/0xabf1cc0bc7841610 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841617 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773013.886760:0:7408:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: 000000006ff3bd0f/0xabf1cc0bc7841610 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841617 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790773013.886812:0:7408:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1790773013.886815:0:7408:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93d26ed89000 10000000:01000000:0.0:1790773013.886819:0:7408:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93d26ed89000 10000000:01000000:0.0:1790773013.886823:0:7408:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790773013.886829:0:7408:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93d26ed89000 from 1 10000000:01000000:0.0:1790773013.886831:0:7408:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790773013.886859:0:7408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: 0000000079624829/0xabf1cc0bc784161e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773013.886867:0:7408:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: 0000000079624829/0xabf1cc0bc784161e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773013.886878:0:7408:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: 0000000079624829/0xabf1cc0bc784161e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773013.886910:0:7408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c2bb6c0d pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:7408:1877761495934080:0@lo:101: 00000100:00100000:0.0:1790773013.886957:0:7408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773013.886989:0:7408:0:(client.c:2716:ptlrpc_set_wait()) set 0000000043b1deb4 going to sleep for 11 seconds 00000100:00100000:1.0:1790773013.887008:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495934080 00000100:00100000:1.0:1790773013.887014:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495934080 00000100:00100000:1.0:1790773013.887047:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790773013.887053:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000070824e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:7408:x1877761495934080:12345-0@lo:101: 00010000:00010000:1.0:1790773013.887079:0:6472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773013.887091:0:6472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d352d4fd/0xabf1cc0bc7841625 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc784161e expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.887115:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d352d4fd/0xabf1cc0bc7841625 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc784161e expref: 18 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.887125:0:6472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d352d4fd/0xabf1cc0bc7841625 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc784161e expref: 18 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.887134:0:6472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d352d4fd, rc 0) 00000100:00100000:1.0:1790773013.887175:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000070824e66 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:7408:x1877761495934080:12345-0@lo:101: Request processed in 122us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773013.887182:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790773013.887235:0:7408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c2bb6c0d pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:7408:1877761495934080:0@lo:101: 00010000:00010000:0.0:1790773013.887249:0:7408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: 0000000079624829/0xabf1cc0bc784161e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841625 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773013.887258:0:7408:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: 0000000079624829/0xabf1cc0bc784161e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7841625 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773013.887340:0:7408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c2bb6c0d pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:7408:1877761495934208:0@lo:501: 00000100:00100000:0.0:1790773013.887365:0:7408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773013.887442:0:7408:0:(client.c:2716:ptlrpc_set_wait()) set 0000000043b1deb4 going to sleep for 11 seconds 00000100:00100000:2.0:1790773013.887547:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495934208 00000100:00100000:2.0:1790773013.887552:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495934208 00000100:00100000:3.0:1790773013.887676:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790773013.887684:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000a689c2bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:7408:x1877761495934208:12345-0@lo:501: 00000100:00100000:3.0:1790773013.887781:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000a689c2bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:7408:x1877761495934208:12345-0@lo:501: Request processed in 98us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773013.887788:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790773013.887847:0:7408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c2bb6c0d pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:7408:1877761495934208:0@lo:501: 00000100:00100000:0.0:1790773013.887872:0:7408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c2bb6c0d pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:7408:1877761495934336:0@lo:503: 00000100:00100000:0.0:1790773013.887909:0:7408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773013.887964:0:7408:0:(client.c:2716:ptlrpc_set_wait()) set 0000000043b1deb4 going to sleep for 11 seconds 00000100:00100000:2.0:1790773013.888002:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495934336 00000100:00100000:2.0:1790773013.888011:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495934336 00000100:00100000:2.0:1790773013.888038:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790773013.888043:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000002afeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:7408:x1877761495934336:12345-0@lo:503: 00000100:00100000:2.0:1790773013.888237:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000002afeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:7408:x1877761495934336:12345-0@lo:503: Request processed in 193us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773013.888244:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790773013.888464:0:7408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c2bb6c0d pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:7408:1877761495934336:0@lo:503: 00000040:00080000:0.0:1790773013.888733:0:7408:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790773013.888789:0:7408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c2bb6c0d pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:7408:1877761495934464:0@lo:502: 00000100:00100000:0.0:1790773013.888827:0:7408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773013.888894:0:7408:0:(client.c:2716:ptlrpc_set_wait()) set 00000000631480e7 going to sleep for 11 seconds 00000100:00100000:2.0:1790773013.888931:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495934464 00000100:00100000:2.0:1790773013.888935:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495934464 00000100:00100000:2.0:1790773013.888995:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790773013.889002:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000798ed58f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:7408:x1877761495934464:12345-0@lo:502: 00000100:00100000:2.0:1790773013.889078:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000798ed58f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:7408:x1877761495934464:12345-0@lo:502: Request processed in 77us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773013.889093:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790773013.889152:0:7408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c2bb6c0d pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:7408:1877761495934464:0@lo:502: 00000040:00080000:0.0:1790773013.889498:0:7408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1790773013.889527:0:7408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1790773013.889540:0:7408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1790773013.889550:0:7408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1790773013.889563:0:7408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1790773013.889580:0:7408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1790773013.889594:0:7408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1790773013.889608:0:7408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1790773013.889619:0:7408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1790773013.889630:0:7408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1790773013.889641:0:7408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1790773013.889652:0:7408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1790773013.889663:0:7408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1790773013.889674:0:7408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1790773013.889684:0:7408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1790773013.889695:0:7408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1790773013.889705:0:7408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1790773013.889716:0:7408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1790773013.889727:0:7408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1790773013.889751:0:7408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1790773013.889763:0:7408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1790773013.889774:0:7408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1790773013.889784:0:7408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1790773013.889796:0:7408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1790773013.889807:0:7408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1790773013.889821:0:7408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1790773013.889837:0:7408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1790773013.889851:0:7408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:0.0:1790773013.889874:0:7408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c2bb6c0d pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:7408:1877761495934592:0@lo:502: 00000100:00100000:0.0:1790773013.889917:0:7408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773013.890055:0:7408:0:(client.c:2716:ptlrpc_set_wait()) set 00000000631480e7 going to sleep for 11 seconds 00000100:00100000:3.0:1790773013.890103:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495934592 00000100:00100000:3.0:1790773013.890142:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495934592 00000100:00100000:2.0:1790773013.890282:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790773013.890295:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000056e98694 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:7408:x1877761495934592:12345-0@lo:502: 00000100:00100000:2.0:1790773013.890389:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000056e98694 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:7408:x1877761495934592:12345-0@lo:502: Request processed in 96us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773013.890397:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790773013.890511:0:7408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c2bb6c0d pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:7408:1877761495934592:0@lo:502: 00000040:00080000:0.0:1790773013.890554:0:7408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1790773013.890569:0:7408:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1790773013.890980:0:7431:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1790773013.890995:0:7431:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000c1aa5a77) 00000020:00000080:0.0:1790773013.891016:0:7431:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type lwp with refcount 2 00000020:01000004:0.0:1790773013.891110:0:7431:0:(tgt_mount.c:153:server_get_mount()) get mount 000000007aca9f9c from lustre-MDT0001, refs=3 00000020:01000004:0.0:1790773013.891114:0:7431:0:(tgt_mount.c:187:server_put_mount()) put mount 000000007aca9f9c from lustre-MDT0001, refs=3 00000020:01000004:0.0:1790773013.891117:0:7431:0:(obd_mount.c:710:lustre_put_lsi()) put 000000007aca9f9c 3 00010000:00080000:0.0:1790773013.891147:0:7431:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000504b5925@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.119@tcp at head 00010000:00010000:0.0:1790773013.893038:0:7431:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-4 is initialized 00000020:00000080:0.0:1790773013.893293:0:7431:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1790773013.893345:0:7431:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790773013.893357:0:7431:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xabf1cc0bc7841633 00000100:00080000:0.0:1790773013.893367:0:7431:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790773013.893378:0:7431:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000504b5925 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:0.0:1790773013.893438:0:7431:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c2bb6c0d x1877761495934720/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790773013.893471:0:7431:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000040:00080000:0.0:1790773013.893678:0:7431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:0.0:1790773013.893799:0:7432:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000100:00100000:2.0:1790773013.894501:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c2bb6c0d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3603:1877761495934720:0@lo:38: 00000100:00100000:2.0:1790773013.894583:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1790773013.895230:0:7408:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1790773013.895270:0:7408:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790773013.895284:0:7408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: 0000000079624829/0xabf1cc0bc784161e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841625 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773013.895297:0:7408:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: 0000000079624829/0xabf1cc0bc784161e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841625 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790773013.895352:0:7408:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790773013.895354:0:7408:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1790773013.895356:0:7408:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790773013.895357:0:7408:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790773013.895359:0:7408:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790773013.895360:0:7408:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790773013.895362:0:7408:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790773013.895364:0:7408:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790773013.895366:0:7408:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790773013.895368:0:7408:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790773013.895370:0:7408:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790773013.895375:0:7408:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:2.0:1790773013.895378:0:7408:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790773013.895380:0:7408:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1790773013.895381:0:7408:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790773013.895383:0:7408:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790773013.895384:0:7408:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790773013.895385:0:7408:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790773013.895386:0:7408:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790773013.895387:0:7408:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790773013.895394:0:7408:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790773013.895395:0:7408:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790773013.895396:0:7408:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790773013.895435:0:7408:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1790773013.895451:0:7408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000886d8228 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:7408:1877761495934848:0@lo:253: 00000100:00100000:2.0:1790773013.895493:0:7408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773013.895525:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495934848 00000100:00100000:2.0:1790773013.895533:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495934848 00000100:00100000:2.0:1790773013.895581:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790773013.895590:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000575ba4d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:7408:x1877761495934848:12345-0@lo:253: 00000100:00100000:0.0:1790773013.895712:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495934720 00000100:00100000:0.0:1790773013.895717:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495934720 00000100:00100000:0.0:1790773013.895740:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790773013.895744:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000f7fc1b25 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3603:x1877761495934720:12345-0@lo:38: 00010000:00080000:0.0:1790773013.895764:0:6479:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 156 last 0 00000020:00000080:0.0:1790773013.895798:0:6479:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xabf1cc0bc784163a 00000004:00100000:0.0:1790773013.895815:0:6479:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790773013.895846:0:6479:0:(import.c:65:import_set_state_nolock()) 0000000022dcb600 : changing import state from RECOVER to FULL 20000000:01000000:2.0:1790773013.895959:0:6472:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1790773013.895977:0:6472:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1790773013.896301:0:7408:0:(client.c:2716:ptlrpc_set_wait()) set 000000007c681cc3 going to sleep for 11 seconds 00000100:00100000:0.0:1790773013.896376:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000f7fc1b25 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3603:x1877761495934720:12345-0@lo:38: Request processed in 630us (1792us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773013.896390:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1790773013.897054:0:3603:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c2bb6c0d x1877761495934720/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790773023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773013.897067:0:3603:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790773013.897077:0:3603:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1790773013.897085:0:3603:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1790773013.897090:0:3603:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790773013.897094:0:3603:0:(import.c:65:import_set_state_nolock()) 00000000504b5925 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790773013.897100:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c2bb6c0d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3603:1877761495934720:0@lo:38: 00000001:00100000:2.0:1790773013.900185:0:6457:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1790773013.900446:0:6472:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790773013.900466:0:6472:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1790773013.900581:0:6494:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790773013.900588:0:6494:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790773013.900612:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000002fcc5254/0xabf1cc0bc7841641 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773013.900632:0:6494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000125e892/0xabf1cc0bc7841522 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc784151b expref: 18 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773013.900641:0:6494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000069b63a9c/0xabf1cc0bc7841609 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7841602 expref: 18 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773013.900648:0:6494:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000002fcc5254/0xabf1cc0bc7841641 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773013.900685:0:6494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000069b63a9c/0xabf1cc0bc7841609 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc7841602 expref: 18 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773013.900713:0:6494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000069b63a9c/0xabf1cc0bc7841609 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc7841602 expref: 18 pid: 6473 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773013.900729:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bc468763 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6494:1877761495934976:0@lo:104: 00000100:00100000:3.0:1790773013.900794:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790773013.900848:0:6494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000125e892/0xabf1cc0bc7841522 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc784151b expref: 18 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773013.900856:0:6494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000125e892/0xabf1cc0bc7841522 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc784151b expref: 18 pid: 6473 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773013.900864:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000077d7921d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6494:1877761495935104:0@lo:104: 00000100:00100000:3.0:1790773013.900889:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773013.900916:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set 0000000026e4ed68 going to sleep for 11 seconds 00000100:00100000:2.0:1790773013.900950:0:6462:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1790773013.900969:0:6462:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495934976 00000100:00100000:2.0:1790773013.900977:0:6462:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495934976 00000100:00100000:2.0:1790773013.901004:0:6462:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495935104 00000100:00100000:2.0:1790773013.901007:0:6462:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495935104 00000100:00100000:2.0:1790773013.901017:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790773013.901023:0:6462:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000cc78c0db pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+4:6494:x1877761495934976:12345-0@lo:104: 00010000:00010000:2.0:1790773013.901039:0:6462:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: 000000008bec46ce/0xabf1cc0bc7841602 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7841609 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773013.901104:0:6462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790773013.901109:0:6462:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000cc78c0db pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+4:6494:x1877761495934976:12345-0@lo:104: Request processed in 86us (315us total) trans 0 rc 0/0 00010000:00010000:1.0:1790773013.901113:0:6467:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1790773013.901119:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1790773013.901121:0:6467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: 000000008bec46ce/0xabf1cc0bc7841602 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7841609 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.901131:0:6467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008bec46ce already unused, calling callback (000000000c3d7381) 00000100:00100000:2.0:1790773013.901137:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 10000000:00010000:1.0:1790773013.901143:0:6467:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: 000000008bec46ce/0xabf1cc0bc7841602 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc7841609 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773013.901147:0:6462:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000067a22190 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+3:6494:x1877761495935104:12345-0@lo:104: 00010000:00010000:2.0:1790773013.901159:0:6462:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: 0000000012431c86/0xabf1cc0bc784151b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7841522 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.901161:0:6467:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: 000000008bec46ce/0xabf1cc0bc7841602 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc7841609 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790773013.901178:0:6467:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: 000000008bec46ce/0xabf1cc0bc7841602 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc7841609 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790773013.901184:0:6467:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790773013.901201:0:6462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790773013.901223:0:6462:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000067a22190 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+3:6494:x1877761495935104:12345-0@lo:104: Request processed in 79us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773013.901229:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1790773013.901244:0:6467:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: 000000008bec46ce/0xabf1cc0bc7841602 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841609 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.901253:0:6467:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790773013.901273:0:6467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: 000000008bec46ce/0xabf1cc0bc7841602 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841609 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.901280:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: 000000008bec46ce/0xabf1cc0bc7841602 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841609 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773013.901281:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bc468763 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6494:1877761495934976:0@lo:104: 00000100:00100000:2.0:1790773013.901298:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000077d7921d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6494:1877761495935104:0@lo:104: 00010000:00010000:1.0:1790773013.901300:0:6467:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790773013.901305:0:6467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: 0000000012431c86/0xabf1cc0bc784151b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7841522 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.901312:0:6467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000012431c86 already unused, calling callback (000000000c3d7381) 10000000:00010000:1.0:1790773013.901314:0:6467:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: 0000000012431c86/0xabf1cc0bc784151b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc7841522 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773013.901319:0:6494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000002fcc5254/0xabf1cc0bc7841641 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.901321:0:6467:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: 0000000012431c86/0xabf1cc0bc784151b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc7841522 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773013.901346:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 10000000:00010000:1.0:1790773013.901348:0:6467:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: 0000000012431c86/0xabf1cc0bc784151b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc7841522 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790773013.901355:0:6467:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:2.0:1790773013.901357:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000480ed94f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce0675b4-b0c5-48e7-b182-565e22fed04c:3604:1877761495935232:0@lo:103: 00010000:00010000:1.0:1790773013.901371:0:6467:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: 0000000012431c86/0xabf1cc0bc784151b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841522 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.901378:0:6467:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1790773013.901388:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790773013.901395:0:6467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: 0000000012431c86/0xabf1cc0bc784151b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841522 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.901415:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: 0000000012431c86/0xabf1cc0bc784151b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841522 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773013.901430:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773013.901433:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773013.901434:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773013.901445:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b9146aee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce0675b4-b0c5-48e7-b182-565e22fed04c:3606:1877761495935360:0@lo:103: 00000100:00100000:1.0:1790773013.901476:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773013.901552:0:6465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495935232 00000100:00100000:2.0:1790773013.901557:0:6465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495935232 00010000:00010000:2.0:1790773013.901570:0:6465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000069b63a9c/0xabf1cc0bc7841609 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7841602 expref: 19 pid: 6473 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773013.901606:0:6465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495935360 00000100:00100000:2.0:1790773013.901610:0:6465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495935360 00010000:00010000:2.0:1790773013.901629:0:6465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000125e892/0xabf1cc0bc7841522 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc784151b expref: 20 pid: 6473 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773013.901646:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790773013.901652:0:6465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000937a6955 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+20:3604:x1877761495935232:12345-0@lo:103: 00010000:00010000:2.0:1790773013.901662:0:6465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790773013.901666:0:6465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000069b63a9c/0xabf1cc0bc7841609 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7841602 expref: 20 pid: 6473 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773013.901676:0:6465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000069b63a9c/0xabf1cc0bc7841609 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc7841602 expref: 20 pid: 6473 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773013.901689:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000069b63a9c/0xabf1cc0bc7841609 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc7841602 expref: 20 pid: 6473 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773013.901705:0:6465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790773013.901711:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000575ba4d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+19:7408:x1877761495934848:12345-0@lo:253: Request processed in 6120us (6216us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773013.901721:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790773013.901739:0:6465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000937a6955 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:3604:x1877761495935232:12345-0@lo:103: Request processed in 88us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773013.901747:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790773013.901761:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790773013.901765:0:6465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000005cef42e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:3606:x1877761495935360:12345-0@lo:103: 00010000:00010000:2.0:1790773013.901770:0:6465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790773013.901773:0:6465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000125e892/0xabf1cc0bc7841522 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc784151b expref: 17 pid: 6473 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773013.901781:0:6465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000125e892/0xabf1cc0bc7841522 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc784151b expref: 17 pid: 6473 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773013.901795:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000125e892/0xabf1cc0bc7841522 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc784151b expref: 17 pid: 6473 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773013.901806:0:6465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000002fcc5254/0xabf1cc0bc7841641 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773013.901814:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002fcc5254/0xabf1cc0bc7841641 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790773013.901827:0:6465:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005490034s 00010000:00010000:2.0:1790773013.901830:0:6465:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002fcc5254/0xabf1cc0bc7841641 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773013.901836:0:6465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002fcc5254/0xabf1cc0bc7841641 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773013.901843:0:6465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000002fcc5254/0xabf1cc0bc7841641 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773013.901849:0:6465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000002fcc5254/0xabf1cc0bc7841641 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773013.901854:0:6465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002fcc5254 already unused, calling callback (0000000035eb843c) 00010000:00010000:2.0:1790773013.901857:0:6465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000002fcc5254/0xabf1cc0bc7841641 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773013.901865:0:6465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000002fcc5254/0xabf1cc0bc7841641 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773013.901885:0:6465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000002fcc5254/0xabf1cc0bc7841641 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773013.901903:0:6465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790773013.901927:0:6465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000005cef42e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:3606:x1877761495935360:12345-0@lo:103: Request processed in 162us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773013.901932:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1790773013.902039:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773013.902111:0:6494:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000002fcc5254/0xabf1cc0bc7841641 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773013.902119:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000002fcc5254/0xabf1cc0bc7841641 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773013.902126:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002fcc5254/0xabf1cc0bc7841641 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773013.902132:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b9146aee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce0675b4-b0c5-48e7-b182-565e22fed04c:3606:1877761495935360:0@lo:103: 00000100:00100000:2.0:1790773013.902158:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000480ed94f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce0675b4-b0c5-48e7-b182-565e22fed04c:3604:1877761495935232:0@lo:103: 00000100:00100000:2.0:1790773013.902178:0:7408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000886d8228 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:7408:1877761495934848:0@lo:253: 10000000:01000000:2.0:1790773013.902186:0:7408:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1790773013.902189:0:7408:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790773013.902190:0:7408:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1790773013.902192:0:7408:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790773013.902193:0:7408:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790773013.902194:0:7408:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790773013.902195:0:7408:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790773013.902196:0:7408:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790773013.902198:0:7408:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790773013.902199:0:7408:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790773013.902201:0:7408:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790773013.902229:0:7408:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790773013.902239:0:7408:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1790773013.907650:0:7408:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:3.0:1790773013.907822:0:7408:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1790773013.908025:0:7408:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1790773013.908733:0:7408:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1790773013.908939:0:7408:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1790773013.909092:0:7408:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:3.0:1790773013.909758:0:7408:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1790773013.909977:0:7408:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1790773013.910146:0:7408:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:3.0:1790773013.910500:0:7408:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1790773013.910659:0:7408:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:3.0:1790773013.910825:0:7408:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:3.0:1790773013.912064:0:7408:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:3.0:1790773013.912627:0:7437:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:3.0:1790773013.912683:0:7437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009df70b0a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7437:1877761495935488:0@lo:700: 00000100:00100000:3.0:1790773013.912755:0:7437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773013.912807:0:7437:0:(client.c:2716:ptlrpc_set_wait()) set 000000004eff338f going to sleep for 11 seconds 00000040:01000000:0.0:1790773013.912852:0:7408:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:2.0:1790773013.913019:0:6485:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495935488 00000100:00100000:2.0:1790773013.913027:0:6485:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495935488 00000100:00100000:2.0:1790773013.913077:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790773013.913086:0:6485:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000007fe264bd pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7437:x1877761495935488:12345-0@lo:700: 00000100:00100000:0.0:1790773013.913490:0:7438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000af22a4b2 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7438:1877761495935616:0@lo:1000: 00000100:00100000:0.0:1790773013.913534:0:7438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773013.913554:0:7438:0:(client.c:2716:ptlrpc_set_wait()) set 0000000003870669 going to sleep for 11 seconds 00000040:01000000:3.0:1790773013.913963:0:7408:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1790773013.914092:0:7408:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1790773013.914604:0:7408:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1790773013.914611:0:7408:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1790773013.914734:0:7408:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790773013.915936:0:7408:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:2.0:1790773013.916408:0:6483:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495935616 00000100:00100000:2.0:1790773013.916419:0:6483:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495935616 00000100:00100000:2.0:1790773013.916480:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790773013.916489:0:6483:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000005b0ed42 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7438:x1877761495935616:12345-0@lo:1000: 00000100:00100000:2.0:1790773013.916649:0:6483:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000005b0ed42 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7438:x1877761495935616:12345-0@lo:1000: Request processed in 160us (3113us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773013.916670:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790773013.916687:0:7438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000af22a4b2 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7438:1877761495935616:0@lo:1000: 00000040:01000000:0.0:1790773013.916733:0:7438:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:0.0:1790773013.916776:0:7438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000af22a4b2 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7438:1877761495935744:0@lo:700: 00000100:00100000:0.0:1790773013.916816:0:7438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773013.916851:0:6487:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495935744 00000100:00100000:0.0:1790773013.916855:0:6487:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495935744 00000100:00100000:0.0:1790773013.916882:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790773013.916890:0:6487:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000012d57a8f pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7438:x1877761495935744:12345-0@lo:700: 00000100:00100000:0.0:1790773013.916943:0:6487:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000012d57a8f pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7438:x1877761495935744:12345-0@lo:700: Request processed in 54us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773013.916950:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790773013.916991:0:7438:0:(client.c:2716:ptlrpc_set_wait()) set 0000000003870669 going to sleep for 11 seconds 00000100:00100000:0.0:1790773013.917008:0:7438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000af22a4b2 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7438:1877761495935744:0@lo:700: 00000100:00100000:0.0:1790773013.918168:0:7438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000af22a4b2 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7438:1877761495935872:0@lo:900: 00000100:00100000:0.0:1790773013.918240:0:7438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773013.918270:0:7438:0:(client.c:2716:ptlrpc_set_wait()) set 0000000003870669 going to sleep for 11 seconds 00000020:00080000:1.0:1790773013.918636:0:7436:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1790773013.918643:0:7436:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:0.0:1790773013.919377:0:6489:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495935872 00000100:00100000:0.0:1790773013.919387:0:6489:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495935872 00000100:00100000:0.0:1790773013.919469:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790773013.919479:0:6489:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000008086c044 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7438:x1877761495935872:12345-0@lo:900: 00000100:00100000:0.0:1790773013.919572:0:6489:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000008086c044 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7438:x1877761495935872:12345-0@lo:900: Request processed in 94us (1333us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773013.919582:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1790773013.919629:0:7438:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000af22a4b2 x1877761495935872/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790773029 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773013.919643:0:7438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000af22a4b2 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7438:1877761495935872:0@lo:900: 00000100:00100000:0.0:1790773013.919744:0:7438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000af22a4b2 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7438:1877761495936000:0@lo:1000: 00000100:00100000:0.0:1790773013.919777:0:7438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773013.919799:0:7438:0:(client.c:2716:ptlrpc_set_wait()) set 00000000306c1534 going to sleep for 11 seconds 00000100:00100000:0.0:1790773013.920574:0:6483:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495936000 00000100:00100000:0.0:1790773013.920582:0:6483:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495936000 00000100:00100000:0.0:1790773013.920627:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790773013.920635:0:6483:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000c0136772 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7438:x1877761495936000:12345-0@lo:1000: 00000100:00100000:0.0:1790773013.920716:0:6483:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000c0136772 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7438:x1877761495936000:12345-0@lo:1000: Request processed in 83us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773013.920724:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:3.0:1790773013.920821:0:7408:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1790773013.920902:0:7408:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000100:00100000:0.0:1790773013.920936:0:7438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000af22a4b2 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7438:1877761495936000:0@lo:1000: 00000004:00080000:0.0:1790773013.920996:0:7438:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000003870669 with version 0 00000020:00100000:0.0:1790773013.921014:0:7438:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1790773013.921020:0:7438:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000af22a4b2 x1877761495936256/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790773013.921035:0:7438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000af22a4b2 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7438:1877761495936256:0@lo:1000: 00000100:00100000:0.0:1790773013.921068:0:7438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1790773013.921150:0:7408:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790773013.921313:0:6483:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495936256 00000100:00100000:0.0:1790773013.921318:0:6483:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495936256 00000100:00100000:0.0:1790773013.921348:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790773013.921355:0:6483:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000c2bb6c0d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7438:x1877761495936256:12345-0@lo:1000: 00080000:10000000:3.0:1790773013.921396:0:7408:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000100:00100000:0.0:1790773013.921765:0:7438:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a6d96f6f going to sleep for 11 seconds 00100000:10000000:3.0:1790773013.922115:0:7408:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1790773013.922303:0:7408:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 40000000:02000000:0.0:1790773013.922435:0:6485:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00100000:10000000:3.0:1790773013.922630:0:7408:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1790773013.922765:0:7408:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1790773013.922943:0:7408:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1790773013.923077:0:7408:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1790773013.923442:0:7408:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1790773013.923749:0:7408:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1790773013.923883:0:7408:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1790773013.924009:0:7408:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1790773013.924136:0:7408:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1790773013.924457:0:7408:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1790773013.924584:0:7408:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1790773013.924716:0:7408:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1790773013.924835:0:7408:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1790773013.924969:0:7408:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1790773013.925272:0:7408:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1790773013.925384:0:7408:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1790773013.925529:0:7408:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1790773013.925671:0:7408:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1790773013.925787:0:7408:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1790773013.925907:0:7408:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1790773013.926064:0:7408:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1790773013.926656:0:7408:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1790773013.926781:0:7408:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1790773013.926922:0:7408:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00000100:00100000:0.0:1790773013.927012:0:6485:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000007fe264bd pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7437:x1877761495935488:12345-0@lo:700: Request processed in 13924us (14254us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773013.927032:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00100000:10000000:2.0:1790773013.927067:0:7408:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1790773013.927199:0:7408:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00010000:00080000:3.0:1790773013.927631:0:7437:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000009df70b0a x1877761495935488/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1790773029 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773013.927651:0:7437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009df70b0a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7437:1877761495935488:0@lo:700: 40000000:02000000:3.0:1790773013.927666:0:7437:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00100000:10000000:2.0:1790773013.929504:0:7408:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1790773013.929655:0:7408:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1790773013.929835:0:7408:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1790773013.929979:0:7408:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1790773013.930155:0:7408:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:3.0:1790773013.935662:0:6457:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:3.0:1790773013.935827:0:6483:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000c2bb6c0d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7438:x1877761495936256:12345-0@lo:1000: Request processed in 14467us (14753us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1790773013.935850:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000004:00080000:0.0:1790773013.937134:0:7438:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1790773013.937142:0:7438:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1790773013.937163:0:7438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000af22a4b2 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7438:1877761495936256:0@lo:1000: 00000001:00080000:2.0:1790773013.937546:0:7408:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1790773013.937587:0:7408:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb21f01c13988 00100000:10000000:2.0:1790773013.937595:0:7408:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0001-osd: start master thread 00000100:00100000:0.0:1790773013.938240:0:7438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000af22a4b2 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7438:1877761495936384:0@lo:1000: 00000100:00100000:0.0:1790773013.938321:0:7438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773013.938380:0:7438:0:(client.c:2716:ptlrpc_set_wait()) set 000000003d49c6d6 going to sleep for 11 seconds 00000100:00100000:1.0:1790773013.938382:0:6484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495936384 00000100:00100000:1.0:1790773013.938392:0:6484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495936384 00000100:00100000:1.0:1790773013.938450:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790773013.938460:0:6484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000fc955ea7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7438:x1877761495936384:12345-0@lo:1000: 00000100:00100000:1.0:1790773013.938540:0:6484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000fc955ea7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7438:x1877761495936384:12345-0@lo:1000: Request processed in 83us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773013.938548:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000020:01000004:2.0:1790773013.938600:0:7408:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 00000100:00100000:0.0:1790773013.938608:0:7438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000af22a4b2 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7438:1877761495936384:0@lo:1000: 00000040:00080000:0.0:1790773013.938633:0:7438:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 10000000:01000000:2.0:1790773013.938634:0:7408:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.119@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790773013.938660:0:7408:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000004:00080000:0.0:1790773013.938662:0:7438:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000003870669 with version 1 00000080:00000004:2.0:1790773013.938677:0:7408:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000004:00080000:1.0:1790773013.939337:0:7428:0:(osp_trans.c:1336:osp_get_next_request()) ou 0000000003080f03 version 1 rpc_version 1 00000020:00100000:1.0:1790773013.939358:0:7428:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1790773013.939364:0:7428:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000009c7841f3 x1877761495936640/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790773013.939383:0:7428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009c7841f3 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7428:1877761495936640:0@lo:1000: 00000100:00100000:1.0:1790773013.939441:0:7428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773013.939465:0:7428:0:(client.c:2716:ptlrpc_set_wait()) set 0000000038225f0b going to sleep for 11 seconds 00000100:00100000:1.0:1790773013.939484:0:6484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495936640 00000100:00100000:1.0:1790773013.939489:0:6484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495936640 00000100:00100000:1.0:1790773013.939513:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790773013.939519:0:6484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000008cd59fda pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7428:x1877761495936640:12345-0@lo:1000: 00000040:00080000:0.0:1790773013.941931:0:7438:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1790773013.942029:0:7438:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000001:00080000:3.0:1790773013.946179:0:6457:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:1.0:1790773013.951429:0:6484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000008cd59fda pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7428:x1877761495936640:12345-0@lo:1000: Request processed in 11904us (11982us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1790773013.951447:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000004:00080000:0.0:1790773013.953419:0:7428:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1790773013.953427:0:7428:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1790773013.953450:0:7428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009c7841f3 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7428:1877761495936640:0@lo:1000: 00000020:00000004:1.0:1790773013.955387:0:7408:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790773013.955601:0:7408:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:0.0:1790773013.957845:0:7437:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790773013.964326:0:7437:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1790773013.964426:0:7437:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1790773013.964432:0:7437:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:0.0:1790773014.350366:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773014.797475:0:7424:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b4d05e43 going to sleep for 0 seconds 00010000:00010000:0.0:1790773015.375144:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773015.822060:0:7424:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b4d05e43 going to sleep for 0 seconds 00010000:00010000:0.0:1790773016.399490:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773016.845272:0:7424:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b4d05e43 going to sleep for 0 seconds 00010000:00010000:0.0:1790773017.449560:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773017.869385:0:7424:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b4d05e43 going to sleep for 0 seconds 00010000:00010000:2.0:1790773018.446370:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773018.893391:0:7424:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b4d05e43 going to sleep for 0 seconds 00000100:00080000:3.0:1790773018.957420:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1790773018.957431:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1790773018.957433:0:37:0:(import.c:65:import_set_state_nolock()) 00000000cd64ad0c lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790773018.957442:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 156 00000100:00080000:3.0:1790773018.957448:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1790773018.957458:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000cd64ad0c using connection 192.168.202.119@tcp/0@lo 00000100:00100000:3.0:1790773018.957477:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000400b638a x1877761495937024/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790773018.957520:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001468ce90 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3606:1877761495937280:0@lo:400: 00000100:00100000:3.0:1790773018.957582:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773018.957635:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790773018.957640:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009df70b0a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce0675b4-b0c5-48e7-b182-565e22fed04c:3606:1877761495936768:0@lo:400: 00000100:00100000:3.0:1790773018.957666:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773018.957702:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000033f9337e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3604:1877761495936896:0@lo:400: 00000100:00100000:3.0:1790773018.957726:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773018.957741:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790773018.957745:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d9a9a074 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761495937152:0@lo:400: 00000100:00100000:3.0:1790773018.957766:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773018.957785:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000400b638a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761495937024:0@lo:38: 00000100:00100000:3.0:1790773018.957811:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773018.957838:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495937280 00000100:00100000:3.0:1790773018.957845:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495937280 00000100:00100000:3.0:1790773018.957879:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495936896 00000100:00100000:3.0:1790773018.957881:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495936896 00000100:00100000:3.0:1790773018.957894:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790773018.957900:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000006247cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1877761495937280:12345-0@lo:400: 00000100:00100000:3.0:1790773018.957943:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000006247cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1877761495937280:12345-0@lo:400: Request processed in 43us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773018.957950:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790773018.957964:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790773018.957968:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000077d7921d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3604:x1877761495936896:12345-0@lo:400: 00000100:00100000:3.0:1790773018.957992:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000077d7921d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3604:x1877761495936896:12345-0@lo:400: Request processed in 25us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773018.957998:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790773018.958012:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495936768 00000100:00100000:3.0:1790773018.958015:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495936768 00000100:00100000:3.0:1790773018.958034:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790773018.958038:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000247527a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:3606:x1877761495936768:12345-0@lo:400: 00000100:00100000:3.0:1790773018.958077:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000247527a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:3606:x1877761495936768:12345-0@lo:400: Request processed in 38us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773018.958090:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790773018.958116:0:6483:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495937152 00000100:00100000:3.0:1790773018.958120:0:6483:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495937152 00000100:00100000:3.0:1790773018.958133:0:6483:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495937024 00000100:00100000:3.0:1790773018.958135:0:6483:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495937024 00000100:00100000:3.0:1790773018.958142:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790773018.958157:0:6483:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000bc468763 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761495937152:12345-0@lo:400: 00000100:00100000:3.0:1790773018.958186:0:6483:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000bc468763 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761495937152:12345-0@lo:400: Request processed in 30us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773018.958192:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790773018.958201:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790773018.958230:0:6483:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000cc78c0db pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3603:x1877761495937024:12345-0@lo:38: 00010000:00080000:3.0:1790773018.958251:0:6483:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 161 last 0 00000020:00000080:3.0:1790773018.958283:0:6483:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xabf1cc0bc7841648 00000004:00100000:3.0:1790773018.958295:0:6483:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1790773018.958300:0:6483:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1790773018.958396:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009df70b0a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce0675b4-b0c5-48e7-b182-565e22fed04c:3606:1877761495936768:0@lo:400: 00010000:00080000:3.0:1790773018.958406:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000001468ce90 x1877761495937280/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773034 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773018.958416:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001468ce90 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3606:1877761495937280:0@lo:400: 00000100:00100000:3.0:1790773018.958437:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d9a9a074 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761495937152:0@lo:400: 00010000:00080000:3.0:1790773018.958443:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000033f9337e x1877761495936896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773034 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773018.958451:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000033f9337e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3604:1877761495936896:0@lo:400: 00000100:00100000:1.0:1790773018.960940:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790773018.960959:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004d2a8f08 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761495937408:0@lo:41: 00000100:00100000:1.0:1790773018.961012:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773018.961057:0:6484:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1790773018.961065:0:6484:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1790773018.961171:0:6484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495937408 00000100:00100000:1.0:1790773018.961178:0:6484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495937408 00000100:00100000:1.0:1790773018.961316:0:7666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790773018.961324:0:7666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000009c7841f3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761495937408:12345-0@lo:41: 00000004:00000024:1.0:1790773018.961362:0:7666:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1790773018.961401:0:7666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000009c7841f3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761495937408:12345-0@lo:41: Request processed in 78us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773018.961416:0:7666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790773018.961453:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004d2a8f08 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761495937408:0@lo:41: 00000100:00080000:0.0:1790773018.970839:0:6483:0:(import.c:65:import_set_state_nolock()) 00000000853982e6 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790773018.970921:0:6483:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000cc78c0db pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3603:x1877761495937024:12345-0@lo:38: Request processed in 12689us (13108us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773018.970931:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790773018.971248:0:3603:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790773018.971259:0:3603:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1790773018.971266:0:3603:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1790773018.971271:0:3603:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1790773018.971273:0:3603:0:(import.c:65:import_set_state_nolock()) 00000000cd64ad0c lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1790773018.971285:0:3603:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000b4d05e43): req@000000000f96c86d x1877761495932544/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773018.971301:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000400b638a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761495937024:0@lo:38: 00000100:00100000:3.0:1790773018.971384:0:7424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773018.971418:0:7424:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b4d05e43 going to sleep for 11 seconds 00000100:00100000:3.0:1790773018.971432:0:6484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495932544 00000100:00100000:3.0:1790773018.971438:0:6484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495932544 00000100:00100000:3.0:1790773018.971478:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790773018.971487:0:6484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000400b638a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7424:x1877761495932544:12345-0@lo:1000: 00000100:00100000:0.0:1790773018.971504:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000af22a4b2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761495937536:0@lo:41: 00000100:00100000:0.0:1790773018.971538:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773018.971567:0:6484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000400b638a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7424:x1877761495932544:12345-0@lo:1000: Request processed in 81us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773018.971576:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790773018.971581:0:6483:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495937536 00000100:00100000:0.0:1790773018.971585:0:6483:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495937536 00000100:00100000:3.0:1790773018.971610:0:7424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000f96c86d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7424:1877761495932544:0@lo:1000: 00000100:00100000:0.0:1790773018.971613:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790773018.971622:0:6483:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000c165b51c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3604:x1877761495937536:12345-0@lo:41: 00000004:00000024:0.0:1790773018.971644:0:6483:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000040:01000000:3.0:1790773018.971646:0:7424:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1790773018.971676:0:6483:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000c165b51c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3604:x1877761495937536:12345-0@lo:41: Request processed in 55us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773018.971680:0:7424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000033f9337e pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7424:1877761495937664:0@lo:1000: 00000100:00100000:0.0:1790773018.971687:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790773018.971716:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000af22a4b2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761495937536:0@lo:41: 00000100:00100000:3.0:1790773018.971723:0:7424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773018.971748:0:7424:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bdb0ed01 going to sleep for 11 seconds 00000100:00100000:0.0:1790773018.981865:0:6484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495937664 00000100:00100000:0.0:1790773018.981880:0:6484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495937664 00000100:00100000:0.0:1790773018.981922:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790773018.981930:0:6484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000d9a9a074 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7424:x1877761495937664:12345-0@lo:1000: 00000100:00100000:0.0:1790773018.982093:0:6484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000d9a9a074 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7424:x1877761495937664:12345-0@lo:1000: Request processed in 164us (10375us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773018.982100:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790773018.982161:0:7424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000033f9337e pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7424:1877761495937664:0@lo:1000: 00000100:00100000:0.0:1790773018.982243:0:7424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000af22a4b2 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7424:1877761495937792:0@lo:700: 00000100:00100000:0.0:1790773018.982428:0:7424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773018.982449:0:7424:0:(client.c:2716:ptlrpc_set_wait()) set 000000007b1e06eb going to sleep for 11 seconds 00000100:00100000:0.0:1790773018.982463:0:6488:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495937792 00000100:00100000:0.0:1790773018.982466:0:6488:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495937792 00000100:00100000:0.0:1790773018.982491:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790773018.982496:0:6488:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000001bd7dd57 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7424:x1877761495937792:12345-0@lo:700: 00000100:00100000:0.0:1790773018.982532:0:6488:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000001bd7dd57 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7424:x1877761495937792:12345-0@lo:700: Request processed in 36us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773018.982538:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790773018.982563:0:7424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000af22a4b2 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7424:1877761495937792:0@lo:700: 00000100:00100000:0.0:1790773018.982651:0:7424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000af22a4b2 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7424:1877761495937920:0@lo:1000: 00000100:00100000:0.0:1790773018.982674:0:7424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773018.982686:0:7424:0:(client.c:2716:ptlrpc_set_wait()) set 0000000043b1deb4 going to sleep for 11 seconds 00000100:00100000:0.0:1790773018.982747:0:6484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495937920 00000100:00100000:0.0:1790773018.982750:0:6484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495937920 00000100:00100000:0.0:1790773018.982778:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790773018.982783:0:6484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000095dfa49c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7424:x1877761495937920:12345-0@lo:1000: 00000100:00100000:0.0:1790773018.982827:0:6484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000095dfa49c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7424:x1877761495937920:12345-0@lo:1000: Request processed in 44us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773018.982833:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790773018.982853:0:7424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000af22a4b2 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7424:1877761495937920:0@lo:1000: 00000004:00080000:0.0:1790773018.982884:0:7424:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000007b1e06eb with version 0 00000020:00100000:0.0:1790773018.982896:0:7424:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1790773018.982901:0:7424:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000af22a4b2 x1877761495938176/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790773018.982912:0:7424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000af22a4b2 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7424:1877761495938176:0@lo:1000: 00000100:00100000:0.0:1790773018.982937:0:7424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773018.982948:0:7424:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dc047896 going to sleep for 11 seconds 00000100:00100000:0.0:1790773018.982957:0:6484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495938176 00000100:00100000:0.0:1790773018.982960:0:6484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495938176 00000100:00100000:0.0:1790773018.982974:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790773018.982978:0:6484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000007fce24e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7424:x1877761495938176:12345-0@lo:1000: 00000001:00080000:3.0:1790773019.033192:0:7410:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:3.0:1790773019.033235:0:7410:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1790773019.033431:0:6484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000007fce24e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7424:x1877761495938176:12345-0@lo:1000: Request processed in 50449us (50490us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1790773019.033445:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:3.0:1790773019.033623:0:7424:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1790773019.033628:0:7424:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1790773019.033650:0:7424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000af22a4b2 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7424:1877761495938176:0@lo:1000: 00000100:00100000:3.0:1790773019.033727:0:7424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001468ce90 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7424:1877761495938304:0@lo:1000: 00000100:00100000:3.0:1790773019.033761:0:7424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773019.033795:0:7424:0:(client.c:2716:ptlrpc_set_wait()) set 0000000038dce252 going to sleep for 11 seconds 00000100:00100000:0.0:1790773019.033842:0:6483:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495938304 00000100:00100000:0.0:1790773019.033848:0:6483:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495938304 00000100:00100000:0.0:1790773019.033891:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790773019.033898:0:6483:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000009df70b0a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7424:x1877761495938304:12345-0@lo:1000: 00000100:00100000:0.0:1790773019.033952:0:6483:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000009df70b0a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7424:x1877761495938304:12345-0@lo:1000: Request processed in 55us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773019.033959:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790773019.034007:0:7424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001468ce90 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7424:1877761495938304:0@lo:1000: 00000040:00080000:3.0:1790773019.034022:0:7424:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1790773019.034057:0:7424:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000d8531a38 with version 1 00000040:00080000:3.0:1790773019.036705:0:7424:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1790773019.036773:0:7424:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 6, retries 0 00000004:00080000:3.0:1790773019.036777:0:7424:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00080000:0.0:1790773019.037146:0:7422:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000f1268710 version 1 rpc_version 1 00000020:00100000:0.0:1790773019.037183:0:7422:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1790773019.037198:0:7422:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000958bbb40 x1877761495938560/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790773019.037241:0:7422:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000958bbb40 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7422:1877761495938560:0@lo:1000: 00000100:00100000:0.0:1790773019.037303:0:7422:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773019.037334:0:7422:0:(client.c:2716:ptlrpc_set_wait()) set 000000004131b60d going to sleep for 11 seconds 00000100:00100000:0.0:1790773019.037364:0:6484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495938560 00000100:00100000:0.0:1790773019.037370:0:6484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495938560 00000100:00100000:0.0:1790773019.037412:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790773019.037419:0:6484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000053ae89d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7422:x1877761495938560:12345-0@lo:1000: 00000001:00080000:0.0:1790773019.046188:0:7410:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:1.0:1790773019.048590:0:6484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000053ae89d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7422:x1877761495938560:12345-0@lo:1000: Request processed in 11166us (11282us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1790773019.048604:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:0.0:1790773019.054388:0:7422:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1790773019.054400:0:7422:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1790773019.054423:0:7422:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000958bbb40 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7422:1877761495938560:0@lo:1000: 00000001:02000400:3.0:1790773019.170717:0:7684:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg219-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1790773019.471851:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1790773020.393799:0:7736:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790773020.396189:0:7736:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1790773020.496145:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773021.525872:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1790773022.542201:0:6475:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790773022.542224:0:6475:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93d26ed89000 from 4 10000000:01000000:1.0:1790773022.542229:0:6475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790773022.542282:0:6475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: 00000000d7ed604b/0xabf1cc0bc784164f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773022.542296:0:6475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: 00000000d7ed604b/0xabf1cc0bc784164f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773022.542310:0:6475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: 00000000d7ed604b/0xabf1cc0bc784164f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773022.542347:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004d2a8f08 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495938688:0@lo:101: 00000100:00100000:1.0:1790773022.542429:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773022.542604:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495938688 00000100:00100000:3.0:1790773022.542615:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495938688 00000100:00100000:3.0:1790773022.542681:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790773022.542690:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000d0e646f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:6475:x1877761495938688:12345-0@lo:101: 00010000:00010000:3.0:1790773022.542704:0:6472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773022.542717:0:6472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002fcc5254/0xabf1cc0bc7841656 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc784164f expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773022.542752:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002fcc5254/0xabf1cc0bc7841656 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc784164f expref: 17 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773022.542762:0:6472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002fcc5254/0xabf1cc0bc7841656 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc784164f expref: 17 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773022.542770:0:6472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002fcc5254, rc 0) 00000100:00100000:3.0:1790773022.542839:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000d0e646f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:6475:x1877761495938688:12345-0@lo:101: Request processed in 150us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773022.542846:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790773022.543071:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set 0000000043433be8 going to sleep for 11 seconds 00000100:00100000:1.0:1790773022.543093:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004d2a8f08 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495938688:0@lo:101: 00010000:00010000:1.0:1790773022.543107:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: 00000000d7ed604b/0xabf1cc0bc784164f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841656 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773022.543116:0:6475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: 00000000d7ed604b/0xabf1cc0bc784164f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7841656 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773022.543162:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004d2a8f08 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495938816:0@lo:256: 00000100:00100000:1.0:1790773022.543199:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773022.543242:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set 0000000043433be8 going to sleep for 11 seconds 00000100:00100000:3.0:1790773022.543294:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495938816 00000100:00100000:3.0:1790773022.543298:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495938816 00000100:00100000:3.0:1790773022.543338:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790773022.543345:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000db9d0351 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:6475:x1877761495938816:12345-0@lo:256: 20000000:01000000:3.0:1790773022.543360:0:6471:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790773022.543376:0:6471:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790773022.543379:0:6471:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1790773022.543663:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000db9d0351 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:6475:x1877761495938816:12345-0@lo:256: Request processed in 319us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773022.543672:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00010000:0.0:1790773022.545169:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773022.549190:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004d2a8f08 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495938816:0@lo:256: 10000000:01000000:2.0:1790773022.549300:0:6475:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790773022.549311:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: 00000000d7ed604b/0xabf1cc0bc784164f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841656 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773022.549333:0:6475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: 00000000d7ed604b/0xabf1cc0bc784164f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841656 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790773022.549344:0:6475:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790773022.549347:0:6475:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93d25268e800 from 4 10000000:01000000:2.0:1790773022.549350:0:6475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790773022.549387:0:6475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: 0000000007dc942a/0xabf1cc0bc784165d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773022.549411:0:6475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: 0000000007dc942a/0xabf1cc0bc784165d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773022.549420:0:6475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: 0000000007dc942a/0xabf1cc0bc784165d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773022.549441:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000886d8228 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495938944:0@lo:101: 00000100:00100000:2.0:1790773022.549574:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773022.549626:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set 0000000014b673cd going to sleep for 11 seconds 00000100:00100000:3.0:1790773022.549714:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495938944 00000100:00100000:3.0:1790773022.549723:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495938944 00000100:00100000:3.0:1790773022.549790:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790773022.549800:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000c316f22d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:6475:x1877761495938944:12345-0@lo:101: 00010000:00010000:3.0:1790773022.549815:0:6473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773022.549995:0:6473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000632bcef9/0xabf1cc0bc7841664 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc784165d expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773022.550020:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000632bcef9/0xabf1cc0bc7841664 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc784165d expref: 18 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773022.550043:0:6473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000632bcef9/0xabf1cc0bc7841664 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc784165d expref: 18 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773022.550051:0:6473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000632bcef9, rc 0) 00000100:00100000:3.0:1790773022.550099:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000c316f22d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:6475:x1877761495938944:12345-0@lo:101: Request processed in 300us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773022.550113:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790773022.550527:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000886d8228 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495938944:0@lo:101: 00010000:00010000:2.0:1790773022.550543:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: 0000000007dc942a/0xabf1cc0bc784165d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841664 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773022.550552:0:6475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: 0000000007dc942a/0xabf1cc0bc784165d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7841664 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773022.550601:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000886d8228 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495939072:0@lo:256: 00000100:00100000:2.0:1790773022.550636:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773022.550664:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set 0000000014b673cd going to sleep for 11 seconds 00000100:00100000:3.0:1790773022.551136:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495939072 00000100:00100000:3.0:1790773022.551144:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495939072 00000100:00100000:3.0:1790773022.551187:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790773022.551195:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000e3114b3b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:6475:x1877761495939072:12345-0@lo:256: 20000000:01000000:3.0:1790773022.551241:0:6471:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790773022.551261:0:6471:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790773022.551264:0:6471:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1790773022.551376:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000e3114b3b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:6475:x1877761495939072:12345-0@lo:256: Request processed in 182us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773022.551384:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790773022.551723:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000886d8228 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495939072:0@lo:256: 10000000:01000000:2.0:1790773022.551906:0:6475:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790773022.551913:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: 0000000007dc942a/0xabf1cc0bc784165d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841664 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773022.551922:0:6475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: 0000000007dc942a/0xabf1cc0bc784165d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841664 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773023.567723:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773024.079590:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000958bbb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761495939200:0@lo:41: 00000100:00100000:0.0:1790773024.079665:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773024.079972:0:7666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495939200 00000100:00100000:3.0:1790773024.079981:0:7666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495939200 00000100:00100000:3.0:1790773024.080022:0:7666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790773024.080030:0:7666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000f8e84006 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761495939200:12345-0@lo:41: 00000004:00000024:3.0:1790773024.080061:0:7666:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1790773024.080106:0:7666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000f8e84006 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761495939200:12345-0@lo:41: Request processed in 77us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773024.080113:0:7666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790773024.080591:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000480ed94f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761495939328:0@lo:41: 00000100:00100000:3.0:1790773024.080623:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773024.080789:0:6483:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495939328 00000100:00100000:0.0:1790773024.080795:0:6483:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495939328 00000100:00100000:0.0:1790773024.080831:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790773024.080838:0:6483:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000001468ce90 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761495939328:12345-0@lo:41: 00000004:00000024:0.0:1790773024.080859:0:6483:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1790773024.080887:0:6483:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000001468ce90 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761495939328:12345-0@lo:41: Request processed in 50us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773024.080893:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790773024.080912:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a23e29dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3605:1877761495939712:0@lo:400: 00000100:00100000:0.0:1790773024.080938:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773024.080973:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000958bbb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761495939200:0@lo:41: 00000100:00100000:0.0:1790773024.080989:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790773024.080993:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000af22a4b2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3605:1877761495939584:0@lo:400: 00000100:00100000:0.0:1790773024.081015:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773024.081038:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001037ac06 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce0675b4-b0c5-48e7-b182-565e22fed04c:3607:1877761495939456:0@lo:400: 00000100:00100000:0.0:1790773024.081063:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773024.081102:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495939712 00000100:00100000:0.0:1790773024.081107:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495939712 00000100:00100000:0.0:1790773024.081128:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495939584 00000100:00100000:0.0:1790773024.081131:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495939584 00000100:00100000:0.0:1790773024.081143:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790773024.081148:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000017f43b9f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3605:x1877761495939712:12345-0@lo:400: 00000100:00100000:0.0:1790773024.081182:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000017f43b9f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3605:x1877761495939712:12345-0@lo:400: Request processed in 34us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773024.081188:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790773024.081199:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790773024.081225:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000007ced670e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3605:x1877761495939584:12345-0@lo:400: 00000100:00100000:0.0:1790773024.081251:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000007ced670e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3605:x1877761495939584:12345-0@lo:400: Request processed in 47us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773024.081257:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790773024.081274:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495939456 00000100:00100000:0.0:1790773024.081278:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495939456 00000100:00100000:0.0:1790773024.081297:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790773024.081542:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000b95f797b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:3607:x1877761495939456:12345-0@lo:400: 00000100:00100000:0.0:1790773024.081582:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000b95f797b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:3607:x1877761495939456:12345-0@lo:400: Request processed in 279us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773024.081589:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:0.0:1790773024.081625:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000af22a4b2 x1877761495939584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773040 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773024.081637:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000af22a4b2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3605:1877761495939584:0@lo:400: 00010000:00080000:0.0:1790773024.081645:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000a23e29dd x1877761495939712/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773040 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773024.081653:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a23e29dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3605:1877761495939712:0@lo:400: 00000100:00100000:0.0:1790773024.081682:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001037ac06 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce0675b4-b0c5-48e7-b182-565e22fed04c:3607:1877761495939456:0@lo:400: 00000100:00100000:3.0:1790773024.081820:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000480ed94f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761495939328:0@lo:41: 00000020:00000004:1.0:1790773024.130437:0:7837:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790773024.130639:0:7837:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1790773024.591801:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773025.615363:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790773026.015159:0:7886:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc0c7e1eb0 20000000:00000080:2.0:1790773026.015178:0:7886:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93d24e835c00 uarg=0000000000000000 20000000:01000000:2.0:1790773026.015253:0:7886:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1790773026.015261:0:7886:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1790773026.015267:0:7886:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1790773026.015359:0:7886:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1790773026.015371:0:7886:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1790773026.022356:0:7886:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790773026.023921:0:7886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1790773026.023962:0:7886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1790773026.024042:0:7886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1790773026.024064:0:7886:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1790773026.024082:0:7886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ab7ce6bf/0xabf1cc0bc784166b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773026.024102:0:7886:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000072ca5c93/0xabf1cc0bc78414ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78414e3 expref: 17 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773026.024108:0:7886:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000b8f81d9/0xabf1cc0bc7841617 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7841610 expref: 17 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773026.024114:0:7886:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ab7ce6bf/0xabf1cc0bc784166b lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773026.024155:0:7886:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000b8f81d9/0xabf1cc0bc7841617 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc7841610 expref: 17 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773026.024169:0:7886:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000b8f81d9/0xabf1cc0bc7841617 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc7841610 expref: 17 pid: 6472 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773026.024182:0:7886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a23e29dd pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7886:1877761495939840:0@lo:104: 00000100:00100000:0.0:1790773026.024355:0:7886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790773026.024451:0:7886:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000072ca5c93/0xabf1cc0bc78414ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc78414e3 expref: 17 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773026.024459:0:7886:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000072ca5c93/0xabf1cc0bc78414ea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc78414e3 expref: 17 pid: 6472 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773026.024474:0:7886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b1db00be pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7886:1877761495939968:0@lo:104: 00000100:00100000:0.0:1790773026.024498:0:7886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773026.028458:0:7886:0:(client.c:2716:ptlrpc_set_wait()) set 000000003ca7470f going to sleep for 11 seconds 00000100:00100000:1.0:1790773026.028563:0:6461:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495939840 00000100:00100000:1.0:1790773026.028574:0:6461:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495939840 00000100:00100000:1.0:1790773026.028619:0:6461:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495939968 00000100:00100000:1.0:1790773026.028622:0:6461:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495939968 00000100:00100000:1.0:1790773026.028637:0:6461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790773026.028645:0:6461:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000e4b45824 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce0675b4-b0c5-48e7-b182-565e22fed04c+4:7886:x1877761495939840:12345-0@lo:104: 00010000:00010000:1.0:1790773026.028672:0:6461:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: 000000006ff3bd0f/0xabf1cc0bc7841610 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7841617 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773026.028812:0:6461:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790773026.028818:0:6461:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000e4b45824 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce0675b4-b0c5-48e7-b182-565e22fed04c+4:7886:x1877761495939840:12345-0@lo:104: Request processed in 174us (4464us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773026.028825:0:6461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790773026.028844:0:6461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790773026.028850:0:6461:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000421081bf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce0675b4-b0c5-48e7-b182-565e22fed04c+3:7886:x1877761495939968:12345-0@lo:104: 00010000:00010000:1.0:1790773026.028858:0:6461:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: 00000000c31c7ba7/0xabf1cc0bc78414e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc78414ea expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773026.028895:0:6461:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1790773026.028900:0:6461:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000421081bf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce0675b4-b0c5-48e7-b182-565e22fed04c+3:7886:x1877761495939968:12345-0@lo:104: Request processed in 51us (4403us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773026.028906:0:6461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1790773026.028922:0:6466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790773026.028927:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: 000000006ff3bd0f/0xabf1cc0bc7841610 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7841617 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773026.028948:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006ff3bd0f already unused, calling callback (000000000c3d7381) 10000000:00010000:1.0:1790773026.028951:0:6466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: 000000006ff3bd0f/0xabf1cc0bc7841610 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc7841617 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773026.028959:0:6466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: 000000006ff3bd0f/0xabf1cc0bc7841610 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc7841617 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790773026.028982:0:6466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: 000000006ff3bd0f/0xabf1cc0bc7841610 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc7841617 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790773026.028988:0:6466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790773026.029022:0:6466:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: 000000006ff3bd0f/0xabf1cc0bc7841610 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841617 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773026.029029:0:6466:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790773026.029046:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: 000000006ff3bd0f/0xabf1cc0bc7841610 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841617 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773026.029053:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: 000000006ff3bd0f/0xabf1cc0bc7841610 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841617 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773026.029065:0:6466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790773026.029067:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: 00000000c31c7ba7/0xabf1cc0bc78414e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc78414ea expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773026.029073:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c31c7ba7 already unused, calling callback (000000000c3d7381) 10000000:00010000:1.0:1790773026.029075:0:6466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: 00000000c31c7ba7/0xabf1cc0bc78414e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc78414ea expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773026.029092:0:6466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: 00000000c31c7ba7/0xabf1cc0bc78414e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc78414ea expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790773026.029099:0:6466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: 00000000c31c7ba7/0xabf1cc0bc78414e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc78414ea expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790773026.029104:0:6466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790773026.029116:0:6466:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: 00000000c31c7ba7/0xabf1cc0bc78414e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78414ea expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773026.029122:0:6466:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790773026.029126:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: 00000000c31c7ba7/0xabf1cc0bc78414e3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78414ea expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773026.029131:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: 00000000c31c7ba7/0xabf1cc0bc78414e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78414ea expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773026.029144:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773026.029145:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773026.029147:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773026.029166:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b9146aee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce0675b4-b0c5-48e7-b182-565e22fed04c:3606:1877761495940096:0@lo:103: 00000100:00100000:1.0:1790773026.029225:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773026.029249:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790773026.029254:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a0e9fa33 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce0675b4-b0c5-48e7-b182-565e22fed04c:3606:1877761495940224:0@lo:103: 00000100:00100000:1.0:1790773026.029295:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773026.029325:0:6464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495940096 00000100:00100000:1.0:1790773026.029329:0:6464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495940096 00010000:00010000:1.0:1790773026.029349:0:6464:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000b8f81d9/0xabf1cc0bc7841617 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7841610 expref: 18 pid: 6472 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773026.029380:0:6464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495940224 00000100:00100000:1.0:1790773026.029383:0:6464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495940224 00010000:00010000:1.0:1790773026.029395:0:6464:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000072ca5c93/0xabf1cc0bc78414ea lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc78414e3 expref: 19 pid: 6472 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773026.029407:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790773026.029413:0:6464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000b69eb200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+19:3606:x1877761495940096:12345-0@lo:103: 00010000:00010000:1.0:1790773026.029422:0:6464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790773026.029427:0:6464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000b8f81d9/0xabf1cc0bc7841617 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7841610 expref: 19 pid: 6472 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773026.029437:0:6464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000b8f81d9/0xabf1cc0bc7841617 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc7841610 expref: 19 pid: 6472 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773026.029453:0:6464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790773026.029481:0:6464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000b69eb200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+19:3606:x1877761495940096:12345-0@lo:103: Request processed in 69us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773026.029487:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790773026.029499:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790773026.029504:0:6464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000094f749cb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:3606:x1877761495940224:12345-0@lo:103: 00010000:00010000:1.0:1790773026.029512:0:6464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790773026.029516:0:6464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000072ca5c93/0xabf1cc0bc78414ea lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc78414e3 expref: 18 pid: 6472 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773026.029523:0:6464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000072ca5c93/0xabf1cc0bc78414ea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc78414e3 expref: 18 pid: 6472 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773026.029534:0:6464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ab7ce6bf/0xabf1cc0bc784166b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773026.029550:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ab7ce6bf/0xabf1cc0bc784166b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773026.029566:0:6464:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ab7ce6bf/0xabf1cc0bc784166b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773026.029572:0:6464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ab7ce6bf/0xabf1cc0bc784166b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773026.029578:0:6464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ab7ce6bf/0xabf1cc0bc784166b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773026.029582:0:6464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ab7ce6bf/0xabf1cc0bc784166b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773026.029587:0:6464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ab7ce6bf already unused, calling callback (0000000035eb843c) 00010000:00010000:1.0:1790773026.029591:0:6464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ab7ce6bf/0xabf1cc0bc784166b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773026.029597:0:6464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ab7ce6bf/0xabf1cc0bc784166b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773026.029603:0:6464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ab7ce6bf/0xabf1cc0bc784166b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773026.029611:0:6464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790773026.029638:0:6464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000094f749cb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:3606:x1877761495940224:12345-0@lo:103: Request processed in 129us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773026.029647:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790773026.029697:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a0e9fa33 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce0675b4-b0c5-48e7-b182-565e22fed04c:3606:1877761495940224:0@lo:103: 00000100:00100000:1.0:1790773026.029713:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b9146aee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce0675b4-b0c5-48e7-b182-565e22fed04c:3606:1877761495940096:0@lo:103: 00010000:00010000:3.0:1790773026.029785:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773026.037863:0:7886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000b8f81d9/0xabf1cc0bc7841617 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc7841610 expref: 17 pid: 6472 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773026.037888:0:7886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a23e29dd pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7886:1877761495939840:0@lo:104: 00010000:00010000:1.0:1790773026.038279:0:7886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000072ca5c93/0xabf1cc0bc78414ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc78414e3 expref: 16 pid: 6472 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773026.038304:0:7886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b1db00be pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7886:1877761495939968:0@lo:104: 00010000:00010000:1.0:1790773026.038337:0:7886:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ab7ce6bf/0xabf1cc0bc784166b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773026.038348:0:7886:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ab7ce6bf/0xabf1cc0bc784166b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773026.038353:0:7886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ab7ce6bf/0xabf1cc0bc784166b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773026.038359:0:7886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ab7ce6bf/0xabf1cc0bc784166b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773026.642237:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773027.662831:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773028.686958:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773029.200723:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000886d8228 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761495940352:0@lo:41: 00000100:00100000:0.0:1790773029.200808:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773029.200863:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009d9965d7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761495940864:0@lo:400: 00000100:00100000:0.0:1790773029.200883:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773029.200907:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1790773029.200912:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005b47e109 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce0675b4-b0c5-48e7-b182-565e22fed04c:3604:1877761495940480:0@lo:400: 00000100:00100000:0.0:1790773029.200937:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773029.201060:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000080d3d75f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3606:1877761495940608:0@lo:400: 00000100:00100000:3.0:1790773029.201093:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773029.201151:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000165bfecb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3604:1877761495940992:0@lo:400: 00000100:00100000:3.0:1790773029.205732:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000937a6955 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761495941120:0@lo:41: 00000100:00100000:3.0:1790773029.205799:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773029.205832:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790773029.205838:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001e9d5e89 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761495940736:0@lo:400: 00000100:00100000:3.0:1790773029.205860:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773029.205919:0:6484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495940352 00000100:00100000:2.0:1790773029.205928:0:6484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495940352 00000100:00100000:2.0:1790773029.205976:0:6484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495940864 00000100:00100000:2.0:1790773029.205979:0:6484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495940864 00000100:00100000:2.0:1790773029.205988:0:6484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495941120 00000100:00100000:2.0:1790773029.205990:0:6484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495941120 00000100:00100000:2.0:1790773029.205999:0:6484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495940736 00000100:00100000:2.0:1790773029.206001:0:6484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495940736 00000100:00100000:2.0:1790773029.206012:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790773029.206018:0:6484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000093649676 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3604:x1877761495940352:12345-0@lo:41: 00000004:00000024:2.0:1790773029.206052:0:6484:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1790773029.206095:0:6484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000093649676 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3604:x1877761495940352:12345-0@lo:41: Request processed in 77us (5288us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773029.206101:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790773029.206119:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790773029.206124:0:6484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000075d3a087 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761495940864:12345-0@lo:400: 00000100:00100000:2.0:1790773029.206152:0:6484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000075d3a087 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761495940864:12345-0@lo:400: Request processed in 29us (5269us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773029.206157:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790773029.206179:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790773029.206183:0:6484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000ee4d1af8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3606:x1877761495941120:12345-0@lo:41: 00000004:00000024:2.0:1790773029.206198:0:6484:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1790773029.206274:0:6484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000ee4d1af8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3606:x1877761495941120:12345-0@lo:41: Request processed in 91us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773029.206281:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790773029.206293:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790773029.206298:0:6484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000005590c511 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761495940736:12345-0@lo:400: 00000100:00100000:2.0:1790773029.206324:0:6484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000005590c511 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761495940736:12345-0@lo:400: Request processed in 26us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773029.206330:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790773029.206459:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001e9d5e89 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761495940736:0@lo:400: 00000100:00100000:3.0:1790773029.206474:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000937a6955 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761495941120:0@lo:41: 00000100:00100000:0.0:1790773029.206631:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495940608 00000100:00100000:0.0:1790773029.206636:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495940608 00000100:00100000:0.0:1790773029.206669:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790773029.206675:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000006a6cee92 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1877761495940608:12345-0@lo:400: 00000100:00100000:0.0:1790773029.206713:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000006a6cee92 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1877761495940608:12345-0@lo:400: Request processed in 39us (5620us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773029.206719:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790773029.206753:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495940480 00000100:00100000:0.0:1790773029.206756:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495940480 00000100:00100000:0.0:1790773029.206779:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790773029.206783:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000006c1c3e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:3604:x1877761495940480:12345-0@lo:400: 00000100:00100000:0.0:1790773029.206818:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000006c1c3e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:3604:x1877761495940480:12345-0@lo:400: Request processed in 35us (5881us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773029.206823:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790773029.206850:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773029.206869:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495940992 00000100:00100000:0.0:1790773029.206872:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495940992 00000100:00100000:0.0:1790773029.206889:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790773029.206893:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000ac98fb56 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3604:x1877761495940992:12345-0@lo:400: 00000100:00100000:0.0:1790773029.206917:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000ac98fb56 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3604:x1877761495940992:12345-0@lo:400: Request processed in 24us (68us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773029.206922:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1790773029.207030:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000080d3d75f x1877761495940608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773045 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773029.207043:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000080d3d75f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3606:1877761495940608:0@lo:400: 00010000:00080000:0.0:1790773029.207075:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000165bfecb x1877761495940992/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773045 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773029.207084:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000165bfecb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3604:1877761495940992:0@lo:400: 00000100:00100000:0.0:1790773029.207099:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000886d8228 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761495940352:0@lo:41: 00000100:00100000:0.0:1790773029.207107:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009d9965d7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761495940864:0@lo:400: 00000100:00100000:0.0:1790773029.207121:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005b47e109 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce0675b4-b0c5-48e7-b182-565e22fed04c:3604:1877761495940480:0@lo:400: 00010000:00010000:1.0:1790773029.713664:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1790773029.837302:0:6475:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790773029.837368:0:6475:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d26ed89000 from 1 10000000:01000000:1.0:1790773029.837373:0:6475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790773029.837425:0:6475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: 00000000dd0890f6/0xabf1cc0bc7841672 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773029.837892:0:6475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: 00000000dd0890f6/0xabf1cc0bc7841672 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773029.837907:0:6475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: 00000000dd0890f6/0xabf1cc0bc7841672 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773029.838110:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b9146aee pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495941248:0@lo:101: 00000100:00100000:1.0:1790773029.838192:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773029.838354:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set 00000000be3efaf8 going to sleep for 11 seconds 00000100:00100000:3.0:1790773029.842180:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495941248 00000100:00100000:3.0:1790773029.842196:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495941248 00000100:00100000:2.0:1790773029.847618:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790773029.847632:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000009a7bf511 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:6475:x1877761495941248:12345-0@lo:101: 00010000:00010000:2.0:1790773029.847652:0:6471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773029.847674:0:6471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000027db9d5a/0xabf1cc0bc7841679 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7841672 expref: -99 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773029.847702:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000027db9d5a/0xabf1cc0bc7841679 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7841672 expref: 17 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773029.847713:0:6471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000027db9d5a/0xabf1cc0bc7841679 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7841672 expref: 17 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773029.847723:0:6471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000027db9d5a, rc 0) 00000100:00100000:2.0:1790773029.847802:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000009a7bf511 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:6475:x1877761495941248:12345-0@lo:101: Request processed in 174us (9611us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773029.847809:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790773029.847880:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b9146aee pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495941248:0@lo:101: 00010000:00010000:2.0:1790773029.847906:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: 00000000dd0890f6/0xabf1cc0bc7841672 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841679 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773029.847915:0:6475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: 00000000dd0890f6/0xabf1cc0bc7841672 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7841679 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773029.848004:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e8d7433a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495941376:0@lo:501: 00000100:00100000:2.0:1790773029.848035:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773029.848066:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set 00000000157f72ab going to sleep for 11 seconds 00000100:00100000:2.0:1790773029.848080:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495941376 00000100:00100000:2.0:1790773029.848086:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495941376 00000100:00100000:2.0:1790773029.848110:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790773029.848116:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000405b73a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:6475:x1877761495941376:12345-0@lo:501: 00000100:00100000:2.0:1790773029.848239:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000405b73a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:6475:x1877761495941376:12345-0@lo:501: Request processed in 123us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773029.848257:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790773029.848295:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e8d7433a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495941376:0@lo:501: 00000100:00100000:2.0:1790773029.848323:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e8d7433a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495941504:0@lo:503: 00000100:00100000:2.0:1790773029.848365:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773029.848384:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set 00000000157f72ab going to sleep for 11 seconds 00000100:00100000:2.0:1790773029.848396:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495941504 00000100:00100000:2.0:1790773029.848399:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495941504 00000100:00100000:2.0:1790773029.848418:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790773029.848423:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000fafa33f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:6475:x1877761495941504:12345-0@lo:503: 00000100:00100000:2.0:1790773029.848504:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000fafa33f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:6475:x1877761495941504:12345-0@lo:503: Request processed in 80us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773029.848511:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790773029.848556:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e8d7433a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495941504:0@lo:503: 00000100:00100000:3.0:1790773029.849550:0:8016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008769d7f5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:8016:1877761495941632:0@lo:502: 00000100:00100000:3.0:1790773029.849604:0:8016:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773029.849639:0:8016:0:(client.c:2716:ptlrpc_set_wait()) set 0000000060544a04 going to sleep for 11 seconds 00000100:00100000:2.0:1790773029.849692:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495941632 00000100:00100000:2.0:1790773029.849698:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495941632 00000100:00100000:2.0:1790773029.849741:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1790773029.849748:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000f7f89aec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:8016:x1877761495941632:12345-0@lo:502: 00000100:00100000:2.0:1790773029.850109:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000f7f89aec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:8016:x1877761495941632:12345-0@lo:502: Request processed in 361us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773029.850117:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790773029.859988:0:8016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008769d7f5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:8016:1877761495941632:0@lo:502: 00000020:01000000:3.0:1790773029.862917:0:8016:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790773029.862935:0:8016:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773029.862938:0:8016:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1790773029.863123:0:8016:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93d26ed89000 00000020:00000080:3.0:1790773029.863126:0:8016:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790773029.863194:0:8016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447de300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:8016:1877761495941760:0@lo:502: 00000100:00100000:3.0:1790773029.863437:0:8016:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773029.863489:0:8016:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ef8c780 going to sleep for 11 seconds 00000100:00100000:0.0:1790773029.867695:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495941760 00000100:00100000:0.0:1790773029.867711:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495941760 00000100:00100000:0.0:1790773029.867778:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790773029.867789:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:8016:x1877761495941760:12345-0@lo:502: 00000100:00100000:0.0:1790773029.868008:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:8016:x1877761495941760:12345-0@lo:502: Request processed in 220us (4571us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773029.868017:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790773029.881877:0:8016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447de300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:8016:1877761495941760:0@lo:502: 00000020:01000000:1.0:1790773029.881935:0:8016:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790773029.881949:0:8016:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790773029.881952:0:8016:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1790773029.881956:0:8016:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1790773029.882419:0:6475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1790773029.882448:0:6475:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790773029.882478:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12b600/0xabf1cc0bc7841672 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841679 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773029.882491:0:6475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d27b12b600/0xabf1cc0bc7841672 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841679 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773029.882502:0:6475:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790773029.882505:0:6475:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d25268e800 from 1 10000000:01000000:3.0:1790773029.882507:0:6475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790773029.882545:0:6475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d24166e600/0xabf1cc0bc7841680 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773029.882552:0:6475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d24166e600/0xabf1cc0bc7841680 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773029.882561:0:6475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d24166e600/0xabf1cc0bc7841680 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773029.882581:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495941888:0@lo:101: 00000100:00100000:3.0:1790773029.882654:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773029.882700:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ef8c000 going to sleep for 11 seconds 00000100:00100000:0.0:1790773029.882861:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495941888 00000100:00100000:0.0:1790773029.882875:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495941888 00000100:00100000:0.0:1790773029.882931:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1790773029.882941:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:6475:x1877761495941888:12345-0@lo:101: 00010000:00010000:0.0:1790773029.882954:0:6473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773029.882965:0:6473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d26c4a2c00/0xabf1cc0bc7841687 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7841680 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773029.882989:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d26c4a2c00/0xabf1cc0bc7841687 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7841680 expref: 18 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773029.883000:0:6473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d26c4a2c00/0xabf1cc0bc7841687 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7841680 expref: 18 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773029.883010:0:6473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26c4a2c00, rc 0) 00000100:00100000:0.0:1790773029.883060:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:6475:x1877761495941888:12345-0@lo:101: Request processed in 121us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773029.883067:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1790773029.884060:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495941888:0@lo:101: 00010000:00010000:1.0:1790773029.884086:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d24166e600/0xabf1cc0bc7841680 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841687 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773029.884098:0:6475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d24166e600/0xabf1cc0bc7841680 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7841687 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773029.884165:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495942016:0@lo:501: 00000100:00100000:1.0:1790773029.884233:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773029.884285:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c159180 going to sleep for 11 seconds 00000100:00100000:0.0:1790773029.884390:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495942016 00000100:00100000:0.0:1790773029.884395:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495942016 00000100:00100000:0.0:1790773029.884439:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790773029.884446:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:6475:x1877761495942016:12345-0@lo:501: 00000100:00100000:0.0:1790773029.884565:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:6475:x1877761495942016:12345-0@lo:501: Request processed in 119us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773029.884572:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790773029.886036:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495942016:0@lo:501: 00000100:00100000:3.0:1790773029.886093:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495942144:0@lo:503: 00000100:00100000:3.0:1790773029.886168:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773029.886222:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ef8cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1790773029.887732:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495942144 00000100:00100000:0.0:1790773029.887744:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495942144 00000100:00100000:0.0:1790773029.887799:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790773029.887808:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:6475:x1877761495942144:12345-0@lo:503: 00000100:00100000:0.0:1790773029.888100:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:6475:x1877761495942144:12345-0@lo:503: Request processed in 293us (1932us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773029.888113:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790773029.888235:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495942144:0@lo:503: 00000100:00100000:0.0:1790773029.888926:0:8019:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ed69f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:8019:1877761495942272:0@lo:502: 00000100:00100000:0.0:1790773029.888989:0:8019:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773029.889016:0:8019:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26c741a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790773029.890329:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495942272 00000100:00100000:2.0:1790773029.890350:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495942272 00000100:00100000:2.0:1790773029.890395:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790773029.890404:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:8019:x1877761495942272:12345-0@lo:502: 00000100:00100000:2.0:1790773029.890535:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:8019:x1877761495942272:12345-0@lo:502: Request processed in 132us (1547us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773029.890543:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1790773029.891465:0:8019:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ed69f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:8019:1877761495942272:0@lo:502: 00000020:01000000:0.0:1790773029.891498:0:8019:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790773029.891508:0:8019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773029.891511:0:8019:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1790773029.891518:0:8019:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93d25268e800 00000020:00000080:0.0:1790773029.891521:0:8019:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1790773029.891550:0:8019:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ed69f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:8019:1877761495942400:0@lo:502: 00000100:00100000:0.0:1790773029.891597:0:8019:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773029.891629:0:8019:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26c741a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790773029.893060:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495942400 00000100:00100000:1.0:1790773029.893071:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495942400 00000100:00100000:1.0:1790773029.893112:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790773029.893121:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:8019:x1877761495942400:12345-0@lo:502: 00000100:00100000:1.0:1790773029.893302:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:8019:x1877761495942400:12345-0@lo:502: Request processed in 181us (1704us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773029.893310:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790773029.893366:0:8019:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ed69f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:8019:1877761495942400:0@lo:502: 00000020:01000000:1.0:1790773029.893401:0:8019:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790773029.893407:0:8019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790773029.893410:0:8019:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1790773029.893414:0:8019:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1790773029.893478:0:6475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1790773029.893500:0:6475:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790773029.893511:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d24166e600/0xabf1cc0bc7841680 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841687 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773029.893525:0:6475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d24166e600/0xabf1cc0bc7841680 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841687 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773030.734878:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773031.760246:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773032.794125:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773033.805470:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773034.317465:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790773034.317494:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ec62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761495942528:0@lo:41: 00000100:00100000:2.0:1790773034.317570:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773034.317629:0:6484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495942528 00000100:00100000:2.0:1790773034.317637:0:6484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495942528 00000100:00100000:2.0:1790773034.317674:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790773034.317681:0:6484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ec61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761495942528:12345-0@lo:41: 00000004:00000024:2.0:1790773034.317714:0:6484:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1790773034.317758:0:6484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ec61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761495942528:12345-0@lo:41: Request processed in 76us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773034.317765:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790773034.317835:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ec62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761495942528:0@lo:41: 00000100:00100000:0.0:1790773034.319801:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce0675b4-b0c5-48e7-b182-565e22fed04c:3604:1877761495942656:0@lo:400: 00000100:00100000:0.0:1790773034.319874:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773034.319949:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790773034.319956:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3604:1877761495942784:0@lo:400: 00000100:00100000:0.0:1790773034.319984:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773034.320023:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495942784 00000100:00100000:0.0:1790773034.320031:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495942784 00000100:00100000:0.0:1790773034.320078:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790773034.320088:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ed68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3604:x1877761495942784:12345-0@lo:400: 00000100:00100000:0.0:1790773034.320156:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ed68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3604:x1877761495942784:12345-0@lo:400: Request processed in 57us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773034.320166:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790773034.321294:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877761495943040:0@lo:400: 00000100:00100000:0.0:1790773034.321338:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773034.321371:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790773034.321377:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761495942912:0@lo:400: 00000100:00100000:0.0:1790773034.321404:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773034.321433:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495943040 00000100:00100000:0.0:1790773034.321439:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495943040 00000100:00100000:0.0:1790773034.321475:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790773034.321484:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ed68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877761495943040:12345-0@lo:400: 00000100:00100000:0.0:1790773034.321531:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ed68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877761495943040:12345-0@lo:400: Request processed in 47us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773034.321537:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790773034.321558:0:7666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495942912 00000100:00100000:0.0:1790773034.321562:0:7666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495942912 00000100:00100000:0.0:1790773034.321584:0:7666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790773034.321590:0:7666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ed6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761495942912:12345-0@lo:400: 00000100:00100000:0.0:1790773034.321620:0:7666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ed6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761495942912:12345-0@lo:400: Request processed in 31us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773034.321626:0:7666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790773034.321662:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761495942912:0@lo:400: 00010000:00080000:0.0:1790773034.321675:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d2447de300 x1877761495943040/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773050 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773034.321685:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877761495943040:0@lo:400: 00010000:00080000:0.0:1790773034.321718:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d2447dd880 x1877761495942784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773050 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773034.321728:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3604:1877761495942784:0@lo:400: 00000100:00100000:2.0:1790773034.323364:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790773034.323388:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ec62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761495943168:0@lo:41: 00000100:00100000:2.0:1790773034.323448:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773034.323497:0:6483:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495943168 00000100:00100000:2.0:1790773034.323505:0:6483:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495943168 00000100:00100000:2.0:1790773034.323546:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790773034.323554:0:6483:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ec60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761495943168:12345-0@lo:41: 00000004:00000024:2.0:1790773034.323589:0:6483:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1790773034.323635:0:6483:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ec60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761495943168:12345-0@lo:41: Request processed in 82us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773034.323642:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790773034.323687:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ec62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761495943168:0@lo:41: 00000100:00100000:1.0:1790773034.323846:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495942656 00000100:00100000:1.0:1790773034.323852:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495942656 00000100:00100000:1.0:1790773034.324081:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790773034.324089:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:3604:x1877761495942656:12345-0@lo:400: 00000100:00100000:1.0:1790773034.324130:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:3604:x1877761495942656:12345-0@lo:400: Request processed in 43us (4256us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773034.324137:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1790773034.327308:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce0675b4-b0c5-48e7-b182-565e22fed04c:3604:1877761495942656:0@lo:400: 00010000:00010000:0.0:1790773034.837085:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773035.859125:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790773036.725148:0:8386:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790773036.725152:0:8386:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1790773036.725154:0:8386:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1790773036.731173:0:8386:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93d26ff80800 00000020:01000004:3.0:1790773036.737814:0:8386:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1790773036.737833:0:8386:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1790773036.737856:0:8386:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff93d27b2c0000) 00000020:00000080:3.0:1790773036.738117:0:8386:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1790773036.791197:0:8386:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1790773036.791280:0:8386:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:0.0:1790773036.821542:0:8386:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1790773036.821737:0:8386:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1790773036.821749:0:8386:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:0.0:1790773036.821759:0:8386:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xabf1cc0bc7841695 00000020:01000004:0.0:1790773036.821765:0:8386:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1790773036.821785:0:8386:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.119@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1790773036.821790:0:8386:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.119@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1790773036.821796:0:8386:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1790773036.821800:0:8386:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1790773036.821810:0:8386:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff93d26bfc4d40) 00000020:00000080:0.0:1790773036.821820:0:8386:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:0.0:1790773036.823568:0:8386:0:(service.c:173:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790773036.823734:0:8386:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1790773036.823740:0:8386:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1790773036.824503:0:8386:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1790773036.824510:0:8386:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1790773036.824785:0:8386:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1790773036.824790:0:8386:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1790773036.833417:0:8386:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790773036.833617:0:8386:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1790773036.833626:0:8386:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1790773036.834583:0:8386:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1790773036.834591:0:8386:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1790773036.865149:0:8386:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790773036.865621:0:8386:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1790773036.865628:0:8386:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1790773036.867135:0:8386:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1790773036.867149:0:8386:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1790773036.876073:0:8386:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1790773036.876092:0:8386:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00010000:00010000:1.0:1790773036.877432:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773036.889609:0:8386:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790773036.889797:0:8386:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1790773036.889803:0:8386:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1790773036.892581:0:8386:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1790773036.892594:0:8386:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1790773036.942617:0:8386:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790773036.942824:0:8386:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1790773036.942830:0:8386:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1790773036.952155:0:8386:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1790773036.952170:0:8386:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1790773036.952694:0:8386:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1790773036.952730:0:8386:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1790773036.952737:0:8386:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.119@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1790773036.977581:0:8386:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.119@tcp ctxt 0 is initialized 00000020:01000004:1.0:1790773036.977626:0:8386:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.119@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1790773036.977630:0:8386:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1790773036.977632:0:8386:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790773036.977634:0:8386:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790773036.977635:0:8386:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790773036.977636:0:8386:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790773036.977638:0:8386:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790773036.977639:0:8386:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790773036.977641:0:8386:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790773036.977642:0:8386:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790773036.977643:0:8386:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790773036.977645:0:8386:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790773036.977649:0:8386:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1790773036.977651:0:8386:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790773036.977652:0:8386:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790773036.977654:0:8386:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790773036.977655:0:8386:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790773036.977656:0:8386:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790773036.977657:0:8386:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790773036.977658:0:8386:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790773036.977659:0:8386:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790773036.977660:0:8386:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790773036.977661:0:8386:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790773036.977662:0:8386:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790773036.977705:0:8386:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1790773036.977724:0:8386:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:8386:1877761495943296:0@lo:253: 00000100:00100000:1.0:1790773036.977797:0:8386:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773036.978040:0:8386:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26c35db40 going to sleep for 11 seconds 00000100:00100000:2.0:1790773036.978134:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495943296 00000100:00100000:2.0:1790773036.978144:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495943296 00000100:00100000:1.0:1790773036.978392:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790773036.978411:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:8386:x1877761495943296:12345-0@lo:253: 20000000:01000000:1.0:1790773036.978443:0:6473:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1790773036.978447:0:6473:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1790773036.978452:0:6473:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1790773036.978455:0:6473:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1790773036.978657:0:6473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790773036.978776:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1790773036.978789:0:6473:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1790773036.978804:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1790773036.978809:0:6473:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1790773036.978820:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1790773036.978832:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1790773036.979159:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1790773036.979174:0:6473:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.119@tcp 20000000:01000000:1.0:1790773036.979176:0:6473:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.119@tcp (null) (null) (null) 00000040:00080000:1.0:1790773036.979239:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1790773036.979246:0:6473:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1790773036.979261:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1790773036.979266:0:6473:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.119@tcp (null) (null) 00000040:00080000:1.0:1790773036.979276:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1790773036.979282:0:6473:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1790773036.979292:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1790773036.979304:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1790773036.979363:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:1.0:1790773036.979372:0:6473:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.119@tcp 20000000:01000000:1.0:1790773036.979374:0:6473:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.119@tcp (null) (null) (null) 00000040:00080000:1.0:1790773036.979386:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:1.0:1790773036.979390:0:6473:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1790773036.979401:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:1.0:1790773036.979405:0:6473:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.202.119@tcp (null) (null) 00000040:00080000:1.0:1790773036.979418:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:1.0:1790773036.979432:0:6473:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1790773036.979446:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:1.0:1790773036.979459:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:1.0:1790773036.979831:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:1.0:1790773036.979844:0:6473:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.119@tcp 20000000:01000000:1.0:1790773036.979845:0:6473:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.119@tcp (null) (null) (null) 00000040:00080000:1.0:1790773036.979859:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:1.0:1790773036.979864:0:6473:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1790773036.979877:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:1.0:1790773036.979882:0:6473:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.119@tcp (null) (null) 00000040:00080000:1.0:1790773036.979894:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:1.0:1790773036.980298:0:6473:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1790773036.980322:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:1.0:1790773036.980359:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:1.0:1790773036.980374:0:6473:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1790773036.980377:0:6473:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1790773036.980381:0:6473:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1790773036.980445:0:6473:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1790773036.980448:0:6473:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1790773036.981115:0:8405:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1790773036.981350:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1790773036.981375:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1790773036.981391:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1790773036.981401:0:6473:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1790773036.981402:0:6473:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1790773036.981783:0:8406:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:1.0:1790773036.981807:0:8406:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:1.0:1790773036.981823:0:8406:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:2.0:1790773036.981954:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:2.0:1790773036.981974:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:2.0:1790773036.981989:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:2.0:1790773036.982008:0:6473:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1790773036.982011:0:6473:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1790773036.982604:0:8407:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 19 1->4: lustre sys.timeout 20000000:01000000:1.0:1790773036.982627:0:8407:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 19 2->4: lustre sys.timeout 00000040:00080000:1.0:1790773036.982641:0:8407:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1790773036.982776:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:2.0:1790773036.982809:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:2.0:1790773036.982825:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:2.0:1790773036.982835:0:6473:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1790773036.982836:0:6473:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1790773036.983197:0:8408:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:1.0:1790773036.983315:0:8408:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:1.0:1790773036.983332:0:8408:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1790773036.983495:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1790773036.983514:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1790773036.983529:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:2.0:1790773036.983542:0:6473:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1790773036.983561:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93d241527800/0xabf1cc0bc78416a3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773036.983579:0:6473:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d26c4a3600/0xabf1cc0bc7841545 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc784153e expref: 18 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773036.983587:0:6473:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d2532e5c00/0xabf1cc0bc7841561 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc784155a expref: 18 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773036.983595:0:6473:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d27b12b800/0xabf1cc0bc784158b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7841584 expref: 18 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773036.983602:0:6473:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d27b12ac00/0xabf1cc0bc78415ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78415a7 expref: 18 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773036.983609:0:6473:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d27b12a400/0xabf1cc0bc7841625 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc784161e expref: 18 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773036.983617:0:6473:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93d241527800/0xabf1cc0bc78416a3 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773036.983655:0:6473:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d27b12a400/0xabf1cc0bc7841625 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc784161e expref: 18 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773036.983680:0:6473:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d27b12a400/0xabf1cc0bc7841625 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc784161e expref: 18 pid: 6472 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773036.983695:0:6473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ec62680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6473:1877761495943424:0@lo:104: 00000100:00100000:2.0:1790773036.983760:0:6473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790773036.983816:0:6473:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d27b12ac00/0xabf1cc0bc78415ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc78415a7 expref: 18 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773036.983824:0:6473:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d27b12ac00/0xabf1cc0bc78415ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc78415a7 expref: 18 pid: 6473 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773036.983832:0:6473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ec60000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6473:1877761495943552:0@lo:104: 00000100:00100000:2.0:1790773036.983852:0:6473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790773036.983883:0:6473:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d27b12b800/0xabf1cc0bc784158b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc7841584 expref: 18 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773036.983892:0:6473:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d27b12b800/0xabf1cc0bc784158b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc7841584 expref: 18 pid: 6472 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773036.983971:0:6473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ec63b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6473:1877761495943680:0@lo:104: 00000100:00100000:2.0:1790773036.983995:0:6473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790773036.984012:0:6473:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d2532e5c00/0xabf1cc0bc7841561 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc784155a expref: 18 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773036.984020:0:6473:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d2532e5c00/0xabf1cc0bc7841561 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc784155a expref: 18 pid: 6473 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773036.984028:0:6473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ec63480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6473:1877761495943808:0@lo:104: 00000100:00100000:2.0:1790773036.984055:0:6473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790773036.984071:0:6473:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d26c4a3600/0xabf1cc0bc7841545 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc784153e expref: 18 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773036.984080:0:6473:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d26c4a3600/0xabf1cc0bc7841545 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc784153e expref: 18 pid: 6472 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773036.984088:0:6473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ec60700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6473:1877761495943936:0@lo:104: 00000100:00100000:2.0:1790773036.984109:0:6473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773036.984119:0:6473:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c144300 going to sleep for 11 seconds 00000100:00100000:3.0:1790773036.984249:0:6462:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1790773036.984262:0:6462:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495943424 00000100:00100000:3.0:1790773036.984268:0:6462:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495943424 00000100:00100000:3.0:1790773036.984303:0:6462:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495943552 00000100:00100000:3.0:1790773036.984306:0:6462:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495943552 00000100:00100000:3.0:1790773036.984316:0:6462:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495943680 00000100:00100000:3.0:1790773036.984318:0:6462:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495943680 00000100:00100000:3.0:1790773036.984326:0:6462:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495943808 00000100:00100000:3.0:1790773036.984328:0:6462:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495943808 00000100:00100000:3.0:1790773036.984337:0:6462:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495943936 00000100:00100000:3.0:1790773036.984340:0:6462:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495943936 00000100:00100000:3.0:1790773036.984352:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790773036.984361:0:6462:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ec63100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+7:6473:x1877761495943424:12345-0@lo:104: 00010000:00010000:3.0:1790773036.984372:0:6462:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2a00/0xabf1cc0bc784161e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7841625 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773036.984440:0:6462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790773036.984447:0:6462:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ec63100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+7:6473:x1877761495943424:12345-0@lo:104: Request processed in 88us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773036.984454:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790773036.984471:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790773036.984477:0:6462:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ec61180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+6:6473:x1877761495943552:12345-0@lo:104: 00010000:00010000:3.0:1790773036.984484:0:6462:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d27b12a800/0xabf1cc0bc78415a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc78415ae expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773036.984516:0:6462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790773036.984527:0:6462:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ec61180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+6:6473:x1877761495943552:12345-0@lo:104: Request processed in 50us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773036.984532:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790773036.984544:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790773036.984550:0:6462:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ec61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+5:6473:x1877761495943680:12345-0@lo:104: 00010000:00010000:3.0:1790773036.984557:0:6462:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d27b12a000/0xabf1cc0bc7841584 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc784158b expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773036.984582:0:6462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1790773036.984587:0:6462:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ec61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+5:6473:x1877761495943680:12345-0@lo:104: Request processed in 38us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773036.984592:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790773036.984601:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790773036.984607:0:6462:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ec60e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+4:6473:x1877761495943808:12345-0@lo:104: 00010000:00010000:3.0:1790773036.984613:0:6462:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d2532e4e00/0xabf1cc0bc784155a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7841561 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773036.984635:0:6462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1790773036.984639:0:6462:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ec60e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+4:6473:x1877761495943808:12345-0@lo:104: Request processed in 33us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773036.984643:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790773036.984653:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790773036.984658:0:6462:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d24e836050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+3:6473:x1877761495943936:12345-0@lo:104: 00010000:00010000:3.0:1790773036.984665:0:6462:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc784153e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7841545 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773036.984686:0:6462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1790773036.984695:0:6462:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d24e836050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+3:6473:x1877761495943936:12345-0@lo:104: Request processed in 37us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773036.984700:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:3.0:1790773036.984733:0:6466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1790773036.984739:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2a00/0xabf1cc0bc784161e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7841625 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773036.984746:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a2a00 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:3.0:1790773036.984751:0:6466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2a00/0xabf1cc0bc784161e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc7841625 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773036.984760:0:6466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2a00/0xabf1cc0bc784161e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc7841625 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790773036.984766:0:6466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2a00/0xabf1cc0bc784161e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc7841625 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773036.984773:0:6466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790773036.984801:0:6466:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2a00/0xabf1cc0bc784161e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841625 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773036.984808:0:6466:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790773036.984823:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2a00/0xabf1cc0bc784161e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841625 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773036.984830:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2a00/0xabf1cc0bc784161e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841625 expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773036.984842:0:6466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1790773036.984845:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d27b12a800/0xabf1cc0bc78415a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc78415ae expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773036.984861:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12a800 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:3.0:1790773036.984864:0:6466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d27b12a800/0xabf1cc0bc78415a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc78415ae expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773036.984871:0:6466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d27b12a800/0xabf1cc0bc78415a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc78415ae expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790773036.984877:0:6466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d27b12a800/0xabf1cc0bc78415a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc78415ae expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773036.984883:0:6466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790773036.984896:0:6466:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d27b12a800/0xabf1cc0bc78415a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78415ae expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773036.985066:0:6467:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:2.0:1790773036.985128:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce0675b4-b0c5-48e7-b182-565e22fed04c:3605:1877761495944064:0@lo:103: 00000100:00100000:2.0:1790773036.985160:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790773036.985301:0:6466:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790773036.985319:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d27b12a800/0xabf1cc0bc78415a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78415ae expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773036.985326:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d27b12a800/0xabf1cc0bc78415a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78415ae expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773036.985335:0:6466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790773036.985339:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d2532e4e00/0xabf1cc0bc784155a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7841561 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773036.985346:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d2532e4e00 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:3.0:1790773036.985349:0:6466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d2532e4e00/0xabf1cc0bc784155a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc7841561 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773036.985366:0:6466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d2532e4e00/0xabf1cc0bc784155a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc7841561 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790773036.985373:0:6466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d2532e4e00/0xabf1cc0bc784155a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc7841561 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773036.985379:0:6466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790773036.985392:0:6466:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d2532e4e00/0xabf1cc0bc784155a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841561 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773036.985398:0:6466:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790773036.985402:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d2532e4e00/0xabf1cc0bc784155a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841561 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773036.985408:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d2532e4e00/0xabf1cc0bc784155a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841561 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773036.985418:0:6466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790773036.985421:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc784153e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7841545 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773036.985427:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a2000 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:3.0:1790773036.985430:0:6466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc784153e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc7841545 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773036.985437:0:6466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc784153e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc7841545 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790773036.985444:0:6466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc784153e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc7841545 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773036.985454:0:6466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790773036.985467:0:6466:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc784153e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841545 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773036.985473:0:6466:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790773036.985478:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc784153e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841545 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773036.985485:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc784153e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841545 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773036.985494:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773036.985496:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773036.985497:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773036.985517:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce0675b4-b0c5-48e7-b182-565e22fed04c:3604:1877761495944448:0@lo:103: 00000100:00100000:3.0:1790773036.985548:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce0675b4-b0c5-48e7-b182-565e22fed04c:3607:1877761495944320:0@lo:103: 00010000:00010000:3.0:1790773036.985743:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773036.985749:0:6467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d27b12a000/0xabf1cc0bc7841584 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc784158b expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773036.985755:0:6467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12a000 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:3.0:1790773036.985759:0:6467:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d27b12a000/0xabf1cc0bc7841584 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc784158b expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773036.985766:0:6467:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d27b12a000/0xabf1cc0bc7841584 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc784158b expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790773036.985773:0:6467:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d27b12a000/0xabf1cc0bc7841584 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc784158b expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773036.985784:0:6467:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790773036.985800:0:6467:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d27b12a000/0xabf1cc0bc7841584 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc784158b expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773036.985807:0:6467:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790773036.985814:0:6467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d27b12a000/0xabf1cc0bc7841584 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc784158b expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773036.985820:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d27b12a000/0xabf1cc0bc7841584 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc784158b expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773036.985833:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773036.985835:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773036.985836:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773036.985846:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773036.985847:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773036.985946:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce0675b4-b0c5-48e7-b182-565e22fed04c:3605:1877761495944576:0@lo:103: 00000100:00100000:2.0:1790773036.985970:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773036.988296:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce0675b4-b0c5-48e7-b182-565e22fed04c:3606:1877761495944192:0@lo:103: 00000100:00100000:3.0:1790773036.988403:0:6473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ec62680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6473:1877761495943424:0@lo:104: 00000100:00100000:3.0:1790773036.988414:0:6473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ec60000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6473:1877761495943552:0@lo:104: 00000100:00100000:3.0:1790773036.988422:0:6473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ec63b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6473:1877761495943680:0@lo:104: 00000100:00100000:3.0:1790773036.988429:0:6473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ec63480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6473:1877761495943808:0@lo:104: 00000100:00100000:3.0:1790773036.988437:0:6473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ec60700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6473:1877761495943936:0@lo:104: 00010000:00010000:3.0:1790773036.988467:0:6473:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93d241527800/0xabf1cc0bc78416a3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773036.990504:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773036.990600:0:6463:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495944064 00000100:00100000:0.0:1790773036.990610:0:6463:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495944064 00010000:00010000:0.0:1790773036.990650:0:6463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d27b12a400/0xabf1cc0bc7841625 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc784161e expref: 19 pid: 6472 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773036.990870:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773036.990975:0:6465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495944576 00000100:00100000:1.0:1790773036.990980:0:6465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495944576 00010000:00010000:1.0:1790773036.990999:0:6465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d27b12b800/0xabf1cc0bc784158b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7841584 expref: 20 pid: 6472 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773036.991020:0:6465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495944192 00000100:00100000:1.0:1790773036.991023:0:6465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495944192 00010000:00010000:1.0:1790773036.991036:0:6465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d27b12ac00/0xabf1cc0bc78415ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc78415a7 expref: 21 pid: 6473 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773036.991051:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790773036.991059:0:6465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ec62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:3605:x1877761495944064:12345-0@lo:103: 00010000:00010000:1.0:1790773036.991073:0:6465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790773036.991079:0:6465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d27b12a400/0xabf1cc0bc7841625 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc784161e expref: 21 pid: 6472 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773036.991090:0:6465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d27b12a400/0xabf1cc0bc7841625 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc784161e expref: 21 pid: 6472 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773036.991107:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d27b12a400/0xabf1cc0bc7841625 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc784161e expref: 21 pid: 6472 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773036.991121:0:6465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790773036.991172:0:6465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ec62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+20:3605:x1877761495944064:12345-0@lo:103: Request processed in 114us (6011us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773036.991189:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790773036.991461:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790773036.991470:0:6465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ec61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+19:3605:x1877761495944576:12345-0@lo:103: 00010000:00010000:1.0:1790773036.991480:0:6465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790773036.991484:0:6465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d27b12b800/0xabf1cc0bc784158b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7841584 expref: 19 pid: 6472 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773036.991494:0:6465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d27b12b800/0xabf1cc0bc784158b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc7841584 expref: 19 pid: 6472 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773036.991511:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d27b12b800/0xabf1cc0bc784158b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc7841584 expref: 19 pid: 6472 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773036.991521:0:6465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790773036.991547:0:6465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ec61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:3605:x1877761495944576:12345-0@lo:103: Request processed in 80us (5576us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773036.991553:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790773036.991567:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790773036.991573:0:6465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ec61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:3606:x1877761495944192:12345-0@lo:103: 00010000:00010000:1.0:1790773036.991581:0:6465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790773036.991585:0:6465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d27b12ac00/0xabf1cc0bc78415ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc78415a7 expref: 17 pid: 6473 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773036.991593:0:6465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d27b12ac00/0xabf1cc0bc78415ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc78415a7 expref: 17 pid: 6473 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773036.991603:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d27b12ac00/0xabf1cc0bc78415ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc78415a7 expref: 17 pid: 6473 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773036.991613:0:6465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790773036.991639:0:6465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ec61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:3606:x1877761495944192:12345-0@lo:103: Request processed in 67us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773036.991646:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790773036.991820:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773036.991880:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce0675b4-b0c5-48e7-b182-565e22fed04c:3606:1877761495944192:0@lo:103: 00000100:00100000:1.0:1790773036.992037:0:6465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495944320 00000100:00100000:1.0:1790773036.992042:0:6465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495944320 00010000:00010000:1.0:1790773036.992055:0:6465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d2532e5c00/0xabf1cc0bc7841561 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc784155a expref: 16 pid: 6473 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773036.992067:0:6465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495944448 00000100:00100000:1.0:1790773036.992074:0:6465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495944448 00010000:00010000:1.0:1790773036.992083:0:6465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d26c4a3600/0xabf1cc0bc7841545 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc784153e expref: 17 pid: 6472 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773036.992094:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790773036.992099:0:6465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ec60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:3607:x1877761495944320:12345-0@lo:103: 00010000:00010000:1.0:1790773036.992107:0:6465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790773036.992111:0:6465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d2532e5c00/0xabf1cc0bc7841561 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc784155a expref: 17 pid: 6473 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773036.992118:0:6465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d2532e5c00/0xabf1cc0bc7841561 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc784155a expref: 17 pid: 6473 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773036.992128:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d2532e5c00/0xabf1cc0bc7841561 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc784155a expref: 17 pid: 6473 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773036.992136:0:6465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790773036.992239:0:6464:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1790773036.992248:0:6464:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1790773036.992408:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790773036.992416:0:6464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512c8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:3604:x1877761495944448:12345-0@lo:103: 00010000:00010000:3.0:1790773036.992424:0:6464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773036.992428:0:6464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d26c4a3600/0xabf1cc0bc7841545 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc784153e expref: 16 pid: 6472 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773036.992438:0:6464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d26c4a3600/0xabf1cc0bc7841545 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc784153e expref: 16 pid: 6472 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773036.992448:0:6464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d26c4a3600/0xabf1cc0bc7841545 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc784153e expref: 16 pid: 6472 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773036.992459:0:6464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93d241527800/0xabf1cc0bc78416a3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773036.992468:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d241527800/0xabf1cc0bc78416a3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773036.992483:0:6464:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d241527800/0xabf1cc0bc78416a3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773036.992491:0:6464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d241527800/0xabf1cc0bc78416a3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773036.992498:0:6464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93d241527800/0xabf1cc0bc78416a3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773036.992506:0:6464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93d241527800/0xabf1cc0bc78416a3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773036.992511:0:6464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d241527800 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:3.0:1790773036.992516:0:6464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93d241527800/0xabf1cc0bc78416a3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773036.992530:0:6464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93d241527800/0xabf1cc0bc78416a3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773036.992544:0:6464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93d241527800/0xabf1cc0bc78416a3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773036.992553:0:6464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790773036.992692:0:6465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ec60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:3607:x1877761495944320:12345-0@lo:103: Request processed in 592us (1821us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773036.992699:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790773036.992860:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce0675b4-b0c5-48e7-b182-565e22fed04c:3607:1877761495944320:0@lo:103: 00000100:00100000:2.0:1790773036.992895:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce0675b4-b0c5-48e7-b182-565e22fed04c:3605:1877761495944576:0@lo:103: 00000100:00100000:2.0:1790773036.992916:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce0675b4-b0c5-48e7-b182-565e22fed04c:3605:1877761495944064:0@lo:103: 00010000:00010000:0.0:1790773036.993147:0:6473:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93d241527800/0xabf1cc0bc78416a3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773036.993158:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93d241527800/0xabf1cc0bc78416a3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773036.993164:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d241527800/0xabf1cc0bc78416a3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790773036.993190:0:6473:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1790773036.995559:0:6464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512c8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+14:3604:x1877761495944448:12345-0@lo:103: Request processed in 3134us (3729us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773036.995574:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790773036.995690:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce0675b4-b0c5-48e7-b182-565e22fed04c:3604:1877761495944448:0@lo:103: 00000100:00100000:0.0:1790773036.996069:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+13:8386:x1877761495943296:12345-0@lo:253: Request processed in 17658us (18270us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773036.996079:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790773036.996136:0:8386:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:8386:1877761495943296:0@lo:253: 10000000:01000000:1.0:1790773036.996149:0:8386:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1790773036.996152:0:8386:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790773036.996154:0:8386:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790773036.996155:0:8386:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790773036.996156:0:8386:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1790773036.996157:0:8386:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790773036.996159:0:8386:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790773036.996160:0:8386:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790773036.996161:0:8386:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1790773036.996163:0:8386:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790773036.996164:0:8386:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1790773036.996201:0:8386:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93d26ff80800 from lustre-OST0000 10000000:01000000:1.0:1790773036.996513:0:8386:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1790773036.996516:0:8386:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1790773036.996524:0:8386:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93d262660000 local copy 10000000:01000000:1.0:1790773036.996528:0:8386:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1790773036.996567:0:8386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12be00/0xabf1cc0bc78416aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773036.996578:0:8386:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.119@tcp lock: ffff93d27b12be00/0xabf1cc0bc78416aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773036.996588:0:8386:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d27b12be00/0xabf1cc0bc78416aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773036.996605:0:8386:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:8386:1877761495944704:0@lo:101: 00000100:00100000:1.0:1790773036.996642:0:8386:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773036.997007:0:8386:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d25146b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790773036.997122:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495944704 00000100:00100000:2.0:1790773036.997129:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495944704 00000100:00100000:2.0:1790773036.997174:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1790773036.997192:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+13:8386:x1877761495944704:12345-0@lo:101: 00010000:00010000:2.0:1790773036.997355:0:6472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773036.997368:0:6472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d241526a00/0xabf1cc0bc78416b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc78416aa expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773036.997391:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d241526a00/0xabf1cc0bc78416b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc78416aa expref: 14 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773036.997401:0:6472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d241526a00/0xabf1cc0bc78416b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78416aa expref: 14 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773036.997409:0:6472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d241526a00, rc 0) 00000100:00100000:2.0:1790773036.997454:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+14:8386:x1877761495944704:12345-0@lo:101: Request processed in 273us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773036.997461:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790773036.997534:0:8386:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:8386:1877761495944704:0@lo:101: 00010000:00010000:3.0:1790773036.997549:0:8386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d27b12be00/0xabf1cc0bc78416aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xabf1cc0bc78416b1 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773036.997557:0:8386:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d27b12be00/0xabf1cc0bc78416aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xabf1cc0bc78416b1 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773036.997656:0:8386:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447de300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:8386:1877761495944832:0@lo:501: 00000100:00100000:3.0:1790773036.997682:0:8386:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773036.997706:0:8386:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d246b25300 going to sleep for 11 seconds 00000100:00100000:0.0:1790773036.997744:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495944832 00000100:00100000:0.0:1790773036.997749:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495944832 00000100:00100000:0.0:1790773036.997779:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1790773036.997785:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+14:8386:x1877761495944832:12345-0@lo:501: 00000100:00100000:0.0:1790773036.997856:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+14:8386:x1877761495944832:12345-0@lo:501: Request processed in 71us (172us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790773036.997862:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790773036.998088:0:8386:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447de300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:8386:1877761495944832:0@lo:501: 10000000:01000000:3.0:1790773036.998101:0:8386:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.119@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1790773036.998116:0:8386:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.119@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1790773036.998121:0:8386:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12be00/0xabf1cc0bc78416aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xabf1cc0bc78416b1 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773036.998129:0:8386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12be00/0xabf1cc0bc78416aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xabf1cc0bc78416b1 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773036.998144:0:8386:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffff93d27b12be00/0xabf1cc0bc78416aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xabf1cc0bc78416b1 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773036.998166:0:8386:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1790773036.998362:0:8386:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93d26ff80800 10000000:01000000:3.0:1790773036.998369:0:8386:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790773036.998374:0:8386:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1790773036.998377:0:8386:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790773036.998381:0:8386:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1790773036.998383:0:8386:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1790773036.998399:0:8386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d24166ea00/0xabf1cc0bc78416b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773036.998408:0:8386:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d24166ea00/0xabf1cc0bc78416b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773036.998416:0:8386:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d24166ea00/0xabf1cc0bc78416b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773036.998429:0:8386:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447de300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:8386:1877761495944960:0@lo:101: 00000100:00100000:3.0:1790773036.998457:0:8386:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773036.998478:0:8386:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d246b25f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790773036.998518:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495944960 00000100:00100000:2.0:1790773036.998523:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495944960 00000100:00100000:2.0:1790773036.998553:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1790773036.998560:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+14:8386:x1877761495944960:12345-0@lo:101: 00010000:00010000:2.0:1790773036.998569:0:6472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773036.998577:0:6472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d241527e00/0xabf1cc0bc78416bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc78416b8 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773036.998592:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d241527e00/0xabf1cc0bc78416bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc78416b8 expref: 15 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773036.998600:0:6472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d241527e00/0xabf1cc0bc78416bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78416b8 expref: 15 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773036.998606:0:6472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d241527e00, rc 0) 00000100:00100000:2.0:1790773036.998638:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:8386:x1877761495944960:12345-0@lo:101: Request processed in 78us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773036.998643:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00010000:0.0:1790773036.998708:0:6466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790773036.998713:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d27b12be00/0xabf1cc0bc78416aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xabf1cc0bc78416b1 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773036.998720:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12be00 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:0.0:1790773036.998724:0:6466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d27b12be00/0xabf1cc0bc78416aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xabf1cc0bc78416b1 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773036.998740:0:6466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d27b12be00/0xabf1cc0bc78416aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xabf1cc0bc78416b1 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790773036.998747:0:6466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d27b12be00/0xabf1cc0bc78416aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xabf1cc0bc78416b1 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790773036.998752:0:6466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790773036.998769:0:6466:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d27b12be00/0xabf1cc0bc78416aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xabf1cc0bc78416b1 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773036.998775:0:6466:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790773036.998796:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d27b12be00/0xabf1cc0bc78416aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xabf1cc0bc78416b1 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773036.998801:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d27b12be00/0xabf1cc0bc78416aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xabf1cc0bc78416b1 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773036.998812:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773036.998814:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773036.998815:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773036.998856:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790773036.998867:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ed6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce0675b4-b0c5-48e7-b182-565e22fed04c:3607:1877761495945088:0@lo:103: 00000100:00100000:2.0:1790773036.999070:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773036.999151:0:8386:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447de300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:8386:1877761495944960:0@lo:101: 00010000:00010000:3.0:1790773036.999162:0:8386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d24166ea00/0xabf1cc0bc78416b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78416bf expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773036.999171:0:8386:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d24166ea00/0xabf1cc0bc78416b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc78416bf expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773036.999490:0:8386:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447de300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:8386:1877761495945216:0@lo:501: 00000100:00100000:3.0:1790773036.999518:0:8386:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773036.999539:0:8386:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d246b25f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790773036.999581:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495945216 00000100:00100000:2.0:1790773036.999586:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495945216 00000100:00100000:2.0:1790773036.999622:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1790773036.999630:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:8386:x1877761495945216:12345-0@lo:501: 00000100:00100000:2.0:1790773036.999718:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:8386:x1877761495945216:12345-0@lo:501: Request processed in 89us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773036.999725:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1790773036.999784:0:8386:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447de300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:8386:1877761495945216:0@lo:501: 00000100:00100000:3.0:1790773036.999821:0:8386:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447de300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:8386:1877761495945344:0@lo:503: 00000100:00100000:3.0:1790773036.999854:0:8386:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773037.000019:0:8386:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d246b25f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790773037.000074:0:6465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495945088 00000100:00100000:0.0:1790773037.000078:0:6465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495945088 00000100:00100000:0.0:1790773037.000110:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790773037.000116:0:6465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ec63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:3607:x1877761495945088:12345-0@lo:103: 00010000:00010000:0.0:1790773037.000125:0:6465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773037.000137:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d241526a00/0xabf1cc0bc78416b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xabf1cc0bc78416aa expref: 15 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773037.000149:0:6465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790773037.000198:0:6465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ec63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+14:3607:x1877761495945088:12345-0@lo:103: Request processed in 82us (1127us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773037.000227:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790773037.000340:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ed6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce0675b4-b0c5-48e7-b182-565e22fed04c:3607:1877761495945088:0@lo:103: 00000100:00100000:2.0:1790773037.000548:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495945344 00000100:00100000:2.0:1790773037.000552:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495945344 00000100:00100000:2.0:1790773037.000583:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1790773037.000590:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+14:8386:x1877761495945344:12345-0@lo:503: 00000100:00100000:2.0:1790773037.000709:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+14:8386:x1877761495945344:12345-0@lo:503: Request processed in 119us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773037.000715:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1790773037.000816:0:8386:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447de300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:8386:1877761495945344:0@lo:503: 00000040:00080000:1.0:1790773037.001561:0:8386:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790773037.001639:0:8386:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:8386:1877761495945472:0@lo:502: 00000100:00100000:1.0:1790773037.001684:0:8386:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773037.001750:0:8386:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d25146b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790773037.001843:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495945472 00000100:00100000:3.0:1790773037.001850:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495945472 00000100:00100000:3.0:1790773037.001976:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1790773037.001984:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+14:8386:x1877761495945472:12345-0@lo:502: 00000100:00100000:3.0:1790773037.002163:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+14:8386:x1877761495945472:12345-0@lo:502: Request processed in 179us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773037.002169:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1790773037.002321:0:8386:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:8386:1877761495945472:0@lo:502: 00000040:00080000:0.0:1790773037.002528:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1790773037.002554:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1790773037.002565:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1790773037.002576:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1790773037.002599:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1790773037.002611:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1790773037.002630:0:8386:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ed69500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:8386:1877761495945600:0@lo:502: 00000100:00100000:0.0:1790773037.002661:0:8386:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773037.002889:0:8386:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279ed9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790773037.003063:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495945600 00000100:00100000:2.0:1790773037.003070:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495945600 00000100:00100000:2.0:1790773037.003098:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1790773037.003105:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+14:8386:x1877761495945600:12345-0@lo:502: 00000100:00100000:2.0:1790773037.003320:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+14:8386:x1877761495945600:12345-0@lo:502: Request processed in 215us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773037.003327:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1790773037.003460:0:8386:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ed69500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:8386:1877761495945600:0@lo:502: 00000040:00080000:0.0:1790773037.003509:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1790773037.003518:0:8386:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1790773037.004046:0:8411:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790773037.004054:0:8411:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1790773037.004060:0:8411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773037.004063:0:8411:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1790773037.004069:0:8411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790773037.004089:0:8411:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff93d141d819c0) 00000020:00000080:0.0:1790773037.004110:0:8411:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:0.0:1790773037.004118:0:8411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1790773037.004188:0:8411:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93d26ff80800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1790773037.004196:0:8411:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:0.0:1790773037.004283:0:8411:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xabf1cc0bc78416cd 00010000:00010000:2.0:1790773037.010451:0:8411:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:2.0:1790773037.010795:0:8411:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1790773037.015378:0:8411:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1790773037.015739:0:8411:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1790773037.020030:0:8411:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1790773037.021330:0:8411:0:(osd_compat.c:1354:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1790773037.026629:0:8411:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1790773037.028200:0:8411:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1790773037.028305:0:8411:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790773037.028312:0:8411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773037.028315:0:8411:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1790773037.028318:0:8411:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790773037.028323:0:8411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773037.028324:0:8411:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790773037.028327:0:8411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790773037.028329:0:8411:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1790773037.028356:0:8411:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790773037.028358:0:8411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773037.028359:0:8411:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:2.0:1790773037.028362:0:8411:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1790773037.028551:0:8386:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1790773037.028587:0:8386:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1790773037.028609:0:8386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d24166ea00/0xabf1cc0bc78416b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78416bf expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773037.028622:0:8386:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d24166ea00/0xabf1cc0bc78416b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78416bf expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773037.028631:0:8386:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d26ff80800 from 1 10000000:01000000:3.0:1790773037.028634:0:8386:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790773037.028674:0:8386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d24166f400/0xabf1cc0bc78416d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773037.028682:0:8386:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d24166f400/0xabf1cc0bc78416d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773037.028693:0:8386:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d24166f400/0xabf1cc0bc78416d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773037.028715:0:8386:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447df100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:8386:1877761495945728:0@lo:101: 00000100:00100000:3.0:1790773037.028778:0:8386:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773037.028812:0:8386:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d246b25c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790773037.029323:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495945728 00000100:00100000:2.0:1790773037.029331:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495945728 00000100:00100000:2.0:1790773037.029439:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790773037.029451:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+14:8386:x1877761495945728:12345-0@lo:101: 00010000:00010000:2.0:1790773037.029466:0:6473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773037.029478:0:6473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d241526400/0xabf1cc0bc78416db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc78416d4 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773037.029503:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d241526400/0xabf1cc0bc78416db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc78416d4 expref: 15 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773037.029514:0:6473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d241526400/0xabf1cc0bc78416db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78416d4 expref: 15 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773037.029530:0:6473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d241526400, rc 0) 00000100:00100000:2.0:1790773037.029585:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:8386:x1877761495945728:12345-0@lo:101: Request processed in 137us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773037.029592:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1790773037.030003:0:8386:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447df100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:8386:1877761495945728:0@lo:101: 00010000:00010000:1.0:1790773037.030021:0:8386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d24166f400/0xabf1cc0bc78416d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78416db expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773037.030030:0:8386:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d24166f400/0xabf1cc0bc78416d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc78416db expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773037.030120:0:8386:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:8386:1877761495945856:0@lo:501: 00000100:00100000:1.0:1790773037.030157:0:8386:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773037.032200:0:8386:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d25146b000 going to sleep for 11 seconds 00000100:00100000:3.0:1790773037.032403:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495945856 00000100:00100000:3.0:1790773037.032413:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495945856 00000100:00100000:3.0:1790773037.032457:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1790773037.032466:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c696050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:8386:x1877761495945856:12345-0@lo:501: 00000100:00100000:3.0:1790773037.032611:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c696050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:8386:x1877761495945856:12345-0@lo:501: Request processed in 147us (2454us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773037.032618:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1790773037.032722:0:8386:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:8386:1877761495945856:0@lo:501: 00000100:00100000:1.0:1790773037.032766:0:8386:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:8386:1877761495945984:0@lo:503: 00000100:00100000:1.0:1790773037.032807:0:8386:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773037.032831:0:8386:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d25146b000 going to sleep for 11 seconds 00000100:00100000:3.0:1790773037.032888:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495945984 00000100:00100000:3.0:1790773037.032892:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495945984 00000100:00100000:3.0:1790773037.032971:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1790773037.032977:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c696850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:8386:x1877761495945984:12345-0@lo:503: 00000100:00100000:3.0:1790773037.033095:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c696850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:8386:x1877761495945984:12345-0@lo:503: Request processed in 118us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773037.033102:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1790773037.034052:0:8386:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:8386:1877761495945984:0@lo:503: 00000040:00080000:1.0:1790773037.034425:0:8386:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790773037.034505:0:8386:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:8386:1877761495946112:0@lo:502: 00000100:00100000:1.0:1790773037.034550:0:8386:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773037.036025:0:8386:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d25146b000 going to sleep for 11 seconds 00000100:00100000:3.0:1790773037.039763:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495946112 00000100:00100000:3.0:1790773037.039779:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495946112 00000100:00100000:3.0:1790773037.040998:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1790773037.041022:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c694c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:8386:x1877761495946112:12345-0@lo:502: 00000100:00100000:3.0:1790773037.041242:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c694c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:8386:x1877761495946112:12345-0@lo:502: Request processed in 223us (6690us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773037.041251:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1790773037.041366:0:8386:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:8386:1877761495946112:0@lo:502: 00000040:00080000:0.0:1790773037.041613:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1790773037.041652:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1790773037.041687:0:8386:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ed69500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:8386:1877761495946240:0@lo:502: 00000100:00100000:0.0:1790773037.041730:0:8386:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773037.042384:0:8386:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d141fd2900 going to sleep for 11 seconds 00000100:00100000:1.0:1790773037.042472:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495946240 00000100:00100000:1.0:1790773037.042479:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495946240 00000100:00100000:1.0:1790773037.042517:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1790773037.042527:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c695450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:8386:x1877761495946240:12345-0@lo:502: 00000100:00100000:1.0:1790773037.042637:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c695450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:8386:x1877761495946240:12345-0@lo:502: Request processed in 112us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773037.042645:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1790773037.042738:0:8386:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ed69500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:8386:1877761495946240:0@lo:502: 00000040:00080000:0.0:1790773037.042784:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1790773037.042794:0:8386:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1790773037.043589:0:8415:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790773037.043600:0:8415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773037.043602:0:8415:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1790773037.043609:0:8415:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93d26ff80800 00000020:00000080:0.0:1790773037.043612:0:8415:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790773037.043622:0:8415:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790773037.043625:0:8415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773037.043626:0:8415:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1790773037.043628:0:8415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1790773037.043767:0:8386:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1790773037.043791:0:8386:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790773037.043840:0:8386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d24166f400/0xabf1cc0bc78416d4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78416db expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773037.043852:0:8386:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d24166f400/0xabf1cc0bc78416d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78416db expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790773037.044002:0:8386:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1790773037.044011:0:8386:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93d26ff80800 10000000:01000000:1.0:1790773037.044014:0:8386:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93d26ff80800 10000000:01000000:1.0:1790773037.044018:0:8386:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790773037.044024:0:8386:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93d26ff80800 from 1 10000000:01000000:1.0:1790773037.044026:0:8386:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790773037.044053:0:8386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12ac00/0xabf1cc0bc78416e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773037.044061:0:8386:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d27b12ac00/0xabf1cc0bc78416e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773037.044071:0:8386:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d27b12ac00/0xabf1cc0bc78416e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773037.044087:0:8386:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:8386:1877761495946368:0@lo:101: 00000100:00100000:1.0:1790773037.044132:0:8386:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773037.044332:0:8386:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d25146b180 going to sleep for 11 seconds 00000100:00100000:3.0:1790773037.044466:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495946368 00000100:00100000:3.0:1790773037.044473:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495946368 00000100:00100000:3.0:1790773037.044518:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1790773037.044527:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c697850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:8386:x1877761495946368:12345-0@lo:101: 00010000:00010000:3.0:1790773037.044538:0:6473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773037.044550:0:6473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d24166fc00/0xabf1cc0bc78416e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc78416e2 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773037.044573:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d24166fc00/0xabf1cc0bc78416e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc78416e2 expref: 16 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773037.044584:0:6473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d24166fc00/0xabf1cc0bc78416e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78416e2 expref: 16 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773037.044592:0:6473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d24166fc00, rc 0) 00000100:00100000:3.0:1790773037.044631:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c697850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:8386:x1877761495946368:12345-0@lo:101: Request processed in 105us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773037.044638:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1790773037.044738:0:8386:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:8386:1877761495946368:0@lo:101: 00010000:00010000:1.0:1790773037.044751:0:8386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d27b12ac00/0xabf1cc0bc78416e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78416e9 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773037.044759:0:8386:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d27b12ac00/0xabf1cc0bc78416e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc78416e9 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773037.044827:0:8386:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:8386:1877761495946496:0@lo:501: 00000100:00100000:1.0:1790773037.044852:0:8386:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773037.044890:0:8386:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d25146b180 going to sleep for 11 seconds 00000100:00100000:2.0:1790773037.044976:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495946496 00000100:00100000:2.0:1790773037.044980:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495946496 00000100:00100000:2.0:1790773037.045009:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1790773037.045016:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c696c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:8386:x1877761495946496:12345-0@lo:501: 00000100:00100000:2.0:1790773037.045106:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c696c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:8386:x1877761495946496:12345-0@lo:501: Request processed in 90us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773037.045113:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1790773037.045320:0:8386:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:8386:1877761495946496:0@lo:501: 00000100:00100000:1.0:1790773037.045359:0:8386:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:8386:1877761495946624:0@lo:503: 00000100:00100000:1.0:1790773037.045396:0:8386:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773037.045411:0:8386:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d25146b180 going to sleep for 11 seconds 00000100:00100000:2.0:1790773037.045476:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495946624 00000100:00100000:2.0:1790773037.045480:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495946624 00000100:00100000:2.0:1790773037.045511:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1790773037.045517:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c694850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:8386:x1877761495946624:12345-0@lo:503: 00000100:00100000:2.0:1790773037.045588:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c694850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:8386:x1877761495946624:12345-0@lo:503: Request processed in 71us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773037.045594:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1790773037.045699:0:8386:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:8386:1877761495946624:0@lo:503: 00000040:00080000:1.0:1790773037.046033:0:8386:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790773037.046101:0:8386:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:8386:1877761495946752:0@lo:502: 00000100:00100000:1.0:1790773037.046135:0:8386:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773037.046160:0:8386:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d25146b180 going to sleep for 11 seconds 00000100:00100000:3.0:1790773037.046293:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495946752 00000100:00100000:3.0:1790773037.046297:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495946752 00000100:00100000:3.0:1790773037.046324:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1790773037.046331:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c694050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:8386:x1877761495946752:12345-0@lo:502: 00000100:00100000:3.0:1790773037.047154:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c694050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:8386:x1877761495946752:12345-0@lo:502: Request processed in 820us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773037.047174:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1790773037.047503:0:8386:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:8386:1877761495946752:0@lo:502: 00000040:00080000:1.0:1790773037.047722:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1790773037.047750:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1790773037.047763:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1790773037.047778:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1790773037.047790:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1790773037.047801:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1790773037.047813:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1790773037.047825:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1790773037.047839:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1790773037.047851:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1790773037.047866:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1790773037.048025:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1790773037.048043:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1790773037.048057:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1790773037.048069:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1790773037.048083:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1790773037.048097:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1790773037.048112:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1790773037.048125:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1790773037.048139:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1790773037.048154:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1790773037.048166:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1790773037.048201:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1790773037.048458:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1790773037.048469:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1790773037.048480:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1790773037.048492:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1790773037.048515:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1790773037.048528:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1790773037.048538:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1790773037.048548:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1790773037.048560:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1790773037.048571:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1790773037.048582:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1790773037.048593:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1790773037.048603:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1790773037.048614:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:1.0:1790773037.048649:0:8386:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:8386:1877761495946880:0@lo:502: 00000100:00100000:1.0:1790773037.048708:0:8386:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773037.048787:0:8386:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d25146b180 going to sleep for 11 seconds 00000100:00100000:3.0:1790773037.048837:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495946880 00000100:00100000:3.0:1790773037.048845:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495946880 00000100:00100000:3.0:1790773037.049052:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1790773037.049062:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c696450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:8386:x1877761495946880:12345-0@lo:502: 00000100:00100000:3.0:1790773037.049174:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c696450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:8386:x1877761495946880:12345-0@lo:502: Request processed in 114us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773037.049191:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1790773037.049713:0:8386:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:8386:1877761495946880:0@lo:502: 00000040:00080000:0.0:1790773037.049775:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1790773037.049785:0:8386:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1790773037.050485:0:8416:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1790773037.050502:0:8416:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff93d26ec23380) 00000020:00000080:1.0:1790773037.050522:0:8416:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1790773037.050613:0:8416:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93d26ff80800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1790773037.050617:0:8416:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93d26ff80800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1790773037.050620:0:8416:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93d26ff80800 3 00010000:00080000:1.0:1790773037.050660:0:8416:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d14241a800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.119@tcp at head 00010000:00010000:1.0:1790773037.052796:0:8416:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:1.0:1790773037.053125:0:8416:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1790773037.053164:0:8416:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1790773037.053176:0:8416:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xabf1cc0bc78416f7 00000100:00080000:1.0:1790773037.053196:0:8416:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790773037.053350:0:8416:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d14241a800 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:1.0:1790773037.053394:0:8416:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d25074ce00 x1877761495947008/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790773037.053413:0:8416:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1790773037.053687:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3603:1877761495947008:0@lo:38: 00000100:00100000:3.0:1790773037.053764:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773037.053826:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ed69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3607:1877761495947136:0@lo:400: 00000100:00100000:3.0:1790773037.053852:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773037.053891:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790773037.053897:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ed69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877761495947520:0@lo:400: 00000100:00100000:3.0:1790773037.054038:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773037.054071:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495947008 00000100:00100000:3.0:1790773037.054078:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495947008 00000100:00100000:3.0:1790773037.054103:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495947136 00000100:00100000:3.0:1790773037.054106:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495947136 00000100:00100000:3.0:1790773037.054126:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495947520 00000100:00100000:3.0:1790773037.054129:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495947520 00000100:00100000:3.0:1790773037.054143:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790773037.054151:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1877761495947136:12345-0@lo:400: 00000100:00100000:3.0:1790773037.054314:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1877761495947136:12345-0@lo:400: Request processed in 162us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773037.054323:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790773037.054338:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790773037.054353:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877761495947520:12345-0@lo:400: 00000100:00100000:3.0:1790773037.054384:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877761495947520:12345-0@lo:400: Request processed in 32us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773037.054390:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790773037.054401:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790773037.054404:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3603:x1877761495947008:12345-0@lo:38: 00010000:00080000:3.0:1790773037.054425:0:6478:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 179 last 0 00000020:00000080:3.0:1790773037.054461:0:6478:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xabf1cc0bc78416fe 00000004:00100000:3.0:1790773037.054477:0:6478:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1790773037.054510:0:6478:0:(import.c:65:import_set_state_nolock()) ffff93d27b289800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790773037.054545:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3603:x1877761495947008:12345-0@lo:38: Request processed in 139us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773037.054551:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1790773037.054580:0:3603:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d25074ce00 x1877761495947008/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790773047 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773037.054588:0:3603:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790773037.054595:0:3603:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1790773037.054601:0:3603:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1790773037.054605:0:3603:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1790773037.054607:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d14241a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1790773037.054612:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3603:1877761495947008:0@lo:38: 00010000:00080000:3.0:1790773037.054638:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d26ed69c00 x1877761495947520/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773037.054647:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ed69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877761495947520:0@lo:400: 00010000:00080000:3.0:1790773037.054655:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d26ed69500 x1877761495947136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773037.054670:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ed69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3607:1877761495947136:0@lo:400: 00000020:01000004:3.0:1790773037.056043:0:8416:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1790773037.056059:0:8416:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff93d27b2c4d40) 00000020:00000080:3.0:1790773037.056094:0:8416:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:3.0:1790773037.056174:0:8416:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93d26ff80800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1790773037.056189:0:8416:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93d26ff80800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1790773037.056192:0:8416:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93d26ff80800 3 00010000:00080000:3.0:1790773037.056255:0:8416:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d142526000@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.119@tcp at head 00010000:00010000:3.0:1790773037.059849:0:8416:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000100:00100000:2.0:1790773037.060541:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ed68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761495947264:0@lo:400: 00000100:00100000:2.0:1790773037.060616:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773037.060658:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790773037.060665:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ed6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761495947392:0@lo:400: 00000100:00100000:2.0:1790773037.060685:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773037.060722:0:6483:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495947264 00000100:00100000:2.0:1790773037.060729:0:6483:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495947264 00000100:00100000:2.0:1790773037.060765:0:6483:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495947392 00000100:00100000:2.0:1790773037.060773:0:6483:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495947392 00000100:00100000:2.0:1790773037.060790:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790773037.060797:0:6483:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ec63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761495947264:12345-0@lo:400: 00000100:00100000:2.0:1790773037.060854:0:6483:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ec63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761495947264:12345-0@lo:400: Request processed in 57us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773037.060862:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790773037.060878:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790773037.060884:0:6483:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ec60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761495947392:12345-0@lo:400: 00000020:00000080:3.0:1790773037.061153:0:8416:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000100:00100000:2.0:1790773037.061368:0:6483:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ec60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761495947392:12345-0@lo:400: Request processed in 484us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773037.061375:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790773037.061435:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ed6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761495947392:0@lo:400: 00000100:00100000:2.0:1790773037.061447:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ed68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761495947264:0@lo:400: 00000010:01000000:3.0:1790773037.062925:0:8416:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790773037.062941:0:8416:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xabf1cc0bc784170c 00000100:00080000:3.0:1790773037.062950:0:8416:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790773037.062960:0:8416:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff93d142526000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:3.0:1790773037.062992:0:8416:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d2447df100 x1877761495947648/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790773037.063021:0:8416:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1790773037.063339:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3603:1877761495947648:0@lo:38: 00000100:00100000:1.0:1790773037.063403:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773037.063559:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495947648 00000100:00100000:3.0:1790773037.063567:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495947648 00000100:00100000:3.0:1790773037.063614:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790773037.063621:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3603:x1877761495947648:12345-0@lo:38: 00010000:00080000:3.0:1790773037.063647:0:6478:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 179 last 0 00000020:00000080:3.0:1790773037.063675:0:6478:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xabf1cc0bc7841713 00000004:00100000:3.0:1790773037.063689:0:6478:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1790773037.063716:0:6478:0:(import.c:65:import_set_state_nolock()) ffff93d142527000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790773037.063769:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3603:x1877761495947648:12345-0@lo:38: Request processed in 147us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773037.063782:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1790773037.063823:0:3603:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d2447df100 x1877761495947648/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790773047 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773037.063833:0:3603:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790773037.063841:0:3603:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1790773037.063849:0:3603:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1790773037.063853:0:3603:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1790773037.063855:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d142526000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1790773037.063861:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3603:1877761495947648:0@lo:38: 00000040:00080000:3.0:1790773037.064153:0:8416:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1790773037.064392:0:8386:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1790773037.064420:0:8386:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790773037.064440:0:8386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12ac00/0xabf1cc0bc78416e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78416e9 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773037.064452:0:8386:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d27b12ac00/0xabf1cc0bc78416e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78416e9 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1790773037.064494:0:8386:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1790773037.064497:0:8386:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790773037.064498:0:8386:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790773037.064499:0:8386:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790773037.064500:0:8386:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790773037.064502:0:8386:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790773037.064503:0:8386:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790773037.064505:0:8386:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790773037.064506:0:8386:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790773037.064508:0:8386:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790773037.064509:0:8386:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790773037.064513:0:8386:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1790773037.064516:0:8386:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790773037.064517:0:8386:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790773037.064518:0:8386:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790773037.064519:0:8386:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790773037.064520:0:8386:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790773037.064521:0:8386:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790773037.064523:0:8386:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790773037.064523:0:8386:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790773037.064524:0:8386:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790773037.064531:0:8386:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790773037.064532:0:8386:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790773037.064548:0:8386:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1790773037.064559:0:8386:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:8386:1877761495947776:0@lo:253: 00000100:00100000:1.0:1790773037.064602:0:8386:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773037.064632:0:8386:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d25146bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1790773037.064733:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495947776 00000100:00100000:2.0:1790773037.064739:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495947776 00000100:00100000:2.0:1790773037.064838:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1790773037.064848:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c695c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:8386:x1877761495947776:12345-0@lo:253: 20000000:01000000:2.0:1790773037.064881:0:6472:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1790773037.064896:0:6472:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1790773037.077730:0:6472:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1790773037.077777:0:6472:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1790773037.078381:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c695c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:8386:x1877761495947776:12345-0@lo:253: Request processed in 13527us (13770us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773037.078396:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1790773037.078466:0:8386:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:8386:1877761495947776:0@lo:253: 10000000:01000000:3.0:1790773037.078481:0:8386:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1790773037.078485:0:8386:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790773037.078487:0:8386:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790773037.078488:0:8386:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790773037.078489:0:8386:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790773037.078491:0:8386:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790773037.078492:0:8386:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790773037.078493:0:8386:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790773037.078495:0:8386:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790773037.078497:0:8386:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790773037.078499:0:8386:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790773037.078500:0:8386:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1790773037.078517:0:8386:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1790773037.080313:0:6494:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1790773037.080323:0:6494:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1790773037.080348:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93d241527600/0xabf1cc0bc784171a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773037.080366:0:6494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d24166fe00/0xabf1cc0bc7841656 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc784164f expref: 15 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773037.080374:0:6494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d24166ee00/0xabf1cc0bc7841664 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc784165d expref: 15 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773037.080397:0:6494:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93d241527600/0xabf1cc0bc784171a lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773037.080436:0:6494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d24166ee00/0xabf1cc0bc7841664 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc784165d expref: 15 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773037.080451:0:6494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d24166ee00/0xabf1cc0bc7841664 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc784165d expref: 15 pid: 6473 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773037.080464:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ec62680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6494:1877761495947904:0@lo:104: 00000100:00100000:2.0:1790773037.080516:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790773037.080567:0:6494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d24166fe00/0xabf1cc0bc7841656 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc784164f expref: 15 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773037.080575:0:6494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d24166fe00/0xabf1cc0bc7841656 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc784164f expref: 15 pid: 6472 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773037.080583:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ec61180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6494:1877761495948032:0@lo:104: 00000100:00100000:2.0:1790773037.080604:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773037.080625:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d243301840 going to sleep for 11 seconds 00000100:00100000:2.0:1790773037.080652:0:6461:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495947904 00000100:00100000:2.0:1790773037.080659:0:6461:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495947904 00000100:00100000:2.0:1790773037.080690:0:6461:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495948032 00000100:00100000:2.0:1790773037.080692:0:6461:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495948032 00000100:00100000:2.0:1790773037.080703:0:6461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790773037.080711:0:6461:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ec63100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce0675b4-b0c5-48e7-b182-565e22fed04c+4:6494:x1877761495947904:12345-0@lo:104: 00010000:00010000:2.0:1790773037.080722:0:6461:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d241527400/0xabf1cc0bc784165d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7841664 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773037.080774:0:6461:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790773037.080779:0:6461:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ec63100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce0675b4-b0c5-48e7-b182-565e22fed04c+4:6494:x1877761495947904:12345-0@lo:104: Request processed in 69us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773037.080785:0:6461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790773037.080801:0:6461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790773037.080806:0:6461:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ec61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce0675b4-b0c5-48e7-b182-565e22fed04c+3:6494:x1877761495948032:12345-0@lo:104: 00010000:00010000:2.0:1790773037.080814:0:6461:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d27b12bc00/0xabf1cc0bc784164f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7841656 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773037.080848:0:6461:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790773037.080853:0:6461:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ec61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce0675b4-b0c5-48e7-b182-565e22fed04c+3:6494:x1877761495948032:12345-0@lo:104: Request processed in 47us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773037.080859:0:6461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:2.0:1790773037.080886:0:6467:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790773037.080891:0:6467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d241527400/0xabf1cc0bc784165d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7841664 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773037.081294:0:6467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d241527400 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:2.0:1790773037.081301:0:6467:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d241527400/0xabf1cc0bc784165d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc7841664 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773037.081310:0:6467:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d241527400/0xabf1cc0bc784165d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc7841664 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790773037.081317:0:6467:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d241527400/0xabf1cc0bc784165d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc7841664 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790773037.081324:0:6467:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790773037.081359:0:6467:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d241527400/0xabf1cc0bc784165d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841664 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773037.081366:0:6467:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790773037.081382:0:6467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d241527400/0xabf1cc0bc784165d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841664 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773037.081389:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d241527400/0xabf1cc0bc784165d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841664 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773037.081403:0:6467:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790773037.081406:0:6467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d27b12bc00/0xabf1cc0bc784164f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7841656 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773037.081412:0:6467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12bc00 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:2.0:1790773037.081415:0:6467:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d27b12bc00/0xabf1cc0bc784164f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc7841656 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773037.081421:0:6467:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d27b12bc00/0xabf1cc0bc784164f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc7841656 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790773037.081427:0:6467:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d27b12bc00/0xabf1cc0bc784164f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc7841656 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790773037.081432:0:6467:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790773037.081445:0:6467:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d27b12bc00/0xabf1cc0bc784164f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841656 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773037.081451:0:6467:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790773037.081462:0:6467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d27b12bc00/0xabf1cc0bc784164f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841656 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773037.081479:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d27b12bc00/0xabf1cc0bc784164f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841656 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773037.081491:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773037.081492:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773037.081494:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773037.081502:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790773037.081514:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ec60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce0675b4-b0c5-48e7-b182-565e22fed04c:3606:1877761495948160:0@lo:103: 00000100:00100000:2.0:1790773037.081546:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773037.081578:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ec62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce0675b4-b0c5-48e7-b182-565e22fed04c:3604:1877761495948288:0@lo:103: 00000100:00100000:2.0:1790773037.081600:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773037.081631:0:8410:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495948160 00000100:00100000:2.0:1790773037.081635:0:8410:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495948160 00010000:00010000:2.0:1790773037.081652:0:8410:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d24166ee00/0xabf1cc0bc7841664 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc784165d expref: 16 pid: 6473 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773037.081672:0:8410:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495948288 00000100:00100000:2.0:1790773037.081675:0:8410:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495948288 00010000:00010000:2.0:1790773037.081684:0:8410:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d24166fe00/0xabf1cc0bc7841656 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc784164f expref: 17 pid: 6472 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773037.081698:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790773037.081703:0:8410:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ec61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:3606:x1877761495948160:12345-0@lo:103: 00010000:00010000:2.0:1790773037.081713:0:8410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790773037.081717:0:8410:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d24166ee00/0xabf1cc0bc7841664 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc784165d expref: 17 pid: 6473 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773037.081726:0:8410:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d24166ee00/0xabf1cc0bc7841664 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc784165d expref: 17 pid: 6473 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773037.081745:0:8410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790773037.081769:0:8410:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ec61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:3606:x1877761495948160:12345-0@lo:103: Request processed in 66us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773037.081775:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790773037.081789:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790773037.081793:0:8410:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ec61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:3604:x1877761495948288:12345-0@lo:103: 00010000:00010000:2.0:1790773037.081800:0:8410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790773037.081803:0:8410:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d24166fe00/0xabf1cc0bc7841656 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc784164f expref: 16 pid: 6472 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773037.081810:0:8410:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d24166fe00/0xabf1cc0bc7841656 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc784164f expref: 16 pid: 6472 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773037.081820:0:8410:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93d241527600/0xabf1cc0bc784171a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773037.081828:0:8410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d241527600/0xabf1cc0bc784171a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790773037.081840:0:8410:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005490034s 00010000:00010000:2.0:1790773037.081845:0:8410:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d241527600/0xabf1cc0bc784171a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773037.081853:0:8410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d241527600/0xabf1cc0bc784171a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773037.081860:0:8410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93d241527600/0xabf1cc0bc784171a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773037.081867:0:8410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93d241527600/0xabf1cc0bc784171a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773037.081890:0:8410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d241527600 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:2.0:1790773037.081894:0:8410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93d241527600/0xabf1cc0bc784171a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773037.082351:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d24166ee00/0xabf1cc0bc7841664 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc784165d expref: 16 pid: 6473 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773037.082366:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ec62680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6494:1877761495947904:0@lo:104: 00010000:00010000:1.0:1790773037.082378:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d24166fe00/0xabf1cc0bc7841656 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc784164f expref: 15 pid: 6472 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773037.082387:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ec61180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6494:1877761495948032:0@lo:104: 00010000:00010000:1.0:1790773037.082404:0:6494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93d241527600/0xabf1cc0bc784171a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773037.082414:0:6494:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff93d241527600/0xabf1cc0bc784171a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773037.082420:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93d241527600/0xabf1cc0bc784171a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773037.082990:0:8410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93d241527600/0xabf1cc0bc784171a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773037.083001:0:8410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93d241527600/0xabf1cc0bc784171a lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773037.083009:0:8410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d241527600/0xabf1cc0bc784171a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773037.083024:0:8410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790773037.083076:0:8410:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ec61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ce0675b4-b0c5-48e7-b182-565e22fed04c+14:3604:x1877761495948288:12345-0@lo:103: Request processed in 1281us (1475us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773037.083084:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790773037.083127:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ec62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce0675b4-b0c5-48e7-b182-565e22fed04c:3604:1877761495948288:0@lo:103: 00000100:00100000:2.0:1790773037.083148:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ec60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce0675b4-b0c5-48e7-b182-565e22fed04c:3606:1877761495948160:0@lo:103: 00010000:00010000:2.0:1790773037.084006:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1790773037.086668:0:8386:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1790773037.086865:0:8386:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1790773037.089067:0:8386:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1790773037.089572:0:8386:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1790773037.089805:0:8386:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1790773037.091613:0:8386:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1790773037.102651:0:8386:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1790773037.121046:0:8386:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1790773037.121056:0:8386:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1790773037.121098:0:8386:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790773037.121141:0:8386:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.119@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790773037.121162:0:8386:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1790773037.121189:0:8386:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1790773037.122473:0:8386:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790773037.122664:0:8386:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1790773037.901557:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1790773038.125794:0:8472:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790773038.126021:0:8472:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1790773038.930409:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773039.439933:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761495948416:0@lo:41: 00000100:00100000:3.0:1790773039.440015:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773039.440231:0:6483:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495948416 00000100:00100000:1.0:1790773039.440240:0:6483:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495948416 00000100:00100000:1.0:1790773039.440306:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790773039.440316:0:6483:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761495948416:12345-0@lo:41: 00000004:00000024:1.0:1790773039.440352:0:6483:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1790773039.440423:0:6483:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761495948416:12345-0@lo:41: Request processed in 108us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773039.440430:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790773039.440480:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761495948416:0@lo:41: 00000100:00100000:3.0:1790773039.440731:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ed6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761495948544:0@lo:41: 00000100:00100000:3.0:1790773039.440773:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773039.440899:0:6484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495948544 00000100:00100000:0.0:1790773039.440904:0:6484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495948544 00000100:00100000:0.0:1790773039.440941:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790773039.440948:0:6484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761495948544:12345-0@lo:41: 00000004:00000024:0.0:1790773039.440967:0:6484:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:0.0:1790773039.441007:0:6484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761495948544:12345-0@lo:41: Request processed in 60us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773039.441014:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790773039.441045:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ed6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761495948544:0@lo:41: 00010000:00010000:2.0:1790773039.949910:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773040.980601:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773041.997553:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773042.511240:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce0675b4-b0c5-48e7-b182-565e22fed04c:3607:1877761495948672:0@lo:400: 00000100:00100000:0.0:1790773042.511317:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773042.511482:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790773042.511489:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761495949056:0@lo:400: 00000100:00100000:0.0:1790773042.511521:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773042.511555:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495948672 00000100:00100000:0.0:1790773042.511562:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495948672 00000100:00100000:0.0:1790773042.511610:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1790773042.511620:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c695050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+14:3607:x1877761495948672:12345-0@lo:400: 00000100:00100000:0.0:1790773042.511684:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c695050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+14:3607:x1877761495948672:12345-0@lo:400: Request processed in 65us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773042.511692:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1790773042.511727:0:7666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495949056 00000100:00100000:0.0:1790773042.511731:0:7666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495949056 00000100:00100000:0.0:1790773042.511755:0:7666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790773042.511762:0:7666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ed6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761495949056:12345-0@lo:400: 00000100:00100000:0.0:1790773042.511798:0:7666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ed6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761495949056:12345-0@lo:400: Request processed in 37us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773042.511805:0:7666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790773042.511836:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3604:1877761495948800:0@lo:400: 00000100:00100000:0.0:1790773042.511864:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773042.511884:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790773042.511890:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761495948928:0@lo:400: 00000100:00100000:0.0:1790773042.511911:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773042.511941:0:6483:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495948928 00000100:00100000:0.0:1790773042.511944:0:6483:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495948928 00000100:00100000:0.0:1790773042.511975:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790773042.511981:0:6483:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ed68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761495948928:12345-0@lo:400: 00000100:00100000:0.0:1790773042.512013:0:6483:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ed68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761495948928:12345-0@lo:400: Request processed in 33us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773042.512019:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790773042.512054:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761495948928:0@lo:400: 00000100:00100000:0.0:1790773042.512092:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495948800 00000100:00100000:0.0:1790773042.512095:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495948800 00000100:00100000:0.0:1790773042.512123:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790773042.512141:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ed69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3604:x1877761495948800:12345-0@lo:400: 00000100:00100000:0.0:1790773042.512172:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ed69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3604:x1877761495948800:12345-0@lo:400: Request processed in 44us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773042.512178:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790773042.512226:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3604:1877761495949312:0@lo:400: 00000100:00100000:1.0:1790773042.512236:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790773042.512246:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3606:1877761495949184:0@lo:400: 00000100:00100000:0.0:1790773042.512252:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773042.512275:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1790773042.512276:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d25074e300 x1877761495948800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773042.512287:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3604:1877761495948800:0@lo:400: 00000100:00100000:0.0:1790773042.512297:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790773042.512301:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495949312 00000100:00100000:0.0:1790773042.512302:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3604:1877761495949440:0@lo:400: 00000100:00100000:1.0:1790773042.512304:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495949312 00000100:00100000:0.0:1790773042.512325:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773042.512336:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495949184 00000100:00100000:1.0:1790773042.512339:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495949184 00000100:00100000:0.0:1790773042.512345:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495949440 00000100:00100000:0.0:1790773042.512348:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495949440 00000100:00100000:1.0:1790773042.512351:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790773042.512356:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ed6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3604:x1877761495949312:12345-0@lo:400: 00000100:00100000:0.0:1790773042.512363:0:6478:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1790773042.512369:0:6478:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1790773042.512391:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ed6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3604:x1877761495949312:12345-0@lo:400: Request processed in 33us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773042.512464:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790773042.512471:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1877761495949184:12345-0@lo:400: 00000100:00100000:0.0:1790773042.512514:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1877761495949184:12345-0@lo:400: Request processed in 43us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773042.512520:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790773042.512535:0:6478:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1790773042.512542:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790773042.512547:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ed69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3604:x1877761495949440:12345-0@lo:400: 00000100:00100000:0.0:1790773042.512575:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ed69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3604:x1877761495949440:12345-0@lo:400: Request processed in 27us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773042.512580:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790773042.512682:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790773042.512757:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761495949056:0@lo:400: 00000100:00100000:3.0:1790773042.512767:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce0675b4-b0c5-48e7-b182-565e22fed04c:3607:1877761495948672:0@lo:400: 00010000:00080000:1.0:1790773042.512789:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d25074ed80 x1877761495949184/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773042.512800:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3606:1877761495949184:0@lo:400: 00000100:00080000:2.0:1790773042.512847:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790773042.512852:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1790773042.512895:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d25074df80 x1877761495949440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773042.512905:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3604:1877761495949440:0@lo:400: 00010000:00080000:1.0:1790773042.512916:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d25074fb80 x1877761495949312/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773042.512924:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3604:1877761495949312:0@lo:400: 00010000:00010000:2.0:1790773043.022956:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790773043.742145:0:8763:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg219-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1790773044.050594:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773044.558649:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790773044.558677:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ec60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761495949568:0@lo:41: 00000100:00100000:0.0:1790773044.558746:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773044.558820:0:6484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495949568 00000100:00100000:0.0:1790773044.558828:0:6484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495949568 00000100:00100000:0.0:1790773044.558873:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790773044.558883:0:6484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ed6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761495949568:12345-0@lo:41: 00000004:00000024:0.0:1790773044.558916:0:6484:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1790773044.558959:0:6484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ed6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761495949568:12345-0@lo:41: Request processed in 78us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773044.558966:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790773044.559013:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ec60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761495949568:0@lo:41: 00000100:00100000:3.0:1790773044.559426:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790773044.559437:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ec62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761495949696:0@lo:41: 00000100:00100000:3.0:1790773044.559489:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773044.559557:0:7666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495949696 00000100:00100000:2.0:1790773044.559563:0:7666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495949696 00000100:00100000:2.0:1790773044.559605:0:7666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790773044.559613:0:7666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761495949696:12345-0@lo:41: 00000004:00000024:2.0:1790773044.559636:0:7666:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:2.0:1790773044.559677:0:7666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761495949696:12345-0@lo:41: Request processed in 66us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773044.559683:0:7666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790773044.559712:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ec62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761495949696:0@lo:41: 00000020:00000004:3.0:1790773044.632785:0:8815:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790773044.633041:0:8815:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1790773045.071913:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773046.093598:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773047.118941:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1790773047.123882:0:6475:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1790773047.123889:0:6475:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93d26ed89000 from 30 10000000:01000000:3.0:1790773047.123896:0:6475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790773047.123950:0:6475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d24166ee00/0xabf1cc0bc7841721 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773047.123961:0:6475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d24166ee00/0xabf1cc0bc7841721 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773047.123974:0:6475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d24166ee00/0xabf1cc0bc7841721 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773047.123997:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495949824:0@lo:101: 00000100:00100000:3.0:1790773047.124069:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773047.124127:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279e483c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790773047.124301:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495949824 00000100:00100000:2.0:1790773047.124310:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495949824 00000100:00100000:2.0:1790773047.124363:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1790773047.124372:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c697c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+14:6475:x1877761495949824:12345-0@lo:101: 00010000:00010000:2.0:1790773047.124387:0:6472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773047.124400:0:6472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d241527c00/0xabf1cc0bc7841728 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7841721 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773047.124425:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d241527c00/0xabf1cc0bc7841728 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7841721 expref: 15 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773047.124450:0:6472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d241527c00/0xabf1cc0bc7841728 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7841721 expref: 15 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773047.124459:0:6472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d241527c00, rc 0) 00000100:00100000:2.0:1790773047.124512:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c697c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:6475:x1877761495949824:12345-0@lo:101: Request processed in 142us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773047.124520:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1790773047.124602:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495949824:0@lo:101: 00010000:00010000:0.0:1790773047.124619:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d24166ee00/0xabf1cc0bc7841721 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841728 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773047.124637:0:6475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d24166ee00/0xabf1cc0bc7841721 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7841728 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773047.124698:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ed68380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495949952:0@lo:501: 00000100:00100000:0.0:1790773047.124725:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773047.124751:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ef10cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790773047.124791:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495949952 00000100:00100000:2.0:1790773047.124795:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495949952 00000100:00100000:2.0:1790773047.124835:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1790773047.124841:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c697050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:6475:x1877761495949952:12345-0@lo:501: 00000100:00100000:2.0:1790773047.124974:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c697050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:6475:x1877761495949952:12345-0@lo:501: Request processed in 133us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773047.124981:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1790773047.125010:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ed68380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495949952:0@lo:501: 00000100:00100000:2.0:1790773047.125038:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ec62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495950080:0@lo:503: 00000100:00100000:2.0:1790773047.125076:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773047.125099:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ef8ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1790773047.125111:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495950080 00000100:00100000:2.0:1790773047.125114:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495950080 00000100:00100000:2.0:1790773047.125130:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1790773047.125136:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c697450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:6475:x1877761495950080:12345-0@lo:503: 00000100:00100000:2.0:1790773047.125244:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c697450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:6475:x1877761495950080:12345-0@lo:503: Request processed in 108us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773047.125250:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1790773047.125294:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ec62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495950080:0@lo:503: 00000100:00100000:2.0:1790773047.125463:0:8893:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ec62a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:8893:1877761495950208:0@lo:502: 00000100:00100000:2.0:1790773047.125495:0:8893:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773047.125513:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495950208 00000100:00100000:2.0:1790773047.125516:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495950208 00000100:00100000:2.0:1790773047.125534:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1790773047.125540:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c695850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:8893:x1877761495950208:12345-0@lo:502: 00000100:00100000:2.0:1790773047.125608:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c695850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:8893:x1877761495950208:12345-0@lo:502: Request processed in 67us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773047.125614:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1790773047.125639:0:8893:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ef8c240 going to sleep for 11 seconds 00000100:00100000:2.0:1790773047.125651:0:8893:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ec62a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:8893:1877761495950208:0@lo:502: 00000100:00100000:2.0:1790773047.125687:0:8893:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ec62a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:8893:1877761495950336:0@lo:502: 00000100:00100000:2.0:1790773047.125718:0:8893:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773047.125736:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495950336 00000100:00100000:2.0:1790773047.125739:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495950336 00000100:00100000:2.0:1790773047.125755:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1790773047.125761:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c694450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:8893:x1877761495950336:12345-0@lo:502: 00000100:00100000:2.0:1790773047.125814:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c694450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:8893:x1877761495950336:12345-0@lo:502: Request processed in 52us (94us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773047.125821:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1790773047.125845:0:8893:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ef8c240 going to sleep for 11 seconds 00000100:00100000:2.0:1790773047.125857:0:8893:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ec62a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:8893:1877761495950336:0@lo:502: 00000040:00080000:2.0:1790773047.125875:0:8893:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1790773047.125927:0:6475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1790773047.125942:0:6475:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790773047.125955:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d24166ee00/0xabf1cc0bc7841721 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841728 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773047.125964:0:6475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d24166ee00/0xabf1cc0bc7841721 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841728 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790773047.125972:0:6475:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790773047.125974:0:6475:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93d26ed89000 from 5 10000000:01000000:2.0:1790773047.125976:0:6475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790773047.125997:0:6475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d241527800/0xabf1cc0bc784172f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773047.126004:0:6475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d241527800/0xabf1cc0bc784172f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773047.126012:0:6475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d241527800/0xabf1cc0bc784172f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773047.126023:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ec62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495950464:0@lo:101: 00000100:00100000:2.0:1790773047.126047:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773047.126059:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ef8c240 going to sleep for 11 seconds 00000100:00100000:2.0:1790773047.126071:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495950464 00000100:00100000:2.0:1790773047.126074:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495950464 00000100:00100000:2.0:1790773047.126103:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1790773047.126109:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:6475:x1877761495950464:12345-0@lo:101: 00010000:00010000:2.0:1790773047.126117:0:6471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773047.126127:0:6471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d241526a00/0xabf1cc0bc7841736 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc784172f expref: -99 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773047.126142:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d241526a00/0xabf1cc0bc7841736 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc784172f expref: 16 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773047.126158:0:6471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d241526a00/0xabf1cc0bc7841736 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc784172f expref: 16 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773047.126166:0:6471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d241526a00, rc 0) 00000100:00100000:2.0:1790773047.126194:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:6475:x1877761495950464:12345-0@lo:101: Request processed in 86us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773047.126199:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1790773047.126250:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ec62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495950464:0@lo:101: 00010000:00010000:2.0:1790773047.126262:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d241527800/0xabf1cc0bc784172f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841736 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773047.126269:0:6475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d241527800/0xabf1cc0bc784172f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7841736 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773047.126310:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ec62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495950592:0@lo:256: 00000100:00100000:2.0:1790773047.126337:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773047.126350:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ef8c240 going to sleep for 11 seconds 00000100:00100000:2.0:1790773047.126361:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495950592 00000100:00100000:2.0:1790773047.126364:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495950592 00000100:00100000:2.0:1790773047.126381:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1790773047.126386:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:6475:x1877761495950592:12345-0@lo:256: 20000000:01000000:2.0:1790773047.126398:0:6471:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790773047.126414:0:6471:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790773047.126418:0:6471:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1790773047.126483:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:6475:x1877761495950592:12345-0@lo:256: Request processed in 96us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773047.126489:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1790773047.126522:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ec62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495950592:0@lo:256: 10000000:01000000:2.0:1790773047.126561:0:6475:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790773047.126566:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d241527800/0xabf1cc0bc784172f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841736 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773047.126574:0:6475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d241527800/0xabf1cc0bc784172f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841736 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790773047.126581:0:6475:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1790773047.126583:0:6475:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:2.0:1790773047.126585:0:6475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1790773047.126599:0:6475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d241527600/0xabf1cc0bc784173d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773047.126605:0:6475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d241527600/0xabf1cc0bc784173d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773047.126612:0:6475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d241527600/0xabf1cc0bc784173d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773047.126622:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ec62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495950720:0@lo:101: 00000100:00100000:2.0:1790773047.126644:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773047.126657:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ef8c240 going to sleep for 11 seconds 00000100:00100000:2.0:1790773047.126666:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495950720 00000100:00100000:2.0:1790773047.126669:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495950720 00000100:00100000:2.0:1790773047.126685:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1790773047.126690:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:6475:x1877761495950720:12345-0@lo:101: 00010000:00010000:2.0:1790773047.126696:0:6471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773047.126703:0:6471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d241527400/0xabf1cc0bc7841744 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc784173d expref: -99 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773047.126723:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d241527400/0xabf1cc0bc7841744 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc784173d expref: 17 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773047.126730:0:6471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d241527400/0xabf1cc0bc7841744 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc784173d expref: 17 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773047.126736:0:6471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d241527400, rc 0) 00000100:00100000:2.0:1790773047.126763:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:6475:x1877761495950720:12345-0@lo:101: Request processed in 72us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773047.126768:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1790773047.126794:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ec62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495950720:0@lo:101: 00010000:00010000:2.0:1790773047.126804:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d241527600/0xabf1cc0bc784173d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841744 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773047.126811:0:6475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d241527600/0xabf1cc0bc784173d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7841744 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773047.126850:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ec62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495950848:0@lo:501: 00000100:00100000:2.0:1790773047.126872:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773047.126884:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ef8c240 going to sleep for 11 seconds 00000100:00100000:2.0:1790773047.126893:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495950848 00000100:00100000:2.0:1790773047.126897:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495950848 00000100:00100000:2.0:1790773047.126912:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1790773047.126916:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:6475:x1877761495950848:12345-0@lo:501: 00000100:00100000:2.0:1790773047.127002:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:6475:x1877761495950848:12345-0@lo:501: Request processed in 85us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773047.127008:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1790773047.127040:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ec62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495950848:0@lo:501: 00000100:00100000:2.0:1790773047.127064:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ec62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495950976:0@lo:503: 00000100:00100000:2.0:1790773047.127110:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773047.127123:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ef8c240 going to sleep for 11 seconds 00000100:00100000:2.0:1790773047.127133:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495950976 00000100:00100000:2.0:1790773047.127136:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495950976 00000100:00100000:2.0:1790773047.127151:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1790773047.127156:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:6475:x1877761495950976:12345-0@lo:503: 00000100:00100000:2.0:1790773047.127244:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:6475:x1877761495950976:12345-0@lo:503: Request processed in 87us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773047.127250:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1790773047.127286:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ec62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495950976:0@lo:503: 00000100:00100000:3.0:1790773047.134002:0:8894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:8894:1877761495951104:0@lo:502: 00000100:00100000:3.0:1790773047.134096:0:8894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773047.134143:0:8894:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279e48d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790773047.134340:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495951104 00000100:00100000:2.0:1790773047.134348:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495951104 00000100:00100000:2.0:1790773047.134386:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1790773047.134393:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:8894:x1877761495951104:12345-0@lo:502: 00000100:00100000:2.0:1790773047.134508:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:8894:x1877761495951104:12345-0@lo:502: Request processed in 114us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773047.134515:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1790773047.135030:0:8894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:8894:1877761495951104:0@lo:502: 00000020:01000000:3.0:1790773047.135060:0:8894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790773047.135068:0:8894:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1790773047.135076:0:8894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773047.135078:0:8894:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1790773047.135092:0:8894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1790773047.135097:0:8894:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.119@tcp to nid 0x20000c0a8ca77 (192.168.202.119@tcp) 00000020:01000000:3.0:1790773047.135120:0:8894:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1790773047.135123:0:8894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790773047.135137:0:8894:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff93d27b2c3380) 00000020:00000080:3.0:1790773047.135158:0:8894:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:3.0:1790773047.135164:0:8894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790773047.135293:0:8894:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1790773047.135300:0:8894:0:(osd_handler.c:8931:osd_obd_connect()) connect #4 00000020:00000080:3.0:1790773047.135307:0:8894:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xabf1cc0bc7841752 00010000:00080000:3.0:1790773047.135336:0:8894:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d27c37b000@lustre-OST0000-osc-MDT0001: add connection 192.168.202.119@tcp at head 00010000:00010000:3.0:1790773047.135558:0:8894:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1790773047.166628:0:8894:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1790773047.166653:0:8894:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1790773047.166896:0:8894:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790773047.167360:0:8894:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790773047.167465:0:8894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1790773047.167551:0:8894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1790773047.169588:0:8898:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790773047.169594:0:8898:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1790773047.172414:0:8894:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1790773047.172429:0:8894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1790773047.172481:0:8894:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1790773047.172504:0:8894:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xabf1cc0bc7841759 00000100:00080000:2.0:1790773047.172514:0:8894:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790773047.172525:0:8894:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff93d27c37b000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:2.0:1790773047.172562:0:8894:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d26ec62a00 x1877761495951232/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790773047.172619:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ec62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761495951232:0@lo:8: 00000100:00100000:1.0:1790773047.172694:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773047.172782:0:8392:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495951232 00000100:00100000:0.0:1790773047.172791:0:8392:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495951232 00000100:00100000:0.0:1790773047.172832:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790773047.172840:0:8392:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3603:x1877761495951232:12345-0@lo:8: 00010000:00080000:0.0:1790773047.172865:0:8392:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 189 last 0 00000020:00000080:0.0:1790773047.172891:0:8392:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xabf1cc0bc7841760 00002000:00100000:0.0:1790773047.172932:0:8392:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff93d141fea800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b04 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1790773047.172936:0:8392:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:0.0:1790773047.172940:0:8392:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1790773047.173000:0:8392:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1790773047.173265:0:8392:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1790773047.173290:0:8392:0:(import.c:65:import_set_state_nolock()) ffff93d141fe8800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1790773047.173461:0:8894:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1790773047.173535:0:8894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790773047.173541:0:8894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773047.173543:0:8894:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1790773047.173546:0:8894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790773047.173550:0:8894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773047.173552:0:8894:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790773047.173555:0:8894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790773047.173557:0:8894:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1790773047.173585:0:8894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ec60700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:8894:1877761495951360:0@lo:502: 00000100:00100000:2.0:1790773047.173639:0:8894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773047.173674:0:8894:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c0989c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790773047.174047:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495951360 00000100:00100000:3.0:1790773047.174053:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495951360 00000100:00100000:3.0:1790773047.174106:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1790773047.174116:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:8894:x1877761495951360:12345-0@lo:502: 00000100:00100000:3.0:1790773047.174260:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:8894:x1877761495951360:12345-0@lo:502: Request processed in 146us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773047.174277:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1790773047.176101:0:8894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ec60700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:8894:1877761495951360:0@lo:502: 00000020:01000000:2.0:1790773047.176148:0:8894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790773047.176157:0:8894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773047.176160:0:8894:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:2.0:1790773047.176165:0:8894:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:2.0:1790773047.176259:0:6475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:2.0:1790773047.176284:0:6475:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1790773047.176296:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d241527600/0xabf1cc0bc784173d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841744 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773047.176321:0:6475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d241527600/0xabf1cc0bc784173d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841744 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790773047.176332:0:6475:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1790773047.176335:0:6475:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93d25268e800 from 30 10000000:01000000:2.0:1790773047.176338:0:6475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790773047.176374:0:6475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d241527200/0xabf1cc0bc7841767 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773047.176382:0:6475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d241527200/0xabf1cc0bc7841767 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773047.176392:0:6475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d241527200/0xabf1cc0bc7841767 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773047.176410:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ec60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495951488:0@lo:101: 00000100:00100000:2.0:1790773047.176470:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773047.176505:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c0989c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790773047.178309:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ec62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761495951872:0@lo:400: 00000100:00100000:2.0:1790773047.178375:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773047.178410:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790773047.178416:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3606:1877761495952000:0@lo:400: 00000100:00100000:2.0:1790773047.178441:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773047.178593:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ec60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3604:1877761495951616:0@lo:400: 00000100:00100000:1.0:1790773047.178630:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773047.178661:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3604:1877761495952128:0@lo:400: 00000100:00100000:2.0:1790773047.178916:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495952000 00000100:00100000:2.0:1790773047.178935:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495952000 00000100:00100000:2.0:1790773047.178984:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495951616 00000100:00100000:2.0:1790773047.178987:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495951616 00000100:00100000:2.0:1790773047.179006:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790773047.179023:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1877761495952000:12345-0@lo:400: 00000100:00100000:2.0:1790773047.179080:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1877761495952000:12345-0@lo:400: Request processed in 58us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773047.179096:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790773047.179117:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790773047.179123:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3604:x1877761495951616:12345-0@lo:400: 00000100:00100000:2.0:1790773047.179151:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3604:x1877761495951616:12345-0@lo:400: Request processed in 29us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773047.179157:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1790773047.179195:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d27c3ab480 x1877761495952000/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773047.179233:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3606:1877761495952000:0@lo:400: 00000100:00100000:1.0:1790773047.179354:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1790773047.179393:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d26ec60e00 x1877761495951616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773047.179403:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ec60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3604:1877761495951616:0@lo:400: 00000100:00100000:1.0:1790773047.179411:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1790773047.179418:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ec61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761495951744:0@lo:400: 00000100:00100000:1.0:1790773047.179445:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773047.179464:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3604:1877761495952256:0@lo:400: 00000100:00100000:1.0:1790773047.179484:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773047.179504:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495952128 00000100:00100000:1.0:1790773047.179507:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495952128 00000100:00100000:1.0:1790773047.179537:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495952256 00000100:00100000:1.0:1790773047.179539:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495952256 00000100:00100000:1.0:1790773047.179554:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790773047.179559:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3604:x1877761495952128:12345-0@lo:400: 00000100:00100000:1.0:1790773047.179595:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3604:x1877761495952128:12345-0@lo:400: Request processed in 36us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773047.179601:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790773047.179614:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790773047.179620:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3604:x1877761495952256:12345-0@lo:400: 00000100:00100000:1.0:1790773047.179646:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3604:x1877761495952256:12345-0@lo:400: Request processed in 27us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773047.179661:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790773047.179679:0:7666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495951872 00000100:00100000:1.0:1790773047.179683:0:7666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495951872 00000100:00100000:1.0:1790773047.179704:0:7666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495951744 00000100:00100000:1.0:1790773047.179708:0:7666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495951744 00000100:00100000:1.0:1790773047.179720:0:7666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790773047.180057:0:8392:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3603:x1877761495951232:12345-0@lo:8: Request processed in 7214us (7361us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773047.180066:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790773047.180101:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495951488 00000100:00100000:0.0:1790773047.180106:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495951488 00000100:00100000:0.0:1790773047.180139:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1790773047.180146:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:6475:x1877761495951488:12345-0@lo:101: 00010000:00010000:0.0:1790773047.180158:0:6472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773047.180181:0:6472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d26c4a3800/0xabf1cc0bc784176e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7841767 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773047.180226:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d26c4a3800/0xabf1cc0bc784176e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7841767 expref: 18 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773047.180238:0:6472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d26c4a3800/0xabf1cc0bc784176e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7841767 expref: 18 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773047.180247:0:6472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26c4a3800, rc 0) 00000100:00100000:0.0:1790773047.180284:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:6475:x1877761495951488:12345-0@lo:101: Request processed in 138us (3814us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773047.180290:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1790773047.180332:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790773047.180339:0:6483:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761495951744:12345-0@lo:400: 00000100:00100000:0.0:1790773047.180371:0:6483:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761495951744:12345-0@lo:400: Request processed in 33us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773047.180378:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790773047.180420:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ec60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495951488:0@lo:101: 00010000:00010000:0.0:1790773047.180439:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d241527200/0xabf1cc0bc7841767 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc784176e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773047.180448:0:6475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d241527200/0xabf1cc0bc7841767 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc784176e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773047.180528:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ed6a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495952384:0@lo:501: 00000100:00100000:1.0:1790773047.180737:0:7666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761495951872:12345-0@lo:400: 00000100:00100000:1.0:1790773047.180782:0:7666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761495951872:12345-0@lo:400: Request processed in 1057us (2407us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773047.180789:0:7666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1790773047.180809:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790773047.180813:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790773047.180832:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ec61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761495951744:0@lo:400: 00010000:00080000:1.0:1790773047.180846:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d27c3aad80 x1877761495952256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773047.180855:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3604:1877761495952256:0@lo:400: 00010000:00080000:1.0:1790773047.180866:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d27c3ab800 x1877761495952128/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773047.180874:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3604:1877761495952128:0@lo:400: 00000100:00100000:1.0:1790773047.180909:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ec62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761495951872:0@lo:400: 00000100:00100000:0.0:1790773047.181006:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773047.181036:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d249636240 going to sleep for 11 seconds 00000100:00100000:0.0:1790773047.181057:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495952384 00000100:00100000:0.0:1790773047.181062:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495952384 00000100:00100000:0.0:1790773047.181099:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1790773047.181106:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:6475:x1877761495952384:12345-0@lo:501: 00000100:00100000:0.0:1790773047.181245:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:6475:x1877761495952384:12345-0@lo:501: Request processed in 139us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773047.181252:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1790773047.181282:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ed6a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495952384:0@lo:501: 00000100:00100000:0.0:1790773047.181308:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ed6a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495952512:0@lo:503: 00000100:00100000:0.0:1790773047.181345:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773047.181362:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d249636240 going to sleep for 11 seconds 00000100:00100000:0.0:1790773047.181372:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495952512 00000100:00100000:0.0:1790773047.181375:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495952512 00000100:00100000:0.0:1790773047.181393:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1790773047.181399:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:6475:x1877761495952512:12345-0@lo:503: 00000100:00100000:0.0:1790773047.181471:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:6475:x1877761495952512:12345-0@lo:503: Request processed in 71us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773047.181476:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1790773047.181512:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ed6a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495952512:0@lo:503: 00010000:00080000:1.0:1790773047.181706:0:3603:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d26ec62a00 x1877761495951232/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790773057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773047.181715:0:3603:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790773047.181722:0:3603:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1790773047.181729:0:3603:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1790773047.181741:0:3603:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1790773047.181744:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d27c37b000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1790773047.181752:0:3603:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1790773047.181757:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ec62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761495951232:0@lo:8: 00000100:00100000:1.0:1790773047.181794:0:8899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8899:1877761495952640:0@lo:700: 00000100:00100000:1.0:1790773047.181820:0:8899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773047.181834:0:8899:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c343180 going to sleep for 11 seconds 00000004:00080000:2.0:1790773047.183283:0:8898:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1790773047.183366:0:8898:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 189985160727ns, next at 0ns, rc = 0 00080000:00080000:2.0:1790773047.183375:0:8898:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1790773047.184014:0:8401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495952640 00000100:00100000:0.0:1790773047.184028:0:8401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495952640 00000100:00100000:0.0:1790773047.184162:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790773047.184171:0:8401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8899:x1877761495952640:12345-0@lo:700: 00000100:00100000:0.0:1790773047.184240:0:8401:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ed6a680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8401:1877761495952768:0@lo:700: 00000100:00100000:0.0:1790773047.184301:0:8401:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773047.184327:0:8401:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d249636240 going to sleep for 11 seconds 00000100:00100000:0.0:1790773047.184355:0:6485:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495952768 00000100:00100000:0.0:1790773047.184357:0:6485:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495952768 00000100:00100000:0.0:1790773047.184377:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790773047.184382:0:6485:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ed69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8401:x1877761495952768:12345-0@lo:700: 00000100:00100000:1.0:1790773047.185312:0:8900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:8900:1877761495952896:0@lo:502: 00000100:00100000:1.0:1790773047.185377:0:8900:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773047.185405:0:8900:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c343000 going to sleep for 11 seconds 00000100:00100000:0.0:1790773047.187108:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495952896 00000100:00100000:0.0:1790773047.187119:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495952896 00000100:00100000:0.0:1790773047.187173:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1790773047.187182:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:8900:x1877761495952896:12345-0@lo:502: 00000100:00100000:0.0:1790773047.187382:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:8900:x1877761495952896:12345-0@lo:502: Request processed in 201us (2004us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773047.187389:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1790773047.187875:0:8900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:8900:1877761495952896:0@lo:502: 00000100:00100000:1.0:1790773047.187936:0:8900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:8900:1877761495953024:0@lo:502: 00000100:00100000:1.0:1790773047.187978:0:8900:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773047.188016:0:8900:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c343000 going to sleep for 11 seconds 00000100:00100000:3.0:1790773047.188060:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495953024 00000100:00100000:3.0:1790773047.188074:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495953024 00000100:00100000:3.0:1790773047.188118:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1790773047.188126:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:8900:x1877761495953024:12345-0@lo:502: 00000100:00100000:3.0:1790773047.188231:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:8900:x1877761495953024:12345-0@lo:502: Request processed in 106us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773047.188237:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1790773047.188531:0:8900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:8900:1877761495953024:0@lo:502: 00000040:00080000:1.0:1790773047.188550:0:8900:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1790773047.188888:0:6475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1790773047.188910:0:6475:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790773047.188920:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d241527200/0xabf1cc0bc7841767 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc784176e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773047.188932:0:6475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d241527200/0xabf1cc0bc7841767 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc784176e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790773047.188943:0:6475:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790773047.188946:0:6475:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93d25268e800 from 5 10000000:01000000:0.0:1790773047.188949:0:6475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790773047.188981:0:6475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3000/0xabf1cc0bc7841775 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773047.188991:0:6475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3000/0xabf1cc0bc7841775 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773047.189001:0:6475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3000/0xabf1cc0bc7841775 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773047.189028:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ed69c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495953152:0@lo:101: 00000100:00100000:0.0:1790773047.189551:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773047.189616:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d249636780 going to sleep for 11 seconds 00000100:00080000:2.0:1790773047.192496:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1790773047.193250:0:7410:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 40000000:02000000:2.0:1790773047.193796:0:6485:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:1.0:1790773047.200779:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495953152 00000100:00100000:1.0:1790773047.200796:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495953152 00000100:00100000:1.0:1790773047.200852:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1790773047.200863:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:6475:x1877761495953152:12345-0@lo:101: 00010000:00010000:1.0:1790773047.200881:0:6472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773047.200899:0:6472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d27b12a400/0xabf1cc0bc784177c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7841775 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773047.200927:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d27b12a400/0xabf1cc0bc784177c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7841775 expref: 19 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773047.200953:0:6472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d27b12a400/0xabf1cc0bc784177c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7841775 expref: 19 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773047.200963:0:6472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12a400, rc 0) 00000100:00100000:1.0:1790773047.201051:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+19:6475:x1877761495953152:12345-0@lo:101: Request processed in 190us (11501us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773047.201058:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1790773047.203991:0:6485:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ed69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8401:x1877761495952768:12345-0@lo:700: Request processed in 19600us (19681us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773047.204004:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790773047.204242:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ed69c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495953152:0@lo:101: 00010000:00010000:0.0:1790773047.204268:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3000/0xabf1cc0bc7841775 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc784177c expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773047.204279:0:6475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3000/0xabf1cc0bc7841775 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc784177c expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773047.204356:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ed69c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495953280:0@lo:256: 00000100:00100000:0.0:1790773047.204401:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773047.204440:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d249636780 going to sleep for 11 seconds 00010000:00080000:0.0:1790773047.204779:0:8401:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d26ed6a680 x1877761495952768/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1790773063 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773047.204792:0:8401:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ed6a680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8401:1877761495952768:0@lo:700: 40000000:02000000:0.0:1790773047.204801:0:8401:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000100:00100000:2.0:1790773047.205225:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495953280 00000100:00100000:2.0:1790773047.205234:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495953280 00000100:00100000:2.0:1790773047.205276:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1790773047.205288:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+19:6475:x1877761495953280:12345-0@lo:256: 20000000:01000000:2.0:1790773047.205314:0:6471:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790773047.205339:0:6471:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790773047.205342:0:6471:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1790773047.205435:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+19:6475:x1877761495953280:12345-0@lo:256: Request processed in 148us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773047.205442:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1790773047.206741:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ed69c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495953280:0@lo:256: 10000000:01000000:2.0:1790773047.207273:0:6475:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790773047.207285:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3000/0xabf1cc0bc7841775 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc784177c expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773047.207296:0:6475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3000/0xabf1cc0bc7841775 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc784177c expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790773047.207305:0:6475:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1790773047.207307:0:6475:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1790773047.207310:0:6475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1790773047.207347:0:6475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d241526c00/0xabf1cc0bc7841783 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773047.207355:0:6475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d241526c00/0xabf1cc0bc7841783 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773047.207365:0:6475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d241526c00/0xabf1cc0bc7841783 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773047.207383:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495953408:0@lo:101: 00000100:00100000:2.0:1790773047.207441:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773047.207480:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c0986c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790773047.207559:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495953408 00000100:00100000:1.0:1790773047.207566:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495953408 00000100:00100000:1.0:1790773047.207612:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1790773047.207622:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+19:6475:x1877761495953408:12345-0@lo:101: 00010000:00010000:1.0:1790773047.207634:0:6473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773047.207648:0:6473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d27b12a600/0xabf1cc0bc784178a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7841783 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773047.207671:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d27b12a600/0xabf1cc0bc784178a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7841783 expref: 20 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773047.207680:0:6473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d27b12a600/0xabf1cc0bc784178a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7841783 expref: 20 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773047.207689:0:6473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12a600, rc 0) 00000100:00100000:1.0:1790773047.207730:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+20:6475:x1877761495953408:12345-0@lo:101: Request processed in 110us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773047.207738:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1790773047.207791:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495953408:0@lo:101: 00010000:00010000:1.0:1790773047.207804:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d241526c00/0xabf1cc0bc7841783 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc784178a expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773047.207824:0:6475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d241526c00/0xabf1cc0bc7841783 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc784178a expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773047.207881:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495953536:0@lo:501: 00000100:00100000:1.0:1790773047.207907:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773047.207927:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c343600 going to sleep for 11 seconds 00000100:00100000:1.0:1790773047.207939:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495953536 00000100:00100000:1.0:1790773047.207942:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495953536 00000100:00100000:1.0:1790773047.207964:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1790773047.207970:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+20:6475:x1877761495953536:12345-0@lo:501: 00000100:00100000:1.0:1790773047.208109:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+20:6475:x1877761495953536:12345-0@lo:501: Request processed in 138us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773047.208116:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1790773047.208145:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495953536:0@lo:501: 00000100:00100000:1.0:1790773047.208169:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495953664:0@lo:503: 00000100:00100000:1.0:1790773047.208233:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773047.208251:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c343600 going to sleep for 11 seconds 00000100:00100000:1.0:1790773047.208261:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495953664 00000100:00100000:1.0:1790773047.208264:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495953664 00000100:00100000:1.0:1790773047.208297:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1790773047.208304:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d252ea1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+20:6475:x1877761495953664:12345-0@lo:503: 00000100:00100000:1.0:1790773047.208388:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d252ea1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+20:6475:x1877761495953664:12345-0@lo:503: Request processed in 84us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773047.208394:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1790773047.208432:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495953664:0@lo:503: 00000100:00100000:2.0:1790773047.214982:0:8902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:8902:1877761495953792:0@lo:502: 00000100:00100000:2.0:1790773047.215111:0:8902:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773047.215155:0:8902:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c0986c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790773047.215275:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495953792 00000100:00100000:1.0:1790773047.215283:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495953792 00000100:00100000:1.0:1790773047.215333:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1790773047.215342:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d252ea0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+20:8902:x1877761495953792:12345-0@lo:502: 00000100:00100000:1.0:1790773047.215463:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d252ea0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+20:8902:x1877761495953792:12345-0@lo:502: Request processed in 122us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773047.215472:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1790773047.215862:0:8902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:8902:1877761495953792:0@lo:502: 00000020:01000000:2.0:1790773047.215893:0:8902:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790773047.215902:0:8902:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1790773047.215909:0:8902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773047.215912:0:8902:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1790773047.215917:0:8902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790773047.215921:0:8902:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.119@tcp to nid 0x20000c0a8ca77 (192.168.202.119@tcp) 00000020:01000000:2.0:1790773047.215943:0:8902:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1790773047.215947:0:8902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790773047.215962:0:8902:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff93d2512d4d40) 00000020:00000080:2.0:1790773047.215988:0:8902:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:2.0:1790773047.215994:0:8902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790773047.216111:0:8902:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1790773047.216117:0:8902:0:(osd_handler.c:8931:osd_obd_connect()) connect #6 00000020:00000080:2.0:1790773047.216125:0:8902:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xabf1cc0bc7841798 00010000:00080000:2.0:1790773047.216171:0:8902:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d27f91f800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.119@tcp at head 00010000:00010000:2.0:1790773047.216435:0:8902:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000040:01000000:2.0:1790773047.227057:0:8902:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1790773047.227154:0:8902:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1790773047.227383:0:8902:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790773047.227571:0:8902:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790773047.227667:0:8902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1790773047.227760:0:8902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1790773047.233350:0:8904:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790773047.233358:0:8904:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1790773047.234193:0:8902:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790773047.234236:0:8902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1790773047.234275:0:8902:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1790773047.234305:0:8902:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xabf1cc0bc784179f 00000100:00080000:2.0:1790773047.234316:0:8902:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790773047.234333:0:8902:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93d27f91f800 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:2.0:1790773047.234372:0:8902:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d27c3a9500 x1877761495953920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790773047.234398:0:8902:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1790773047.234514:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3606:1877761495954048:0@lo:400: 00000100:00100000:2.0:1790773047.234588:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773047.234622:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3606:1877761495954560:0@lo:400: 00000100:00100000:2.0:1790773047.234648:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773047.234672:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1790773047.234678:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761495954176:0@lo:400: 00000100:00100000:2.0:1790773047.234704:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773047.234721:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3606:1877761495954688:0@lo:400: 00000100:00100000:2.0:1790773047.234744:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773047.234766:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761495954304:0@lo:400: 00000100:00100000:0.0:1790773047.235259:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3605:1877761495954432:0@lo:400: 00000100:00100000:0.0:1790773047.235294:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773047.235335:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495954048 00000100:00100000:0.0:1790773047.235343:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495954048 00000100:00100000:0.0:1790773047.235379:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495954560 00000100:00100000:0.0:1790773047.235381:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495954560 00000100:00100000:0.0:1790773047.235393:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495954688 00000100:00100000:0.0:1790773047.235395:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495954688 00000100:00100000:0.0:1790773047.235406:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495954432 00000100:00100000:0.0:1790773047.235417:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495954432 00000100:00100000:0.0:1790773047.235436:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790773047.235444:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1877761495954048:12345-0@lo:400: 00000100:00100000:0.0:1790773047.235501:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1877761495954048:12345-0@lo:400: Request processed in 58us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773047.235509:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790773047.235525:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790773047.235531:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1877761495954560:12345-0@lo:400: 00000100:00100000:0.0:1790773047.235559:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1877761495954560:12345-0@lo:400: Request processed in 28us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773047.235564:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790773047.235574:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790773047.235580:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1877761495954688:12345-0@lo:400: 00000100:00100000:0.0:1790773047.235605:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1877761495954688:12345-0@lo:400: Request processed in 26us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773047.235611:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790773047.235621:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790773047.235627:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ed6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3605:x1877761495954432:12345-0@lo:400: 00000100:00100000:0.0:1790773047.235655:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ed6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3605:x1877761495954432:12345-0@lo:400: Request processed in 28us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773047.235661:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790773047.235679:0:6483:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495954176 00000100:00100000:0.0:1790773047.235683:0:6483:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495954176 00000100:00100000:0.0:1790773047.235708:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790773047.235714:0:6483:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761495954176:12345-0@lo:400: 00000100:00100000:0.0:1790773047.235746:0:6483:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761495954176:12345-0@lo:400: Request processed in 32us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773047.235758:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790773047.235817:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761495954176:0@lo:400: 00010000:00080000:0.0:1790773047.235831:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d27c3a9880 x1877761495954688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773047.235842:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3606:1877761495954688:0@lo:400: 00010000:00080000:0.0:1790773047.235853:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d27c3a8380 x1877761495954048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773047.235861:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3606:1877761495954048:0@lo:400: 00010000:00080000:0.0:1790773047.235871:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d27c3a9c00 x1877761495954560/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773047.235879:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3606:1877761495954560:0@lo:400: 00010000:00080000:0.0:1790773047.235911:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d27c3a9180 x1877761495954432/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773047.235920:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3605:1877761495954432:0@lo:400: 00000100:00100000:2.0:1790773047.236247:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773047.236272:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761495954816:0@lo:400: 00000100:00100000:2.0:1790773047.236316:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773047.236352:0:6484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495954304 00000100:00100000:2.0:1790773047.236357:0:6484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495954304 00000100:00100000:2.0:1790773047.236387:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790773047.236394:0:6484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761495954304:12345-0@lo:400: 00000100:00100000:2.0:1790773047.236432:0:6484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761495954304:12345-0@lo:400: Request processed in 38us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773047.236439:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790773047.236463:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761495954304:0@lo:400: 00000020:01000000:2.0:1790773047.236544:0:8902:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790773047.236552:0:8902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773047.236555:0:8902:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1790773047.236558:0:8902:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790773047.236562:0:8902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773047.236564:0:8902:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790773047.236567:0:8902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790773047.236569:0:8902:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1790773047.236596:0:8902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3a8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:8902:1877761495954944:0@lo:502: 00000100:00100000:2.0:1790773047.236635:0:8902:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773047.236659:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495954944 00000100:00100000:2.0:1790773047.236663:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495954944 00000100:00100000:2.0:1790773047.236690:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1790773047.236696:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d252ea3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+20:8902:x1877761495954944:12345-0@lo:502: 00000100:00100000:2.0:1790773047.236811:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d252ea3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+20:8902:x1877761495954944:12345-0@lo:502: Request processed in 114us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773047.236817:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1790773047.236861:0:8902:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27b2d0540 going to sleep for 11 seconds 00000100:00100000:2.0:1790773047.236873:0:8902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3a8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:8902:1877761495954944:0@lo:502: 00000020:01000000:2.0:1790773047.236895:0:8902:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790773047.236899:0:8902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773047.236901:0:8902:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:2.0:1790773047.236905:0:8902:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1790773047.236958:0:6475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1790773047.236981:0:6475:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1790773047.236992:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d241526c00/0xabf1cc0bc7841783 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc784178a expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773047.237003:0:6475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d241526c00/0xabf1cc0bc7841783 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc784178a expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790773047.237021:0:6475:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1790773047.237024:0:6475:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93d262660000 from 1 10000000:01000000:2.0:1790773047.237027:0:6475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1790773047.237051:0:6475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d241526e00/0xabf1cc0bc78417a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773047.237058:0:6475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d241526e00/0xabf1cc0bc78417a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773047.238245:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761495953920:0@lo:8: 00000100:00100000:1.0:1790773047.238306:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773047.238378:0:8394:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495954816 00000100:00100000:1.0:1790773047.238386:0:8394:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495954816 00000100:00100000:1.0:1790773047.238430:0:8394:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495953920 00000100:00100000:1.0:1790773047.238433:0:8394:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495953920 00000100:00100000:1.0:1790773047.238446:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790773047.238453:0:8394:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+7:3604:x1877761495954816:12345-0@lo:400: 00000100:00100000:1.0:1790773047.238505:0:8394:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+7:3604:x1877761495954816:12345-0@lo:400: Request processed in 53us (2189us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773047.238511:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790773047.238525:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790773047.238529:0:8394:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3603:x1877761495953920:12345-0@lo:8: 00010000:00080000:1.0:1790773047.238553:0:8394:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:1.0:1790773047.238581:0:8394:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xabf1cc0bc78417ad 00002000:00100000:1.0:1790773047.238596:0:8394:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff93d14241d000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b04 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1790773047.238600:0:8394:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1790773047.238609:0:8394:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1790773047.238692:0:8394:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1790773047.238715:0:8394:0:(import.c:65:import_set_state_nolock()) ffff93d14241e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790773047.238754:0:8394:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3603:x1877761495953920:12345-0@lo:8: Request processed in 222us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773047.238759:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1790773047.238809:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d27c3aaa00 x1877761495954816/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773047.238821:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761495954816:0@lo:400: 00010000:00080000:1.0:1790773047.238850:0:3603:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d27c3a9500 x1877761495953920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790773057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773047.238857:0:3603:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790773047.238862:0:3603:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1790773047.238869:0:3603:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1790773047.238873:0:3603:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1790773047.238875:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d27f91f800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1790773047.238884:0:3603:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1790773047.238888:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761495953920:0@lo:8: 00000004:00080000:1.0:1790773047.238903:0:8904:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1790773047.238953:0:8904:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 190040747346ns, next at 0ns, rc = 0 00080000:00080000:1.0:1790773047.238960:0:8904:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:2.0:1790773047.239830:0:6475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d241526e00/0xabf1cc0bc78417a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773047.239863:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3a8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495955072:0@lo:101: 00000100:00100000:2.0:1790773047.239909:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773047.239940:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26bec60c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790773047.240245:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495955072 00000100:00100000:1.0:1790773047.240254:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495955072 00000100:00100000:1.0:1790773047.240301:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1790773047.240311:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d279eaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+20:6475:x1877761495955072:12345-0@lo:101: 00010000:00010000:1.0:1790773047.240328:0:6473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773047.240350:0:6473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d27b12a200/0xabf1cc0bc78417b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc78417a6 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773047.240394:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d27b12a200/0xabf1cc0bc78417b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc78417a6 expref: 21 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773047.240407:0:6473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d27b12a200/0xabf1cc0bc78417b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78417a6 expref: 21 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773047.240417:0:6473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12a200, rc 0) 00000100:00100000:1.0:1790773047.240460:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d279eaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:6475:x1877761495955072:12345-0@lo:101: Request processed in 151us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773047.240465:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000001:00100000:3.0:1790773047.240589:0:8388:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1790773047.241235:0:8401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8899:x1877761495952640:12345-0@lo:700: Request processed in 57063us (59411us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773047.241249:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1790773047.241347:0:8899:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d25074c380 x1877761495952640/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790773063 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773047.241361:0:8899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8899:1877761495952640:0@lo:700: 00000004:00080000:2.0:1790773047.242915:0:6457:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1790773047.242987:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3a8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495955072:0@lo:101: 00010000:00010000:2.0:1790773047.243014:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d241526e00/0xabf1cc0bc78417a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78417b4 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773047.243026:0:6475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d241526e00/0xabf1cc0bc78417a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc78417b4 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773047.243448:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3a8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495955200:0@lo:501: 00000100:00100000:2.0:1790773047.244179:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773047.244245:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26bec60c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790773047.244510:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495955200 00000100:00100000:1.0:1790773047.244520:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495955200 00000100:00100000:1.0:1790773047.244569:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1790773047.244579:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d279eaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:6475:x1877761495955200:12345-0@lo:501: 00000100:00100000:1.0:1790773047.244667:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d279eaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:6475:x1877761495955200:12345-0@lo:501: Request processed in 88us (489us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790773047.244675:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1790773047.245924:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790773047.245942:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761495955328:0@lo:13: 00000100:00100000:1.0:1790773047.245988:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1790773047.246027:0:8905:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1790773047.246049:0:8905:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8905:1877761495955456:0@lo:7: 00000100:00100000:3.0:1790773047.246164:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495955328 00000100:00100000:3.0:1790773047.246171:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495955328 00000100:00100000:3.0:1790773047.246260:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790773047.246268:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3604:x1877761495955328:12345-0@lo:13: 00002000:00000024:3.0:1790773047.246291:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:3.0:1790773047.246336:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3604:x1877761495955328:12345-0@lo:13: Request processed in 69us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773047.246343:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1790773047.246397:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d25074f480 x1877761495955328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773063 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773047.246416:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761495955328:0@lo:13: 00000100:00100000:2.0:1790773047.246521:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3a8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495955200:0@lo:501: 10000000:01000000:2.0:1790773047.246566:0:6475:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1790773047.246575:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d241526e00/0xabf1cc0bc78417a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78417b4 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773047.246585:0:6475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d241526e00/0xabf1cc0bc78417a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78417b4 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773047.246662:0:8905:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773047.246738:0:8905:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d248d33780 going to sleep for 11 seconds 00000100:00080000:0.0:1790773047.246850:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790773047.250464:0:8394:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495955456 00000100:00100000:2.0:1790773047.250478:0:8394:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495955456 00000100:00100000:2.0:1790773047.250531:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790773047.250541:0:8394:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8905:x1877761495955456:12345-0@lo:7: 00000004:00080000:3.0:1790773047.261498:0:8899:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1790773047.261533:0:8899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8899:1877761495955712:0@lo:7: 00000100:00100000:3.0:1790773047.261618:0:8899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773047.261648:0:8899:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279e48300 going to sleep for 11 seconds 00000100:00100000:0.0:1790773047.261857:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761495955584:0@lo:13: 00000100:00100000:0.0:1790773047.261893:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773047.261942:0:8392:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1790773047.261951:0:8392:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1790773047.262426:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495955584 00000100:00100000:3.0:1790773047.262434:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495955584 00000100:00100000:3.0:1790773047.262478:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790773047.262488:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ed69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761495955584:12345-0@lo:13: 00002000:00000024:3.0:1790773047.262510:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:3.0:1790773047.262559:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ed69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761495955584:12345-0@lo:13: Request processed in 72us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773047.262566:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1790773047.262647:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d281b9dc00 x1877761495955584/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773063 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773047.262663:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761495955584:0@lo:13: 00000100:00100000:1.0:1790773047.262799:0:8392:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495955712 00000100:00100000:1.0:1790773047.262804:0:8392:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495955712 00000100:00100000:0.0:1790773047.263404:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790773047.263420:0:8906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8899:x1877761495955712:12345-0@lo:7: 00002000:00080000:2.0:1790773047.268102:0:8394:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1790773047.268111:0:8394:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00010000:00080000:1.0:1790773047.268363:0:8905:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d25074dc00 x1877761495955456/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790773063 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773047.268380:0:8905:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8905:1877761495955456:0@lo:7: 00000004:00080000:1.0:1790773047.268394:0:8905:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1790773047.268431:0:8905:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8905:1877761495955840:0@lo:5: 00000100:00100000:1.0:1790773047.268462:0:8905:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773047.268496:0:8905:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d248d33780 going to sleep for 11 seconds 00000100:00100000:3.0:1790773047.268551:0:8392:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1790773047.268559:0:8392:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1790773047.268793:0:8392:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495955840 00000100:00100000:1.0:1790773047.268799:0:8392:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495955840 00000100:00100000:3.0:1790773047.268983:0:8907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790773047.268994:0:8907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:8905:x1877761495955840:12345-0@lo:5: 00002000:00080000:3.0:1790773047.269019:0:8907:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1790773047.269022:0:8907:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1790773047.269135:0:8394:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:8905:x1877761495955456:12345-0@lo:7: Request processed in 18595us (22472us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773047.269143:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00002000:00080000:1.0:1790773047.271857:0:8906:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1790773047.271865:0:8906:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1790773047.272100:0:8906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8899:x1877761495955712:12345-0@lo:7: Request processed in 8678us (10479us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773047.272112:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000001:00080000:0.0:1790773047.276451:0:8388:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1790773047.276477:0:8388:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:2.0:1790773047.276616:0:8899:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d281b9d880 x1877761495955712/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790773063 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773047.276633:0:8899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8899:1877761495955712:0@lo:7: 00000004:00080000:2.0:1790773047.276647:0:8899:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:2.0:1790773047.276687:0:8899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3a8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8899:1877761495955968:0@lo:5: 00000100:00100000:2.0:1790773047.276743:0:8899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773047.276784:0:8899:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26bec6d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790773047.276809:0:8392:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495955968 00000100:00100000:2.0:1790773047.276815:0:8392:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495955968 00000100:00100000:2.0:1790773047.276861:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790773047.276869:0:8392:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8899:x1877761495955968:12345-0@lo:5: 00002000:00080000:2.0:1790773047.276911:0:8392:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1790773047.276950:0:8392:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8899:x1877761495955968:12345-0@lo:5: Request processed in 81us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773047.276957:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1790773047.276989:0:8899:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d27c3a8000 x1877761495955968/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790773063 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773047.276998:0:8899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3a8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8899:1877761495955968:0@lo:5: 00000004:00080000:2.0:1790773047.277006:0:8899:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1790773047.277028:0:8899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3a8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8899:1877761495956096:0@lo:5: 00000100:00100000:2.0:1790773047.277049:0:8899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773047.277063:0:8899:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26bec6d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790773047.277074:0:8394:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495956096 00000100:00100000:2.0:1790773047.277078:0:8394:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495956096 00000100:00100000:2.0:1790773047.277108:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790773047.277114:0:8394:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8899:x1877761495956096:12345-0@lo:5: 00002000:00080000:2.0:1790773047.277150:0:8394:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1790773047.280568:0:8394:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:8899:x1877761495956096:12345-0@lo:5: Request processed in 3447us (3510us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1790773047.280582:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790773047.280750:0:8907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:8905:x1877761495955840:12345-0@lo:5: Request processed in 11756us (12285us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1790773047.280757:0:8907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1790773047.280931:0:8899:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d27c3a8000 x1877761495956096/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790773063 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773047.280952:0:8899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3a8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8899:1877761495956096:0@lo:5: 00000004:00080000:0.0:1790773047.280970:0:8899:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:0.0:1790773047.281015:0:8899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ed68380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8899:1877761495956224:0@lo:900: 00000100:00100000:0.0:1790773047.281052:0:8899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773047.281092:0:8899:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d249636300 going to sleep for 11 seconds 00000100:00100000:2.0:1790773047.281153:0:6490:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495956224 00000100:00100000:2.0:1790773047.281159:0:6490:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495956224 00000100:00100000:2.0:1790773047.281237:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790773047.281245:0:6490:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26bee9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8899:x1877761495956224:12345-0@lo:900: 00000100:00100000:2.0:1790773047.281300:0:6490:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26bee9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8899:x1877761495956224:12345-0@lo:900: Request processed in 55us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773047.281307:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1790773047.281499:0:8899:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d26ed68380 x1877761495956224/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790773063 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773047.281510:0:8899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ed68380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8899:1877761495956224:0@lo:900: 00010000:00080000:1.0:1790773047.281634:0:8905:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d25074dc00 x1877761495955840/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790773063 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773047.281644:0:8905:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1790773047.281648:0:8905:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8905:1877761495955840:0@lo:5: 00000004:00080000:1.0:1790773047.281658:0:8905:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1790773047.281684:0:8905:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8905:1877761495956352:0@lo:700: 00000100:00100000:1.0:1790773047.281711:0:8905:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773047.281740:0:8905:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d248d33780 going to sleep for 11 seconds 00000100:00100000:2.0:1790773047.281916:0:8402:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495956352 00000100:00100000:2.0:1790773047.281920:0:8402:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495956352 00000100:00100000:2.0:1790773047.281991:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790773047.281999:0:8402:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8905:x1877761495956352:12345-0@lo:700: 00000001:00080000:0.0:1790773047.298528:0:8388:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000100:00100000:1.0:1790773047.298994:0:8402:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8905:x1877761495956352:12345-0@lo:700: Request processed in 16991us (17276us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773047.299018:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1790773047.303936:0:8905:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d25074dc00 x1877761495956352/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790773063 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773047.303958:0:8905:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8905:1877761495956352:0@lo:700: 00000004:02000040:2.0:1790773047.305657:0:8905:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:0.0:1790773047.313398:0:8905:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26beea680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8905:1877761495956480:0@lo:5: 00000100:00100000:0.0:1790773047.313473:0:8905:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773047.313514:0:8905:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d249636d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790773047.313573:0:8392:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495956480 00000100:00100000:1.0:1790773047.313582:0:8392:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495956480 00000100:00100000:1.0:1790773047.313640:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790773047.313651:0:8392:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26bee9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8905:x1877761495956480:12345-0@lo:5: 00002000:00080000:1.0:1790773047.320039:0:8392:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1790773047.320059:0:8392:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:1.0:1790773047.322598:0:8392:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26bee9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8905:x1877761495956480:12345-0@lo:5: Request processed in 8943us (9119us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1790773047.322611:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1790773047.327350:0:8905:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d26beea680 x1877761495956480/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790773063 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773047.327373:0:8905:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26beea680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8905:1877761495956480:0@lo:5: 00000004:00080000:1.0:1790773047.327389:0:8905:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000020:00000004:3.0:1790773047.459601:0:8927:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790773047.459920:0:8927:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1790773048.141438:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1790773048.387842:0:8975:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790773048.387854:0:8975:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:1.0:1790773049.165506:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773049.677417:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790773049.681325:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790773049.681353:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761495956736:0@lo:41: 00000100:00100000:0.0:1790773049.681420:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773049.681482:0:7666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495956736 00000100:00100000:0.0:1790773049.681489:0:7666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495956736 00000100:00100000:0.0:1790773049.681538:0:7666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790773049.681547:0:7666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f975c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761495956736:12345-0@lo:41: 00000004:00000024:0.0:1790773049.681582:0:7666:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1790773049.681627:0:7666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f975c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761495956736:12345-0@lo:41: Request processed in 81us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773049.681635:0:7666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790773049.681681:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761495956736:0@lo:41: 00000100:00100000:3.0:1790773049.681896:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761495956608:0@lo:41: 00000100:00100000:3.0:1790773049.681929:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773049.682002:0:6483:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495956608 00000100:00100000:0.0:1790773049.682008:0:6483:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495956608 00000100:00100000:0.0:1790773049.682042:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790773049.682050:0:6483:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761495956608:12345-0@lo:41: 00000004:00000024:0.0:1790773049.682078:0:6483:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1790773049.682121:0:6483:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761495956608:12345-0@lo:41: Request processed in 72us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773049.682127:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790773049.685011:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761495956608:0@lo:41: 00010000:00010000:1.0:1790773050.190387:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773051.215725:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773052.237901:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761495957248:0@lo:400: 00000100:00100000:2.0:1790773052.237975:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773052.238031:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f96b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761495957760:0@lo:400: 00000100:00100000:2.0:1790773052.238072:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773052.238108:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1790773052.238115:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce0675b4-b0c5-48e7-b182-565e22fed04c:3604:1877761495956864:0@lo:400: 00000100:00100000:2.0:1790773052.238141:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773052.238163:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3604:1877761495957376:0@lo:400: 00000100:00100000:2.0:1790773052.238186:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773052.238220:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f96b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761495957888:0@lo:400: 00000100:00100000:2.0:1790773052.238248:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773052.238273:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3606:1877761495956992:0@lo:400: 00000100:00100000:2.0:1790773052.238296:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773052.238314:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3606:1877761495957504:0@lo:400: 00000100:00100000:2.0:1790773052.238335:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773052.238354:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1790773052.238359:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761495957120:0@lo:400: 00000100:00100000:2.0:1790773052.238381:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773052.238396:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3606:1877761495957632:0@lo:400: 00000100:00100000:2.0:1790773052.238428:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773052.241529:0:8906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495957760 00000100:00100000:1.0:1790773052.241546:0:8906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495957760 00000100:00100000:2.0:1790773052.241719:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495956864 00000100:00100000:2.0:1790773052.241724:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495956864 00000100:00100000:2.0:1790773052.241761:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1790773052.241771:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d251208850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:3604:x1877761495956864:12345-0@lo:400: 00000100:00100000:2.0:1790773052.241850:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d251208850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:3604:x1877761495956864:12345-0@lo:400: Request processed in 81us (3707us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773052.241857:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1790773052.241891:0:8394:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495957888 00000100:00100000:2.0:1790773052.241894:0:8394:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495957888 00000100:00100000:2.0:1790773052.241916:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790773052.241922:0:8394:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f969500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3604:x1877761495957888:12345-0@lo:400: 00000100:00100000:2.0:1790773052.241951:0:8394:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f969500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3604:x1877761495957888:12345-0@lo:400: Request processed in 29us (3702us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773052.241956:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790773052.241972:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495957376 00000100:00100000:2.0:1790773052.241975:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495957376 00000100:00100000:2.0:1790773052.241991:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495956992 00000100:00100000:2.0:1790773052.241993:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495956992 00000100:00100000:2.0:1790773052.242002:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495957504 00000100:00100000:2.0:1790773052.242004:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495957504 00000100:00100000:2.0:1790773052.242013:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495957632 00000100:00100000:2.0:1790773052.242015:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495957632 00000100:00100000:2.0:1790773052.242026:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790773052.242031:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f96a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3604:x1877761495957376:12345-0@lo:400: 00000100:00100000:2.0:1790773052.242073:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f96a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3604:x1877761495957376:12345-0@lo:400: Request processed in 41us (3885us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773052.242078:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790773052.242097:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790773052.242102:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f968380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1877761495956992:12345-0@lo:400: 00000100:00100000:2.0:1790773052.242129:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f968380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1877761495956992:12345-0@lo:400: Request processed in 27us (3831us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773052.242134:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790773052.242142:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790773052.242147:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f96b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1877761495957504:12345-0@lo:400: 00000100:00100000:2.0:1790773052.242168:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f96b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1877761495957504:12345-0@lo:400: Request processed in 21us (3832us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773052.242173:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790773052.242181:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790773052.242186:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1877761495957632:12345-0@lo:400: 00000100:00100000:2.0:1790773052.242221:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1877761495957632:12345-0@lo:400: Request processed in 35us (3792us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773052.242226:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:3.0:1790773052.243287:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773052.243851:0:6484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495957248 00000100:00100000:0.0:1790773052.243861:0:6484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495957248 00000100:00100000:0.0:1790773052.243895:0:6484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495957120 00000100:00100000:0.0:1790773052.243897:0:6484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495957120 00000100:00100000:0.0:1790773052.243911:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790773052.243918:0:6484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f96ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761495957248:12345-0@lo:400: 00000100:00100000:0.0:1790773052.243984:0:6484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f96ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761495957248:12345-0@lo:400: Request processed in 67us (6009us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773052.243992:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790773052.244006:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790773052.244011:0:6484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f968000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761495957120:12345-0@lo:400: 00000100:00100000:0.0:1790773052.244032:0:6484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f968000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761495957120:12345-0@lo:400: Request processed in 21us (5651us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773052.244049:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1790773052.244410:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790773052.244416:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790773052.244419:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790773052.246740:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790773052.246760:0:8906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f96bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761495957760:12345-0@lo:400: 00000100:00100000:1.0:1790773052.246851:0:8906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f96bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761495957760:12345-0@lo:400: Request processed in 101us (8779us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773052.246858:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790773052.247911:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce0675b4-b0c5-48e7-b182-565e22fed04c:3604:1877761495956864:0@lo:400: 00010000:00080000:2.0:1790773052.247939:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d27c3aad80 x1877761495957376/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773052.247951:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3604:1877761495957376:0@lo:400: 00010000:00080000:2.0:1790773052.247962:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d27f96b800 x1877761495957888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773052.247971:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f96b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761495957888:0@lo:400: 00000100:00100000:2.0:1790773052.247981:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761495957248:0@lo:400: 00010000:00080000:2.0:1790773052.247991:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d27f96b480 x1877761495957760/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773052.248010:0:3604:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1790773052.248024:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f96b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761495957760:0@lo:400: 00000100:00100000:2.0:1790773052.248110:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761495957120:0@lo:400: 00010000:00080000:2.0:1790773052.248122:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d27c3aaa00 x1877761495957632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773052.248131:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3606:1877761495957632:0@lo:400: 00010000:00080000:2.0:1790773052.248141:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d27c3ab100 x1877761495956992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773052.248149:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3606:1877761495956992:0@lo:400: 00010000:00080000:2.0:1790773052.248159:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d27c3a9500 x1877761495957504/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773052.248166:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3606:1877761495957504:0@lo:400: 00000100:00100000:3.0:1790773052.752898:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761495958016:0@lo:13: 00000100:00100000:3.0:1790773052.752975:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773052.753048:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495958016 00000100:00100000:3.0:1790773052.753057:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495958016 00000100:00100000:3.0:1790773052.753099:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790773052.753108:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761495958016:12345-0@lo:13: 00002000:00000024:3.0:1790773052.753137:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790773052.753177:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761495958016:12345-0@lo:13: Request processed in 70us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773052.753184:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1790773052.753240:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d281b9c700 x1877761495958016/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773068 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773052.753258:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761495958016:0@lo:13: 00000100:00100000:3.0:1790773052.753439:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761495958144:0@lo:13: 00000100:00100000:3.0:1790773052.753468:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773052.753629:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495958144 00000100:00100000:1.0:1790773052.754927:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495958144 00000100:00100000:1.0:1790773052.754988:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790773052.754997:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3607:x1877761495958144:12345-0@lo:13: 00002000:00000024:1.0:1790773052.755026:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790773052.755111:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3607:x1877761495958144:12345-0@lo:13: Request processed in 114us (1641us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773052.755118:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1790773052.755308:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d25074dc00 x1877761495958144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773068 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773052.755328:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761495958144:0@lo:13: 00010000:00010000:1.0:1790773053.262394:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1790773053.266451:0:8388:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:0.0:1790773054.285837:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773054.799238:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790773054.799277:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f96b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761495958272:0@lo:41: 00000100:00100000:0.0:1790773054.799344:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773054.799472:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790773054.799482:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761495958400:0@lo:41: 00000100:00100000:3.0:1790773054.799512:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773054.799571:0:6484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495958272 00000100:00100000:2.0:1790773054.799579:0:6484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495958272 00000100:00100000:2.0:1790773054.799627:0:6484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495958400 00000100:00100000:2.0:1790773054.799630:0:6484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495958400 00000100:00100000:2.0:1790773054.799644:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790773054.799653:0:6484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761495958272:12345-0@lo:41: 00000004:00000024:2.0:1790773054.799700:0:6484:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1790773054.799736:0:7666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790773054.799744:0:7666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761495958400:12345-0@lo:41: 00000100:00100000:2.0:1790773054.799755:0:6484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761495958272:12345-0@lo:41: Request processed in 103us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773054.799768:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000004:00000024:3.0:1790773054.799928:0:7666:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1790773054.799976:0:7666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761495958400:12345-0@lo:41: Request processed in 232us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773054.799983:0:7666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790773054.800033:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f96b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761495958272:0@lo:41: 00000100:00100000:2.0:1790773054.802222:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761495958400:0@lo:41: 00010000:00010000:3.0:1790773055.311293:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773056.334310:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790773057.143066:0:9473:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1790773057.143070:0:9473:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1790773057.143072:0:9473:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1790773057.147661:0:9473:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93d141fee800 00000020:01000004:2.0:1790773057.147697:0:9473:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1790773057.147714:0:9473:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1790773057.147753:0:9473:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff93d1427399c0) 00000020:00000080:2.0:1790773057.147774:0:9473:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1790773057.221967:0:9473:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1790773057.222655:0:9473:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:1.0:1790773057.257397:0:9473:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1790773057.258624:0:9473:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1790773057.258638:0:9473:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:1.0:1790773057.258649:0:9473:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xabf1cc0bc78417c2 00000020:01000004:1.0:1790773057.258656:0:9473:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1790773057.258677:0:9473:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.119@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1790773057.258807:0:9473:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.119@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1790773057.258814:0:9473:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1790773057.258847:0:9473:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1790773057.258851:0:9473:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.119@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1790773057.287401:0:9473:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.119@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790773057.287456:0:9473:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.119@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1790773057.287461:0:9473:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790773057.287463:0:9473:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790773057.287464:0:9473:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790773057.287466:0:9473:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790773057.287467:0:9473:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790773057.287469:0:9473:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790773057.287470:0:9473:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790773057.287472:0:9473:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790773057.287474:0:9473:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790773057.287475:0:9473:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790773057.287477:0:9473:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790773057.287482:0:9473:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1790773057.287484:0:9473:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790773057.287486:0:9473:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790773057.287487:0:9473:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790773057.287488:0:9473:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790773057.287489:0:9473:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790773057.287490:0:9473:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790773057.287491:0:9473:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790773057.287492:0:9473:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790773057.287494:0:9473:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790773057.287495:0:9473:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790773057.287496:0:9473:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790773057.287525:0:9473:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1790773057.287545:0:9473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f96b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:9473:1877761495958528:0@lo:253: 00000100:00100000:2.0:1790773057.287625:0:9473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773057.287700:0:9473:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c159c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790773057.288835:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495958528 00000100:00100000:1.0:1790773057.288849:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495958528 00000100:00100000:1.0:1790773057.288917:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1790773057.288927:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25120b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:9473:x1877761495958528:12345-0@lo:253: 20000000:01000000:1.0:1790773057.288984:0:6473:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1790773057.289030:0:6473:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1790773057.289038:0:6473:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1790773057.289042:0:6473:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1790773057.289373:0:6473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790773057.289512:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:1.0:1790773057.289527:0:6473:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1790773057.289546:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:1.0:1790773057.289559:0:6473:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1790773057.289576:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:1.0:1790773057.289592:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:1.0:1790773057.289703:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:1.0:1790773057.289719:0:6473:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.119@tcp 20000000:01000000:1.0:1790773057.289721:0:6473:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.119@tcp (null) (null) (null) 00000040:00080000:1.0:1790773057.289737:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:1.0:1790773057.289743:0:6473:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1790773057.289756:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:1.0:1790773057.289762:0:6473:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.119@tcp (null) (null) 00000040:00080000:1.0:1790773057.289776:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:1.0:1790773057.289782:0:6473:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1790773057.289795:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:1.0:1790773057.289810:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:1.0:1790773057.289881:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:1.0:1790773057.289892:0:6473:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.119@tcp 20000000:01000000:1.0:1790773057.289893:0:6473:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.119@tcp (null) (null) (null) 00000040:00080000:1.0:1790773057.289921:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:1.0:1790773057.289928:0:6473:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1790773057.289941:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:1.0:1790773057.289946:0:6473:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.202.119@tcp (null) (null) 00000040:00080000:1.0:1790773057.289957:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:1.0:1790773057.289962:0:6473:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1790773057.289974:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:1.0:1790773057.290004:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:1.0:1790773057.290398:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:1.0:1790773057.290410:0:6473:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.119@tcp 20000000:01000000:1.0:1790773057.290412:0:6473:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.119@tcp (null) (null) (null) 00000040:00080000:1.0:1790773057.290426:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:1.0:1790773057.290432:0:6473:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1790773057.290445:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:1.0:1790773057.290458:0:6473:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.119@tcp (null) (null) 00000040:00080000:1.0:1790773057.290474:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:1.0:1790773057.290480:0:6473:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1790773057.290492:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:1.0:1790773057.290508:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:1.0:1790773057.290520:0:6473:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1790773057.290523:0:6473:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1790773057.290526:0:6473:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1790773057.290569:0:6473:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1790773057.290571:0:6473:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1790773057.295355:0:9479:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 25 1->4: lustre sys.timeout 20000000:01000000:1.0:1790773057.295410:0:9479:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 25 2->4: lustre sys.timeout 00000040:00080000:1.0:1790773057.295428:0:9479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1790773057.295739:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1790773057.295763:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:0.0:1790773057.295771:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:0.0:1790773057.295779:0:6473:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1790773057.295781:0:6473:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1790773057.296824:0:9480:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:0.0:1790773057.296851:0:9480:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:0.0:1790773057.296874:0:9480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:1.0:1790773057.297069:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:1.0:1790773057.297093:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:1.0:1790773057.297108:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:1.0:1790773057.297123:0:6473:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1790773057.297125:0:6473:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1790773057.297511:0:9481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:0.0:1790773057.297664:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:0.0:1790773057.297679:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:0.0:1790773057.297693:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:0.0:1790773057.297707:0:6473:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1790773057.297709:0:6473:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1790773057.298475:0:9482:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 27 1->4: lustre sys.timeout 20000000:01000000:3.0:1790773057.298496:0:9482:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 27 2->4: lustre sys.timeout 00000040:00080000:3.0:1790773057.298511:0:9482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:0.0:1790773057.298721:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:0.0:1790773057.298755:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:0.0:1790773057.298772:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:0.0:1790773057.298785:0:6473:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1790773057.298787:0:6473:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1790773057.299164:0:9483:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:3.0:1790773057.299186:0:9483:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:3.0:1790773057.299311:0:9483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:0.0:1790773057.299514:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:0.0:1790773057.299536:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:0.0:1790773057.299550:0:6473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 10000000:01000000:0.0:1790773057.299568:0:6473:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1790773057.299590:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93d26c4a2a00/0xabf1cc0bc78417c9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773057.299608:0:6473:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d241527e00/0xabf1cc0bc78416bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78416b8 expref: 21 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773057.299628:0:6473:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d24166fc00/0xabf1cc0bc78416e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78416e2 expref: 21 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773057.299635:0:6473:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d241527c00/0xabf1cc0bc7841728 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7841721 expref: 21 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773057.299642:0:6473:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d241527400/0xabf1cc0bc7841744 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc784173d expref: 21 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773057.299648:0:6473:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d26c4a3800/0xabf1cc0bc784176e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7841767 expref: 21 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773057.299654:0:6473:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d27b12a600/0xabf1cc0bc784178a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7841783 expref: 21 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773057.299660:0:6473:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d27b12a200/0xabf1cc0bc78417b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78417a6 expref: 21 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773057.299668:0:6473:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93d26c4a2a00/0xabf1cc0bc78417c9 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773057.299707:0:6473:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d27b12a200/0xabf1cc0bc78417b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc78417a6 expref: 21 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773057.299724:0:6473:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d27b12a200/0xabf1cc0bc78417b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc78417a6 expref: 21 pid: 6473 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773057.299801:0:6473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f975880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6473:1877761495958656:0@lo:104: 00000100:00100000:0.0:1790773057.299867:0:6473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790773057.299964:0:6473:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d27b12a600/0xabf1cc0bc784178a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc7841783 expref: 21 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773057.299972:0:6473:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d27b12a600/0xabf1cc0bc784178a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc7841783 expref: 21 pid: 6473 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773057.299981:0:6473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f975f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6473:1877761495958784:0@lo:104: 00000100:00100000:0.0:1790773057.300036:0:6473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790773057.301120:0:6473:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d26c4a3800/0xabf1cc0bc784176e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc7841767 expref: 21 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773057.301133:0:6473:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d26c4a3800/0xabf1cc0bc784176e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc7841767 expref: 21 pid: 6472 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773057.301145:0:6473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f976300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6473:1877761495958912:0@lo:104: 00000100:00100000:0.0:1790773057.301181:0:6473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773057.301298:0:6462:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495958656 00000100:00100000:1.0:1790773057.301307:0:6462:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495958656 00000100:00100000:1.0:1790773057.301346:0:6462:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495958784 00000100:00100000:1.0:1790773057.301349:0:6462:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495958784 00000100:00100000:1.0:1790773057.301363:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790773057.301373:0:6462:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f976a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+4:6473:x1877761495958656:12345-0@lo:104: 00010000:00010000:1.0:1790773057.301387:0:6462:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d241526e00/0xabf1cc0bc78417a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc78417b4 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773057.301536:0:6462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790773057.301542:0:6462:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f976a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+4:6473:x1877761495958656:12345-0@lo:104: Request processed in 171us (1675us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773057.301563:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790773057.301581:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790773057.301588:0:6462:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f974700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+3:6473:x1877761495958784:12345-0@lo:104: 00010000:00010000:1.0:1790773057.301596:0:6462:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d241526c00/0xabf1cc0bc7841783 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc784178a expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773057.301648:0:6467:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790773057.301656:0:6467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d241526e00/0xabf1cc0bc78417a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc78417b4 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773057.301664:0:6467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d241526e00 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:2.0:1790773057.301669:0:6467:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d241526e00/0xabf1cc0bc78417a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc78417b4 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773057.301678:0:6467:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d241526e00/0xabf1cc0bc78417a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc78417b4 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790773057.301686:0:6467:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d241526e00/0xabf1cc0bc78417a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc78417b4 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790773057.301692:0:6467:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790773057.301847:0:6473:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d241527400/0xabf1cc0bc7841744 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc784173d expref: 21 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773057.301856:0:6473:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d241527400/0xabf1cc0bc7841744 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc784173d expref: 21 pid: 6471 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773057.301865:0:6473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f974e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6473:1877761495959168:0@lo:104: 00000100:00100000:0.0:1790773057.301887:0:6473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790773057.301902:0:6473:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d241527c00/0xabf1cc0bc7841728 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc7841721 expref: 21 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773057.301909:0:6473:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d241527c00/0xabf1cc0bc7841728 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc7841721 expref: 21 pid: 6472 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773057.301917:0:6473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f977800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6473:1877761495959296:0@lo:104: 00000100:00100000:0.0:1790773057.301945:0:6473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790773057.301963:0:6473:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d24166fc00/0xabf1cc0bc78416e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc78416e2 expref: 21 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773057.301970:0:6473:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d24166fc00/0xabf1cc0bc78416e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc78416e2 expref: 21 pid: 6473 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773057.301978:0:6473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f976d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6473:1877761495959424:0@lo:104: 00010000:00010000:0.0:1790773057.302027:0:6473:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d241527e00/0xabf1cc0bc78416bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc78416b8 expref: 21 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773057.302035:0:6473:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d241527e00/0xabf1cc0bc78416bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc78416b8 expref: 21 pid: 6472 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773057.302044:0:6473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f977b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6473:1877761495959552:0@lo:104: 00000100:00100000:0.0:1790773057.302065:0:6473:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c380a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790773057.302088:0:6473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f975880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6473:1877761495958656:0@lo:104: 00000100:00100000:0.0:1790773057.302097:0:6473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f975f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6473:1877761495958784:0@lo:104: 00000100:00100000:3.0:1790773057.302138:0:6461:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495958912 00000100:00100000:3.0:1790773057.302144:0:6461:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495958912 00000100:00100000:3.0:1790773057.302174:0:6461:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1790773057.302192:0:6461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773057.302234:0:6461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773057.302244:0:6461:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1790773057.302249:0:6461:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:2.0:1790773057.302561:0:6467:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d241526e00/0xabf1cc0bc78417a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78417b4 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773057.302569:0:6467:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790773057.302597:0:6467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d241526e00/0xabf1cc0bc78417a6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78417b4 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773057.302605:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d241526e00/0xabf1cc0bc78417a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78417b4 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773057.302617:0:6467:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790773057.302621:0:6467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d241526c00/0xabf1cc0bc7841783 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc784178a expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773057.302627:0:6467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d241526c00 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:2.0:1790773057.302637:0:6467:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d241526c00/0xabf1cc0bc7841783 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc784178a expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773057.302645:0:6467:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d241526c00/0xabf1cc0bc7841783 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc784178a expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790773057.302651:0:6467:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d241526c00/0xabf1cc0bc7841783 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc784178a expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790773057.302657:0:6467:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790773057.302680:0:6467:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d241526c00/0xabf1cc0bc7841783 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc784178a expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773057.302687:0:6467:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790773057.302693:0:6467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d241526c00/0xabf1cc0bc7841783 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc784178a expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773057.302699:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d241526c00/0xabf1cc0bc7841783 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc784178a expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773057.302707:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773057.302709:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773057.302711:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773057.302723:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f969880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce0675b4-b0c5-48e7-b182-565e22fed04c:3607:1877761495959680:0@lo:103: 00000100:00100000:3.0:1790773057.302813:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f969c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce0675b4-b0c5-48e7-b182-565e22fed04c:3606:1877761495959040:0@lo:103: 00000100:00100000:3.0:1790773057.302849:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773057.302936:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773057.302979:0:8410:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495959040 00000100:00100000:2.0:1790773057.302997:0:8410:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495959040 00010000:00010000:2.0:1790773057.303020:0:8410:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d27b12a200/0xabf1cc0bc78417b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc78417a6 expref: 22 pid: 6473 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773057.303041:0:8410:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495959680 00000100:00100000:2.0:1790773057.303051:0:8410:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495959680 00010000:00010000:2.0:1790773057.303064:0:8410:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d27b12a600/0xabf1cc0bc784178a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7841783 expref: 23 pid: 6473 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773057.303086:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790773057.303094:0:8410:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ce0675b4-b0c5-48e7-b182-565e22fed04c+23:3606:x1877761495959040:12345-0@lo:103: 00010000:00010000:2.0:1790773057.303107:0:8410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790773057.303112:0:8410:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d27b12a200/0xabf1cc0bc78417b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc78417a6 expref: 23 pid: 6473 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773057.303123:0:8410:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d27b12a200/0xabf1cc0bc78417b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc78417a6 expref: 23 pid: 6473 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773057.303136:0:8410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d27b12a200/0xabf1cc0bc78417b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc78417a6 expref: 23 pid: 6473 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773057.303148:0:8410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790773057.303179:0:8410:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ce0675b4-b0c5-48e7-b182-565e22fed04c+22:3606:x1877761495959040:12345-0@lo:103: Request processed in 86us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773057.303185:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790773057.303200:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790773057.303235:0:8410:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f96aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:3607:x1877761495959680:12345-0@lo:103: 00010000:00010000:2.0:1790773057.303242:0:8410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790773057.303246:0:8410:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d27b12a600/0xabf1cc0bc784178a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7841783 expref: 21 pid: 6473 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773057.303256:0:8410:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d27b12a600/0xabf1cc0bc784178a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc7841783 expref: 21 pid: 6473 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773057.303264:0:8410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d27b12a600/0xabf1cc0bc784178a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc7841783 expref: 21 pid: 6473 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773057.303279:0:8410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790773057.303306:0:8410:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f96aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ce0675b4-b0c5-48e7-b182-565e22fed04c+20:3607:x1877761495959680:12345-0@lo:103: Request processed in 74us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773057.303312:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790773057.303347:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f969c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce0675b4-b0c5-48e7-b182-565e22fed04c:3606:1877761495959040:0@lo:103: 00000100:00100000:2.0:1790773057.303369:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f969880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce0675b4-b0c5-48e7-b182-565e22fed04c:3607:1877761495959680:0@lo:103: 00000100:00100000:0.0:1790773057.303557:0:6461:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495959168 00000100:00100000:0.0:1790773057.303562:0:6461:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495959168 00000100:00100000:0.0:1790773057.303582:0:6461:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1790773057.303588:0:6461:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495959296 00000100:00100000:0.0:1790773057.303591:0:6461:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495959296 00000100:00100000:0.0:1790773057.303601:0:6461:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1790773057.303605:0:6461:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495959424 00000100:00100000:0.0:1790773057.303607:0:6461:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495959424 00000100:00100000:0.0:1790773057.303615:0:6461:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1790773057.303619:0:6461:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495959552 00000100:00100000:0.0:1790773057.303621:0:6461:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495959552 00000100:00100000:3.0:1790773057.303723:0:9484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790773057.303744:0:9484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f974a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+8:6473:x1877761495958912:12345-0@lo:104: 00010000:00010000:3.0:1790773057.303755:0:9484:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d241527200/0xabf1cc0bc7841767 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc784176e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.303811:0:9484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790773057.303816:0:9484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f974a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+8:6473:x1877761495958912:12345-0@lo:104: Request processed in 75us (2635us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773057.303830:0:9484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790773057.303846:0:9484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790773057.303852:0:9484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f977480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+7:6473:x1877761495959168:12345-0@lo:104: 00010000:00010000:3.0:1790773057.303860:0:9484:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d241527600/0xabf1cc0bc784173d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7841744 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.303896:0:9484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790773057.303901:0:9484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f977480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+7:6473:x1877761495959168:12345-0@lo:104: Request processed in 50us (2013us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773057.303906:0:9484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790773057.303918:0:9484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790773057.303924:0:9484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d141cd5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+6:6473:x1877761495959296:12345-0@lo:104: 00010000:00010000:3.0:1790773057.303930:0:9484:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d24166ee00/0xabf1cc0bc7841721 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7841728 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.303959:0:9484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1790773057.303964:0:9484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d141cd5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+6:6473:x1877761495959296:12345-0@lo:104: Request processed in 41us (2019us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773057.303969:0:9484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790773057.303981:0:9484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790773057.303998:0:9484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+5:6473:x1877761495959424:12345-0@lo:104: 00010000:00010000:3.0:1790773057.304006:0:9484:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d27b12ac00/0xabf1cc0bc78416e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc78416e9 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.304046:0:9484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1790773057.304051:0:9484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+5:6473:x1877761495959424:12345-0@lo:104: Request processed in 66us (1859us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773057.304063:0:9484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790773057.304077:0:9484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790773057.304083:0:9484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+4:6473:x1877761495959552:12345-0@lo:104: 00010000:00010000:3.0:1790773057.304090:0:9484:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d24166ea00/0xabf1cc0bc78416b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc78416bf expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.304120:0:9484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1790773057.304125:0:9484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+4:6473:x1877761495959552:12345-0@lo:104: Request processed in 44us (1891us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773057.304130:0:9484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790773057.304273:0:6473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f976300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6473:1877761495958912:0@lo:104: 00000100:00100000:0.0:1790773057.304290:0:6473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f974e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6473:1877761495959168:0@lo:104: 00000100:00100000:0.0:1790773057.304296:0:6473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f977800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6473:1877761495959296:0@lo:104: 00000100:00100000:0.0:1790773057.304303:0:6473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f976d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6473:1877761495959424:0@lo:104: 00000100:00100000:0.0:1790773057.304310:0:6473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f977b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6473:1877761495959552:0@lo:104: 00010000:00010000:0.0:1790773057.304335:0:6473:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93d26c4a2a00/0xabf1cc0bc78417c9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.304408:0:6466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1790773057.304484:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d241527200/0xabf1cc0bc7841767 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc784176e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.304493:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d241527200 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:3.0:1790773057.304497:0:6466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d241527200/0xabf1cc0bc7841767 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc784176e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.304505:0:6466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d241527200/0xabf1cc0bc7841767 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc784176e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790773057.304512:0:6466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d241527200/0xabf1cc0bc7841767 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc784176e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773057.304518:0:6466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790773057.304583:0:6466:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d241527200/0xabf1cc0bc7841767 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc784176e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.304590:0:6466:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790773057.304612:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d241527200/0xabf1cc0bc7841767 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc784176e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.304618:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d241527200/0xabf1cc0bc7841767 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc784176e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.304629:0:6466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1790773057.304632:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d241527600/0xabf1cc0bc784173d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7841744 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.304638:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d241527600 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:3.0:1790773057.304641:0:6466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d241527600/0xabf1cc0bc784173d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc7841744 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.304648:0:6466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d241527600/0xabf1cc0bc784173d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc7841744 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790773057.304654:0:6466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d241527600/0xabf1cc0bc784173d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc7841744 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773057.304659:0:6466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790773057.304713:0:8409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790773057.304718:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d24166ee00/0xabf1cc0bc7841721 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7841728 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773057.304735:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d24166ee00 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:2.0:1790773057.304739:0:8409:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d24166ee00/0xabf1cc0bc7841721 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc7841728 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773057.304746:0:8409:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d24166ee00/0xabf1cc0bc7841721 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc7841728 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790773057.304752:0:8409:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d24166ee00/0xabf1cc0bc7841721 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc7841728 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790773057.304758:0:8409:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790773057.304845:0:6462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1790773057.304855:0:6462:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f974700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+3:6473:x1877761495958784:12345-0@lo:104: Request processed in 3266us (4817us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773057.304862:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:3.0:1790773057.305001:0:6466:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d241527600/0xabf1cc0bc784173d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841744 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.305008:0:6466:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790773057.305014:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d241527600/0xabf1cc0bc784173d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841744 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.305020:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d241527600/0xabf1cc0bc784173d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841744 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.305029:0:6466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790773057.305038:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d27b12ac00/0xabf1cc0bc78416e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc78416e9 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.305043:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12ac00 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:3.0:1790773057.305045:0:6466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d27b12ac00/0xabf1cc0bc78416e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc78416e9 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.305052:0:6466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d27b12ac00/0xabf1cc0bc78416e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc78416e9 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790773057.305058:0:6466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d27b12ac00/0xabf1cc0bc78416e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc78416e9 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773057.305063:0:6466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790773057.305078:0:6466:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d27b12ac00/0xabf1cc0bc78416e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78416e9 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.305084:0:6466:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1790773057.305129:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce0675b4-b0c5-48e7-b182-565e22fed04c:3606:1877761495960064:0@lo:103: 00000100:00100000:1.0:1790773057.305174:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790773057.305311:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d27b12ac00/0xabf1cc0bc78416e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78416e9 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.305319:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d27b12ac00/0xabf1cc0bc78416e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78416e9 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.305329:0:6466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790773057.305332:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d24166ea00/0xabf1cc0bc78416b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc78416bf expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.305338:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d24166ea00 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:3.0:1790773057.305341:0:6466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d24166ea00/0xabf1cc0bc78416b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc78416bf expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.305358:0:6466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d24166ea00/0xabf1cc0bc78416b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc78416bf expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790773057.305363:0:6466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d24166ea00/0xabf1cc0bc78416b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc78416bf expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773057.305368:0:6466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790773057.305385:0:6466:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d24166ea00/0xabf1cc0bc78416b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78416bf expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.305390:0:6466:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1790773057.305438:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce0675b4-b0c5-48e7-b182-565e22fed04c:3607:1877761495960192:0@lo:103: 00000100:00100000:0.0:1790773057.305469:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773057.305505:0:6463:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495960064 00000100:00100000:0.0:1790773057.305512:0:6463:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495960064 00010000:00010000:0.0:1790773057.305533:0:6463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d24166fc00/0xabf1cc0bc78416e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc78416e2 expref: 20 pid: 6473 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773057.305554:0:6463:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495960192 00000100:00100000:0.0:1790773057.305557:0:6463:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495960192 00010000:00010000:0.0:1790773057.305568:0:6463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d241527e00/0xabf1cc0bc78416bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc78416b8 expref: 21 pid: 6472 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773057.305580:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790773057.305587:0:6463:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:3606:x1877761495960064:12345-0@lo:103: 00010000:00010000:0.0:1790773057.305598:0:6463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773057.305602:0:6463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d24166fc00/0xabf1cc0bc78416e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc78416e2 expref: 21 pid: 6473 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773057.305612:0:6463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d24166fc00/0xabf1cc0bc78416e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc78416e2 expref: 21 pid: 6473 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773057.305636:0:6463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d24166fc00/0xabf1cc0bc78416e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc78416e2 expref: 21 pid: 6473 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773057.305647:0:6463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790773057.305852:0:8409:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d24166ee00/0xabf1cc0bc7841721 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841728 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773057.305859:0:8409:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790773057.305863:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d24166ee00/0xabf1cc0bc7841721 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841728 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773057.305880:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d24166ee00/0xabf1cc0bc7841721 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841728 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773057.305891:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773057.305893:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773057.305895:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773057.305907:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce0675b4-b0c5-48e7-b182-565e22fed04c:3604:1877761495959808:0@lo:103: 00000100:00100000:2.0:1790773057.305936:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773057.305953:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f969880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce0675b4-b0c5-48e7-b182-565e22fed04c:3604:1877761495960320:0@lo:103: 00000100:00100000:2.0:1790773057.305970:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773057.305982:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790773057.306000:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce0675b4-b0c5-48e7-b182-565e22fed04c:3604:1877761495959936:0@lo:103: 00000100:00100000:2.0:1790773057.306019:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790773057.306054:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773057.306094:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d24166ea00/0xabf1cc0bc78416b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78416bf expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.306100:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d24166ea00/0xabf1cc0bc78416b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78416bf expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.306109:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773057.306110:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773057.306111:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773057.306120:0:6464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495959808 00000100:00100000:3.0:1790773057.306122:0:6464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495959808 00010000:00010000:3.0:1790773057.306133:0:6464:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d26c4a3800/0xabf1cc0bc784176e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7841767 expref: 21 pid: 6472 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773057.306142:0:6464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495960320 00000100:00100000:3.0:1790773057.306143:0:6464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495960320 00010000:00010000:3.0:1790773057.306151:0:6464:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d241527c00/0xabf1cc0bc7841728 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7841721 expref: 22 pid: 6472 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773057.306160:0:6464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495959936 00000100:00100000:3.0:1790773057.306169:0:6464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495959936 00010000:00010000:3.0:1790773057.306182:0:6464:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d241527400/0xabf1cc0bc7841744 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc784173d expref: 23 pid: 6471 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773057.306196:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790773057.306260:0:6464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ca050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+23:3607:x1877761495960192:12345-0@lo:103: 00010000:00010000:3.0:1790773057.306269:0:6464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773057.306273:0:6464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d241527e00/0xabf1cc0bc78416bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc78416b8 expref: 23 pid: 6472 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.306282:0:6464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d241527e00/0xabf1cc0bc78416bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc78416b8 expref: 23 pid: 6472 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.306292:0:6464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d241527e00/0xabf1cc0bc78416bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc78416b8 expref: 23 pid: 6472 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.306298:0:6464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790773057.306326:0:6464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ca050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+22:3607:x1877761495960192:12345-0@lo:103: Request processed in 125us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773057.306331:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790773057.306341:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790773057.306345:0:6464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f969c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:3604:x1877761495959808:12345-0@lo:103: 00010000:00010000:3.0:1790773057.306350:0:6464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773057.306352:0:6464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d26c4a3800/0xabf1cc0bc784176e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7841767 expref: 21 pid: 6472 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.306358:0:6464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d26c4a3800/0xabf1cc0bc784176e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc7841767 expref: 21 pid: 6472 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.306363:0:6464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d26c4a3800/0xabf1cc0bc784176e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc7841767 expref: 21 pid: 6472 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.306373:0:6464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790773057.306390:0:6464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f969c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+20:3604:x1877761495959808:12345-0@lo:103: Request processed in 45us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773057.306393:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790773057.306402:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790773057.306405:0:6464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f969f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+19:3604:x1877761495960320:12345-0@lo:103: 00010000:00010000:3.0:1790773057.306410:0:6464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773057.306412:0:6464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d241527c00/0xabf1cc0bc7841728 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7841721 expref: 19 pid: 6472 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.306417:0:6464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d241527c00/0xabf1cc0bc7841728 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc7841721 expref: 19 pid: 6472 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.306433:0:6464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d241527c00/0xabf1cc0bc7841728 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc7841721 expref: 19 pid: 6472 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.306438:0:6464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790773057.306451:0:6464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f969f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:3604:x1877761495960320:12345-0@lo:103: Request processed in 45us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773057.306454:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790773057.306462:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790773057.306465:0:6464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f968700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:3604:x1877761495959936:12345-0@lo:103: 00010000:00010000:3.0:1790773057.306469:0:6464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773057.306471:0:6464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d241527400/0xabf1cc0bc7841744 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc784173d expref: 17 pid: 6471 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.306476:0:6464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d241527400/0xabf1cc0bc7841744 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc784173d expref: 17 pid: 6471 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.306487:0:6464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d241527400/0xabf1cc0bc7841744 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc784173d expref: 17 pid: 6471 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.306498:0:6464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93d26c4a2a00/0xabf1cc0bc78417c9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.306508:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d26c4a2a00/0xabf1cc0bc78417c9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.306521:0:6464:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d26c4a2a00/0xabf1cc0bc78417c9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.306528:0:6464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d26c4a2a00/0xabf1cc0bc78417c9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.306535:0:6464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93d26c4a2a00/0xabf1cc0bc78417c9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.306542:0:6464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93d26c4a2a00/0xabf1cc0bc78417c9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.306547:0:6464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a2a00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:3.0:1790773057.306550:0:6464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93d26c4a2a00/0xabf1cc0bc78417c9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.306558:0:6464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93d26c4a2a00/0xabf1cc0bc78417c9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.306573:0:6464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93d26c4a2a00/0xabf1cc0bc78417c9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.306592:0:6464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790773057.306611:0:6464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f968700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:3604:x1877761495959936:12345-0@lo:103: Request processed in 145us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773057.306615:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790773057.306716:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce0675b4-b0c5-48e7-b182-565e22fed04c:3604:1877761495959936:0@lo:103: 00000100:00100000:2.0:1790773057.306726:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce0675b4-b0c5-48e7-b182-565e22fed04c:3604:1877761495959808:0@lo:103: 00000100:00100000:2.0:1790773057.306746:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f969880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce0675b4-b0c5-48e7-b182-565e22fed04c:3604:1877761495960320:0@lo:103: 00000100:00100000:2.0:1790773057.306767:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce0675b4-b0c5-48e7-b182-565e22fed04c:3607:1877761495960192:0@lo:103: 00000100:00100000:0.0:1790773057.306946:0:6463:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:3606:x1877761495960064:12345-0@lo:103: Request processed in 1360us (1771us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773057.306952:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:0.0:1790773057.307020:0:6473:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93d26c4a2a00/0xabf1cc0bc78417c9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773057.307028:0:6473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93d26c4a2a00/0xabf1cc0bc78417c9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773057.307034:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d26c4a2a00/0xabf1cc0bc78417c9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790773057.307047:0:6473:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1790773057.307890:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce0675b4-b0c5-48e7-b182-565e22fed04c:3606:1877761495960064:0@lo:103: 00000100:00100000:0.0:1790773057.309643:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25120b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+14:9473:x1877761495958528:12345-0@lo:253: Request processed in 20709us (22010us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773057.309658:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1790773057.309852:0:9473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f96b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:9473:1877761495958528:0@lo:253: 10000000:01000000:2.0:1790773057.309867:0:9473:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1790773057.309871:0:9473:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790773057.309872:0:9473:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790773057.309874:0:9473:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790773057.309875:0:9473:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1790773057.309887:0:9473:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790773057.309889:0:9473:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790773057.309891:0:9473:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790773057.309892:0:9473:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1790773057.309894:0:9473:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790773057.309896:0:9473:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790773057.309918:0:9473:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93d141fee800 from lustre-OST0001 10000000:01000000:2.0:1790773057.309950:0:9473:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1790773057.309953:0:9473:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1790773057.309962:0:9473:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93d262660000 local copy 10000000:01000000:2.0:1790773057.309968:0:9473:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1790773057.310023:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26efc5e00/0xabf1cc0bc78417d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773057.310035:0:9473:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.119@tcp lock: ffff93d26efc5e00/0xabf1cc0bc78417d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773057.310046:0:9473:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d26efc5e00/0xabf1cc0bc78417d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773057.310065:0:9473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f96b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:9473:1877761495960448:0@lo:101: 00000100:00100000:2.0:1790773057.310105:0:9473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773057.310193:0:9473:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c159000 going to sleep for 11 seconds 00000100:00100000:1.0:1790773057.310493:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495960448 00000100:00100000:1.0:1790773057.310500:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495960448 00000100:00100000:1.0:1790773057.310545:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1790773057.310556:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25120ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+14:9473:x1877761495960448:12345-0@lo:101: 00010000:00010000:1.0:1790773057.310571:0:6472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773057.310585:0:6472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d27b12be00/0xabf1cc0bc78417d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc78417d0 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773057.310608:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d27b12be00/0xabf1cc0bc78417d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc78417d0 expref: 15 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773057.310618:0:6472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d27b12be00/0xabf1cc0bc78417d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78417d0 expref: 15 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773057.310637:0:6472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12be00, rc 0) 00000100:00100000:1.0:1790773057.310688:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25120ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:9473:x1877761495960448:12345-0@lo:101: Request processed in 135us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773057.310694:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1790773057.310764:0:9473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f96b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:9473:1877761495960448:0@lo:101: 00010000:00010000:0.0:1790773057.310778:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d26efc5e00/0xabf1cc0bc78417d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xabf1cc0bc78417d7 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773057.310786:0:9473:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d26efc5e00/0xabf1cc0bc78417d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xabf1cc0bc78417d7 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773057.310881:0:9473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f977b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:9473:1877761495960576:0@lo:501: 00000100:00100000:0.0:1790773057.310918:0:9473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773057.310949:0:9473:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2500ed540 going to sleep for 11 seconds 00000100:00100000:1.0:1790773057.311072:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495960576 00000100:00100000:1.0:1790773057.311076:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495960576 00000100:00100000:1.0:1790773057.311109:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1790773057.311115:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d251209450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:9473:x1877761495960576:12345-0@lo:501: 00000100:00100000:1.0:1790773057.311172:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d251209450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:9473:x1877761495960576:12345-0@lo:501: Request processed in 57us (253us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790773057.311178:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1790773057.311393:0:9473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f977b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:9473:1877761495960576:0@lo:501: 10000000:01000000:0.0:1790773057.311406:0:9473:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.119@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1790773057.311434:0:9473:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.119@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1790773057.311440:0:9473:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26efc5e00/0xabf1cc0bc78417d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xabf1cc0bc78417d7 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773057.311448:0:9473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26efc5e00/0xabf1cc0bc78417d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xabf1cc0bc78417d7 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773057.311455:0:9473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffff93d26efc5e00/0xabf1cc0bc78417d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xabf1cc0bc78417d7 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773057.311478:0:9473:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1790773057.311523:0:9473:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93d141fee800 10000000:01000000:0.0:1790773057.311528:0:9473:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1790773057.311533:0:9473:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1790773057.311536:0:9473:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790773057.311540:0:9473:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1790773057.311542:0:9473:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1790773057.311559:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc78417de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773057.311566:0:9473:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc78417de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773057.311575:0:9473:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc78417de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773057.311599:0:9473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f977b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:9473:1877761495960704:0@lo:101: 00000100:00100000:0.0:1790773057.311624:0:9473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773057.311650:0:9473:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ef8cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1790773057.311846:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495960704 00000100:00100000:1.0:1790773057.311852:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495960704 00000100:00100000:1.0:1790773057.311884:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1790773057.311891:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d251208c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:9473:x1877761495960704:12345-0@lo:101: 00010000:00010000:1.0:1790773057.311899:0:6471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773057.311909:0:6471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d27b12bc00/0xabf1cc0bc78417e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc78417de expref: -99 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773057.311924:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d27b12bc00/0xabf1cc0bc78417e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc78417de expref: 16 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773057.311933:0:6471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d27b12bc00/0xabf1cc0bc78417e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78417de expref: 16 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773057.311940:0:6471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12bc00, rc 0) 00000100:00100000:1.0:1790773057.311979:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d251208c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:9473:x1877761495960704:12345-0@lo:101: Request processed in 88us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773057.312003:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00010000:00010000:3.0:1790773057.312065:0:8409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790773057.312074:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d26efc5e00/0xabf1cc0bc78417d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xabf1cc0bc78417d7 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.312082:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc5e00 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:3.0:1790773057.312086:0:8409:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d26efc5e00/0xabf1cc0bc78417d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xabf1cc0bc78417d7 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.312094:0:8409:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d26efc5e00/0xabf1cc0bc78417d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xabf1cc0bc78417d7 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790773057.312101:0:8409:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d26efc5e00/0xabf1cc0bc78417d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xabf1cc0bc78417d7 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773057.312106:0:8409:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790773057.312126:0:8409:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d26efc5e00/0xabf1cc0bc78417d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xabf1cc0bc78417d7 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.312132:0:8409:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790773057.312159:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d26efc5e00/0xabf1cc0bc78417d0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xabf1cc0bc78417d7 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.312167:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d26efc5e00/0xabf1cc0bc78417d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xabf1cc0bc78417d7 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.312190:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773057.312192:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773057.312194:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773057.312269:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce0675b4-b0c5-48e7-b182-565e22fed04c:3605:1877761495960832:0@lo:103: 00000100:00100000:1.0:1790773057.312299:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773057.312376:0:6464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495960832 00000100:00100000:3.0:1790773057.312380:0:6464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495960832 00000100:00100000:3.0:1790773057.312430:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790773057.312437:0:6464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:3605:x1877761495960832:12345-0@lo:103: 00010000:00010000:3.0:1790773057.312446:0:6464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773057.312457:0:6464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d27b12be00/0xabf1cc0bc78417d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xabf1cc0bc78417d0 expref: 16 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.312467:0:6464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790773057.312497:0:6464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:3605:x1877761495960832:12345-0@lo:103: Request processed in 60us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773057.312503:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790773057.312560:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce0675b4-b0c5-48e7-b182-565e22fed04c:3605:1877761495960832:0@lo:103: 00000100:00100000:0.0:1790773057.312689:0:9473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f977b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:9473:1877761495960704:0@lo:101: 00010000:00010000:0.0:1790773057.312703:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc78417de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78417e5 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773057.312712:0:9473:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc78417de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc78417e5 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773057.312911:0:9473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f977b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:9473:1877761495960960:0@lo:501: 00000100:00100000:0.0:1790773057.312940:0:9473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773057.312962:0:9473:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ef8cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1790773057.313010:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495960960 00000100:00100000:1.0:1790773057.313015:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495960960 00000100:00100000:1.0:1790773057.313047:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1790773057.313053:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26be9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:9473:x1877761495960960:12345-0@lo:501: 00000100:00100000:1.0:1790773057.313158:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26be9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:9473:x1877761495960960:12345-0@lo:501: Request processed in 104us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773057.313165:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1790773057.313321:0:9473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f977b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:9473:1877761495960960:0@lo:501: 00000100:00100000:0.0:1790773057.313346:0:9473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f977b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:9473:1877761495961088:0@lo:503: 00000100:00100000:0.0:1790773057.313392:0:9473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773057.313430:0:9473:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ef8cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1790773057.313522:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495961088 00000100:00100000:1.0:1790773057.313527:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495961088 00000100:00100000:1.0:1790773057.313556:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1790773057.313562:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26be9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:9473:x1877761495961088:12345-0@lo:503: 00000100:00100000:1.0:1790773057.313658:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26be9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:9473:x1877761495961088:12345-0@lo:503: Request processed in 95us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773057.313664:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1790773057.313844:0:9473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f977b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:9473:1877761495961088:0@lo:503: 00000040:00080000:0.0:1790773057.314105:0:9473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790773057.314173:0:9473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f977b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:9473:1877761495961216:0@lo:502: 00000100:00100000:0.0:1790773057.314310:0:9473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773057.314358:0:9473:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d14265b600 going to sleep for 11 seconds 00000100:00100000:3.0:1790773057.314541:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495961216 00000100:00100000:3.0:1790773057.314547:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495961216 00000100:00100000:3.0:1790773057.314615:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1790773057.314623:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26be9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:9473:x1877761495961216:12345-0@lo:502: 00000100:00100000:3.0:1790773057.314831:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26be9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:9473:x1877761495961216:12345-0@lo:502: Request processed in 208us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773057.314839:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1790773057.314977:0:9473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f977b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:9473:1877761495961216:0@lo:502: 00000040:00080000:0.0:1790773057.315366:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1790773057.315407:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1790773057.315499:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1790773057.315516:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1790773057.315530:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1790773057.315544:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1790773057.315569:0:9473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f977b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:9473:1877761495961344:0@lo:502: 00000100:00100000:0.0:1790773057.315611:0:9473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773057.315798:0:9473:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d14265b600 going to sleep for 11 seconds 00000100:00100000:3.0:1790773057.315885:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495961344 00000100:00100000:3.0:1790773057.315891:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495961344 00000100:00100000:3.0:1790773057.315930:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1790773057.315938:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26be9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:9473:x1877761495961344:12345-0@lo:502: 00000100:00100000:3.0:1790773057.316084:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26be9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:9473:x1877761495961344:12345-0@lo:502: Request processed in 146us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773057.316097:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1790773057.316360:0:9473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f977b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:9473:1877761495961344:0@lo:502: 00000040:00080000:3.0:1790773057.316551:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1790773057.316561:0:9473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:1.0:1790773057.317484:0:9485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790773057.317493:0:9485:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1790773057.317501:0:9485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790773057.317503:0:9485:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1790773057.317509:0:9485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790773057.317524:0:9485:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff93d26ec219c0) 00000020:00000080:1.0:1790773057.317547:0:9485:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:1.0:1790773057.317554:0:9485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1790773057.317617:0:9485:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93d141fee800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1790773057.317634:0:9485:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:1.0:1790773057.317641:0:9485:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xabf1cc0bc78417f3 00010000:00010000:0.0:1790773057.323905:0:9485:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:0.0:1790773057.324321:0:9485:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1790773057.327605:0:9485:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1790773057.328091:0:9485:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1790773057.333183:0:9485:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1790773057.339927:0:9485:0:(osd_compat.c:1354:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1790773057.352390:0:9485:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1790773057.354149:0:9485:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1790773057.354162:0:9485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790773057.354169:0:9485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790773057.354172:0:9485:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1790773057.354175:0:9485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790773057.354179:0:9485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790773057.354180:0:9485:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790773057.354183:0:9485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790773057.354186:0:9485:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1790773057.354239:0:9485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790773057.354243:0:9485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790773057.354244:0:9485:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:1.0:1790773057.354248:0:9485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1790773057.354458:0:9473:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1790773057.354516:0:9473:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1790773057.354537:0:9473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc78417de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78417e5 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.354549:0:9473:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc78417de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78417e5 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773057.354557:0:9473:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d141fee800 from 1 10000000:01000000:3.0:1790773057.354560:0:9473:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790773057.354598:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d24166ea00/0xabf1cc0bc78417fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.354606:0:9473:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d24166ea00/0xabf1cc0bc78417fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.354617:0:9473:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d24166ea00/0xabf1cc0bc78417fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773057.354642:0:9473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:9473:1877761495961472:0@lo:101: 00000100:00100000:3.0:1790773057.354725:0:9473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773057.354781:0:9473:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d248d33e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790773057.354946:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495961472 00000100:00100000:1.0:1790773057.354954:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495961472 00000100:00100000:1.0:1790773057.355022:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1790773057.355032:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26be9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:9473:x1877761495961472:12345-0@lo:101: 00010000:00010000:1.0:1790773057.355048:0:6471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773057.355061:0:6471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d27b12b800/0xabf1cc0bc7841801 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc78417fa expref: -99 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773057.355085:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d27b12b800/0xabf1cc0bc7841801 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc78417fa expref: 16 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773057.355094:0:6471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d27b12b800/0xabf1cc0bc7841801 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78417fa expref: 16 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773057.355102:0:6471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12b800, rc 0) 00000100:00100000:1.0:1790773057.355144:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26be9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:9473:x1877761495961472:12345-0@lo:101: Request processed in 114us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773057.355161:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1790773057.355256:0:9473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:9473:1877761495961472:0@lo:101: 00010000:00010000:3.0:1790773057.355271:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d24166ea00/0xabf1cc0bc78417fa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841801 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.355289:0:9473:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d24166ea00/0xabf1cc0bc78417fa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7841801 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773057.355365:0:9473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:9473:1877761495961600:0@lo:501: 00000100:00100000:3.0:1790773057.355388:0:9473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773057.355404:0:9473:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d248d33e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790773057.355514:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495961600 00000100:00100000:1.0:1790773057.355519:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495961600 00000100:00100000:1.0:1790773057.355551:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1790773057.355559:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26be9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:9473:x1877761495961600:12345-0@lo:501: 00000100:00100000:1.0:1790773057.355659:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26be9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:9473:x1877761495961600:12345-0@lo:501: Request processed in 100us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773057.355666:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1790773057.355698:0:9473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:9473:1877761495961600:0@lo:501: 00000100:00100000:1.0:1790773057.355725:0:9473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:9473:1877761495961728:0@lo:503: 00000100:00100000:1.0:1790773057.355842:0:9473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773057.355864:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495961728 00000100:00100000:1.0:1790773057.355868:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495961728 00000100:00100000:1.0:1790773057.355888:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1790773057.355894:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:9473:x1877761495961728:12345-0@lo:503: 00000100:00100000:1.0:1790773057.355969:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:9473:x1877761495961728:12345-0@lo:503: Request processed in 74us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773057.355975:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1790773057.356019:0:9473:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d143012a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790773057.356031:0:9473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:9473:1877761495961728:0@lo:503: 00000040:00080000:1.0:1790773057.356320:0:9473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790773057.356380:0:9473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:9473:1877761495961856:0@lo:502: 00000100:00100000:1.0:1790773057.356628:0:9473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773057.356708:0:9473:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d143012a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790773057.360913:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495961856 00000100:00100000:0.0:1790773057.360927:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495961856 00000100:00100000:0.0:1790773057.360977:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1790773057.360996:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:9473:x1877761495961856:12345-0@lo:502: 00000100:00100000:0.0:1790773057.361228:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:9473:x1877761495961856:12345-0@lo:502: Request processed in 243us (4812us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773057.361236:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00010000:00010000:2.0:1790773057.362332:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773057.362350:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f96a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761495962112:0@lo:400: 00000100:00100000:2.0:1790773057.362402:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773057.362559:0:9473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:9473:1877761495961856:0@lo:502: 00000100:00100000:3.0:1790773057.363262:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f969880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3606:1877761495961984:0@lo:400: 00000040:00080000:1.0:1790773057.363386:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1790773057.363500:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1790773057.363532:0:9473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:9473:1877761495963008:0@lo:502: 00000100:00100000:3.0:1790773057.363573:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773057.363585:0:9473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773057.363621:0:9473:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d143012a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790773057.363651:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f96b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3606:1877761495962496:0@lo:400: 00000100:00100000:1.0:1790773057.363658:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495963008 00000100:00100000:1.0:1790773057.363666:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495963008 00000100:00100000:3.0:1790773057.363679:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773057.363719:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f96aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3607:1877761495962624:0@lo:400: 00000100:00100000:2.0:1790773057.363767:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f968a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761495962240:0@lo:400: 00000100:00100000:2.0:1790773057.363794:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773057.363826:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1790773057.363827:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f96b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761495962752:0@lo:400: 00000100:00100000:1.0:1790773057.363839:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:9473:x1877761495963008:12345-0@lo:502: 00000100:00100000:2.0:1790773057.363857:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773057.363882:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1790773057.363889:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f968e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3604:1877761495962368:0@lo:400: 00000100:00100000:2.0:1790773057.363926:0:6484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495962112 00000100:00100000:2.0:1790773057.363931:0:6484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495962112 00000100:00100000:1.0:1790773057.363966:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:9473:x1877761495963008:12345-0@lo:502: Request processed in 128us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773057.363974:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1790773057.363977:0:6484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495962240 00000100:00100000:2.0:1790773057.363982:0:6484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495962240 00000100:00100000:2.0:1790773057.364011:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790773057.364019:0:6484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761495962112:12345-0@lo:400: 00000100:00100000:1.0:1790773057.364037:0:8392:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495962752 00000100:00100000:1.0:1790773057.364042:0:8392:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495962752 00000100:00100000:2.0:1790773057.364069:0:6484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761495962112:12345-0@lo:400: Request processed in 50us (1666us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773057.364076:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790773057.364088:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790773057.364095:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790773057.364099:0:8392:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761495962752:12345-0@lo:400: 00000100:00100000:2.0:1790773057.364107:0:6484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761495962240:12345-0@lo:400: 00000100:00100000:1.0:1790773057.364151:0:8392:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761495962752:12345-0@lo:400: Request processed in 55us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773057.364155:0:6484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761495962240:12345-0@lo:400: Request processed in 50us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773057.364163:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790773057.364167:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790773057.364224:0:9473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:9473:1877761495963008:0@lo:502: 00000040:00080000:1.0:1790773057.364273:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1790773057.364284:0:9473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000100:00100000:2.0:1790773057.364619:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773057.364628:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495961984 00000100:00100000:0.0:1790773057.364635:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495961984 00000100:00080000:1.0:1790773057.364646:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790773057.364669:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495962496 00000100:00100000:0.0:1790773057.364673:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495962496 00000100:00100000:0.0:1790773057.364893:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790773057.364900:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1877761495961984:12345-0@lo:400: 00000100:00100000:0.0:1790773057.364957:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1877761495961984:12345-0@lo:400: Request processed in 57us (1385us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773057.364978:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790773057.365007:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790773057.365013:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1877761495962496:12345-0@lo:400: 00000100:00100000:0.0:1790773057.365050:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1877761495962496:12345-0@lo:400: Request processed in 36us (1370us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773057.365056:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1790773057.365102:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f969880 x1877761495961984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773057.365115:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f969880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3606:1877761495961984:0@lo:400: 00010000:00080000:0.0:1790773057.365130:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f96b800 x1877761495962496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773057.365139:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f96b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3606:1877761495962496:0@lo:400: 00000020:01000000:0.0:1790773057.365306:0:9490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790773057.365317:0:9490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773057.365320:0:9490:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1790773057.365331:0:9490:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93d141fee800 00000020:00000080:0.0:1790773057.365334:0:9490:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790773057.365346:0:9490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790773057.365350:0:9490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773057.365351:0:9490:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1790773057.365353:0:9490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1790773057.365501:0:9473:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 00000100:00080000:3.0:1790773057.365524:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:1.0:1790773057.365550:0:9473:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790773057.365569:0:9473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d24166ea00/0xabf1cc0bc78417fa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841801 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773057.365590:0:9473:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d24166ea00/0xabf1cc0bc78417fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841801 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790773057.365639:0:9473:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1790773057.365642:0:9473:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93d141fee800 10000000:01000000:1.0:1790773057.365645:0:9473:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93d141fee800 10000000:01000000:1.0:1790773057.365649:0:9473:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790773057.365655:0:9473:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93d141fee800 from 1 10000000:01000000:1.0:1790773057.365658:0:9473:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790773057.365688:0:9473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12be00/0xabf1cc0bc7841808 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773057.365696:0:9473:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d27b12be00/0xabf1cc0bc7841808 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773057.365706:0:9473:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d27b12be00/0xabf1cc0bc7841808 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773057.365722:0:9473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:9473:1877761495963136:0@lo:101: 00000100:00100000:1.0:1790773057.365902:0:9473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773057.365933:0:9473:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d143012a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790773057.365951:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495963136 00000100:00100000:3.0:1790773057.365958:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495963136 00000100:00100000:3.0:1790773057.366008:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1790773057.366017:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:9473:x1877761495963136:12345-0@lo:101: 00010000:00010000:3.0:1790773057.366028:0:6471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773057.366041:0:6471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d24166fe00/0xabf1cc0bc784180f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7841808 expref: -99 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.366064:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d24166fe00/0xabf1cc0bc784180f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7841808 expref: 17 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.366075:0:6471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d24166fe00/0xabf1cc0bc784180f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7841808 expref: 17 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.366085:0:6471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d24166fe00, rc 0) 00000100:00100000:3.0:1790773057.366132:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:9473:x1877761495963136:12345-0@lo:101: Request processed in 115us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773057.366145:0:9473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:9473:1877761495963136:0@lo:101: 00000100:00100000:3.0:1790773057.366148:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00010000:00010000:1.0:1790773057.366164:0:9473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d27b12be00/0xabf1cc0bc7841808 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc784180f expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773057.366175:0:9473:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d27b12be00/0xabf1cc0bc7841808 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc784180f expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773057.366294:0:9473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:9473:1877761495963264:0@lo:501: 00000100:00100000:1.0:1790773057.366323:0:9473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773057.366349:0:9473:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d143012a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790773057.366361:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495963264 00000100:00100000:0.0:1790773057.366367:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495963264 00000100:00100000:0.0:1790773057.366402:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1790773057.366410:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:9473:x1877761495963264:12345-0@lo:501: 00000100:00100000:0.0:1790773057.366515:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:9473:x1877761495963264:12345-0@lo:501: Request processed in 106us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773057.366530:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1790773057.366565:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761495962880:0@lo:400: 00000100:00100000:2.0:1790773057.366600:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773057.366635:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f968a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761495962240:0@lo:400: 00000100:00100000:3.0:1790773057.366649:0:8907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495962880 00010000:00080000:2.0:1790773057.366654:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f96b480 x1877761495962752/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773057.366656:0:8907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495962880 00000100:00100000:2.0:1790773057.366670:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f96b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761495962752:0@lo:400: 00000100:00100000:2.0:1790773057.366833:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495962368 00000100:00100000:2.0:1790773057.366845:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495962368 00000100:00100000:2.0:1790773057.366877:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790773057.366884:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3604:x1877761495962368:12345-0@lo:400: 00000100:00100000:2.0:1790773057.366927:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3604:x1877761495962368:12345-0@lo:400: Request processed in 44us (2307us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773057.366934:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790773057.366970:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773057.367023:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f96a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761495962112:0@lo:400: 00000100:00100000:2.0:1790773057.367044:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495962624 00000100:00100000:2.0:1790773057.367048:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495962624 00000100:00100000:3.0:1790773057.367052:0:8907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790773057.367065:0:8907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761495962880:12345-0@lo:400: 00000100:00100000:2.0:1790773057.367082:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790773057.367091:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1877761495962624:12345-0@lo:400: 00000100:00100000:3.0:1790773057.367109:0:8907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761495962880:12345-0@lo:400: Request processed in 47us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773057.367116:0:8907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790773057.367141:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1877761495962624:12345-0@lo:400: Request processed in 50us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773057.367148:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1790773057.367174:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f96aa00 x1877761495962624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790773057.367176:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790773057.367183:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790773057.367188:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f96aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3607:1877761495962624:0@lo:400: 00010000:00080000:2.0:1790773057.367252:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f968e00 x1877761495962368/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773057.367262:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f968e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3604:1877761495962368:0@lo:400: 00010000:00080000:2.0:1790773057.367274:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27c3a9500 x1877761495962880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773057.367281:0:3604:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1790773057.367291:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761495962880:0@lo:400: 00000100:00100000:0.0:1790773057.367311:0:9473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:9473:1877761495963264:0@lo:501: 00000100:00100000:0.0:1790773057.367349:0:9473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f976d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:9473:1877761495963392:0@lo:503: 00000100:00100000:0.0:1790773057.367393:0:9473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773057.367415:0:9473:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d14265bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1790773057.367467:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495963392 00000100:00100000:3.0:1790773057.367472:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495963392 00000100:00100000:3.0:1790773057.367530:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1790773057.367539:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:9473:x1877761495963392:12345-0@lo:503: 00000100:00100000:3.0:1790773057.367633:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:9473:x1877761495963392:12345-0@lo:503: Request processed in 96us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773057.367639:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1790773057.367716:0:9473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f976d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:9473:1877761495963392:0@lo:503: 00000040:00080000:1.0:1790773057.368083:0:9473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790773057.368144:0:9473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:9473:1877761495963520:0@lo:502: 00000100:00100000:1.0:1790773057.368179:0:9473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773057.368235:0:9473:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d143012c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790773057.368513:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495963520 00000100:00100000:3.0:1790773057.368518:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495963520 00000100:00100000:3.0:1790773057.368548:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1790773057.368555:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:9473:x1877761495963520:12345-0@lo:502: 00000100:00100000:3.0:1790773057.368645:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:9473:x1877761495963520:12345-0@lo:502: Request processed in 90us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773057.368652:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1790773057.368676:0:9473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:9473:1877761495963520:0@lo:502: 00000040:00080000:0.0:1790773057.369089:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1790773057.369122:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1790773057.369139:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1790773057.369155:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1790773057.369171:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1790773057.369187:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1790773057.369223:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1790773057.369245:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1790773057.369262:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1790773057.369280:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1790773057.369297:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1790773057.369310:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1790773057.369327:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1790773057.369345:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1790773057.369365:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1790773057.369388:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1790773057.369411:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1790773057.369429:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1790773057.369445:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1790773057.369458:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1790773057.369474:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1790773057.369514:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1790773057.369533:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1790773057.369547:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1790773057.369561:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1790773057.369576:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1790773057.369830:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1790773057.369856:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1790773057.369874:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1790773057.369890:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1790773057.369905:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1790773057.369921:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1790773057.369935:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1790773057.369947:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1790773057.369961:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1790773057.369974:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1790773057.370002:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:2.0:1790773057.370020:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1790773057.370032:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:2.0:1790773057.370043:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:2.0:1790773057.370055:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:2.0:1790773057.370069:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:2.0:1790773057.370082:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:2.0:1790773057.370095:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:2.0:1790773057.370108:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:2.0:1790773057.370121:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:2.0:1790773057.370160:0:9473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:9473:1877761495963648:0@lo:502: 00000100:00100000:2.0:1790773057.370240:0:9473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773057.371363:0:9473:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c159600 going to sleep for 11 seconds 00000100:00100000:3.0:1790773057.371610:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495963648 00000100:00100000:3.0:1790773057.371619:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495963648 00000100:00100000:1.0:1790773057.371835:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1790773057.371847:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:9473:x1877761495963648:12345-0@lo:502: 00000100:00100000:1.0:1790773057.372049:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:9473:x1877761495963648:12345-0@lo:502: Request processed in 203us (1808us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773057.372057:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1790773057.372166:0:9473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:9473:1877761495963648:0@lo:502: 00000040:00080000:3.0:1790773057.372380:0:9473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:3.0:1790773057.372399:0:9473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:1.0:1790773057.373099:0:9491:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1790773057.373115:0:9491:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff93d26ec20000) 00000020:00000080:1.0:1790773057.373139:0:9491:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:1.0:1790773057.373333:0:9491:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93d141fee800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1790773057.373338:0:9491:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93d141fee800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1790773057.373340:0:9491:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93d141fee800 3 00010000:00080000:1.0:1790773057.373368:0:9491:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d141ce9000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.119@tcp at head 00010000:00010000:1.0:1790773057.375598:0:9491:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:1.0:1790773057.376037:0:9491:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1790773057.376089:0:9491:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1790773057.376103:0:9491:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xabf1cc0bc784181d 00000100:00080000:1.0:1790773057.376115:0:9491:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790773057.376128:0:9491:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93d141ce9000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:1.0:1790773057.376171:0:9491:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d25074dc00 x1877761495963776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790773057.376269:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3603:1877761495963776:0@lo:38: 00000100:00100000:2.0:1790773057.376342:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790773057.376520:0:9491:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000020:01000004:1.0:1790773057.376934:0:9491:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1790773057.376959:0:9491:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff93d1435ecd40) 00000020:00000080:1.0:1790773057.376977:0:9491:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:1.0:1790773057.377060:0:9491:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93d141fee800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1790773057.377064:0:9491:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93d141fee800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1790773057.377067:0:9491:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93d141fee800 3 00010000:00080000:1.0:1790773057.377096:0:9491:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d1434c9000@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.119@tcp at head 00000100:00080000:3.0:1790773057.378304:0:9492:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff93d281b9c380 x1877761495963904/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773057.378319:0:9492:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d248d33a80 going to sleep for 0 seconds 00000100:00100000:3.0:1790773057.381570:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495963776 00000100:00100000:3.0:1790773057.381587:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495963776 00000100:00100000:3.0:1790773057.381637:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790773057.381646:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3603:x1877761495963776:12345-0@lo:38: 00010000:00080000:3.0:1790773057.381689:0:6480:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:3.0:1790773057.381753:0:6480:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xabf1cc0bc784182b 00000004:00100000:3.0:1790773057.381772:0:6480:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1790773057.381808:0:6480:0:(import.c:65:import_set_state_nolock()) ffff93d143281000 : changing import state from RECOVER to FULL 00010000:00010000:1.0:1790773057.383320:0:9491:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:1.0:1790773057.385047:0:9491:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1790773057.385104:0:9491:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1790773057.385116:0:9491:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xabf1cc0bc7841832 00000100:00080000:1.0:1790773057.385129:0:9491:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790773057.385144:0:9491:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff93d1434c9000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:1.0:1790773057.385184:0:9491:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d26ec63480 x1877761495964032/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790773057.385199:0:9491:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1790773057.387237:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3603:x1877761495963776:12345-0@lo:38: Request processed in 5581us (10885us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773057.387252:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000040:00080000:1.0:1790773057.387954:0:9491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:3.0:1790773057.388520:0:9473:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:3.0:1790773057.388553:0:9473:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790773057.388569:0:9473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12be00/0xabf1cc0bc7841808 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc784180f expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.388580:0:9473:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d27b12be00/0xabf1cc0bc7841808 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc784180f expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1790773057.388625:0:9473:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1790773057.388627:0:9473:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790773057.388628:0:9473:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790773057.388630:0:9473:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790773057.388631:0:9473:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790773057.388632:0:9473:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790773057.388633:0:9473:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790773057.388639:0:9473:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790773057.388640:0:9473:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790773057.388642:0:9473:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790773057.388643:0:9473:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790773057.388647:0:9473:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1790773057.388649:0:9473:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790773057.388651:0:9473:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790773057.388652:0:9473:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790773057.388653:0:9473:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790773057.388653:0:9473:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790773057.388654:0:9473:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790773057.388655:0:9473:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790773057.388656:0:9473:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790773057.388657:0:9473:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790773057.388657:0:9473:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790773057.388658:0:9473:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790773057.388694:0:9473:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1790773057.388715:0:9473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:9473:1877761495964160:0@lo:253: 00000100:00100000:3.0:1790773057.388899:0:9473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773057.388937:0:9473:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d248d33e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790773057.388960:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495964160 00000100:00100000:3.0:1790773057.388968:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495964160 00000100:00100000:3.0:1790773057.389017:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1790773057.389025:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:9473:x1877761495964160:12345-0@lo:253: 20000000:01000000:3.0:1790773057.389052:0:6471:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1790773057.389065:0:6471:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:2.0:1790773057.391810:0:3603:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d25074dc00 x1877761495963776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790773067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773057.391825:0:3603:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790773057.391836:0:3603:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1790773057.391850:0:3603:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1790773057.391862:0:3603:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790773057.391866:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d141ce9000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1790773057.391875:0:3603:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000e831d9c2): req@ffff93d281b9c380 x1877761495963904/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773057.391896:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3603:1877761495963776:0@lo:38: 00000100:00100000:2.0:1790773057.391932:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ec63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3603:1877761495964032:0@lo:38: 00000100:00100000:2.0:1790773057.392015:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773057.392049:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495964032 00000100:00100000:2.0:1790773057.392056:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495964032 00000100:00100000:2.0:1790773057.392093:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790773057.392102:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3603:x1877761495964032:12345-0@lo:38: 00010000:00080000:2.0:1790773057.392133:0:6479:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:2.0:1790773057.392185:0:6479:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xabf1cc0bc7841839 00000004:00100000:2.0:1790773057.392200:0:6479:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790773057.392260:0:6479:0:(import.c:65:import_set_state_nolock()) ffff93d26ef95800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790773057.392308:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3603:x1877761495964032:12345-0@lo:38: Request processed in 205us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773057.392315:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1790773057.392372:0:3603:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d26ec63480 x1877761495964032/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790773067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773057.392380:0:3603:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790773057.392384:0:3603:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1790773057.392388:0:3603:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1790773057.392391:0:3603:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1790773057.392393:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d1434c9000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790773057.392397:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ec63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3603:1877761495964032:0@lo:38: 00000100:00100000:2.0:1790773057.395540:0:9492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773057.395585:0:9492:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d248d33a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790773057.396376:0:6489:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495963904 00000100:00100000:1.0:1790773057.396388:0:6489:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495963904 00000100:00100000:1.0:1790773057.396572:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790773057.396583:0:6489:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9492:x1877761495963904:12345-0@lo:901: 00000100:00100000:1.0:1790773057.396709:0:6489:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9492:x1877761495963904:12345-0@lo:901: Request processed in 129us (1176us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773057.396717:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1790773057.397110:0:9492:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d281b9c380 x1877761495963904/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1790773073 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773057.397125:0:9492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9c380 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9492:1877761495963904:0@lo:901: 00000100:00080000:3.0:1790773057.401595:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 20000000:01000000:1.0:1790773057.402474:0:6471:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790773057.402498:0:6471:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1790773057.403021:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:9473:x1877761495964160:12345-0@lo:253: Request processed in 13992us (14117us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773057.403034:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1790773057.403102:0:9473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce0675b4-b0c5-48e7-b182-565e22fed04c:9473:1877761495964160:0@lo:253: 10000000:01000000:1.0:1790773057.403115:0:9473:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1790773057.403118:0:9473:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790773057.403120:0:9473:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790773057.403121:0:9473:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790773057.403122:0:9473:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790773057.403123:0:9473:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790773057.403125:0:9473:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790773057.403126:0:9473:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790773057.403127:0:9473:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790773057.403129:0:9473:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790773057.403130:0:9473:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790773057.403132:0:9473:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1790773057.403166:0:9473:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1790773057.403919:0:6494:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790773057.403926:0:6494:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790773057.403950:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93d24166fa00/0xabf1cc0bc7841840 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.403967:0:6494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d241526a00/0xabf1cc0bc7841736 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc784172f expref: 16 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.404008:0:6494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d27b12a400/0xabf1cc0bc784177c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7841775 expref: 16 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.404017:0:6494:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93d24166fa00/0xabf1cc0bc7841840 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.404055:0:6494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d27b12a400/0xabf1cc0bc784177c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc7841775 expref: 16 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.404069:0:6494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d27b12a400/0xabf1cc0bc784177c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc7841775 expref: 16 pid: 6472 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773057.404081:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6494:1877761495964288:0@lo:104: 00000100:00100000:3.0:1790773057.404128:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790773057.404173:0:6494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d241526a00/0xabf1cc0bc7841736 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc784172f expref: 16 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.404183:0:6494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d241526a00/0xabf1cc0bc7841736 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc784172f expref: 16 pid: 6471 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773057.404192:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6494:1877761495964416:0@lo:104: 00000100:00100000:3.0:1790773057.404239:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773057.404256:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2500ed540 going to sleep for 11 seconds 00000100:00100000:3.0:1790773057.404273:0:9484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495964288 00000100:00100000:3.0:1790773057.404280:0:9484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495964288 00000100:00100000:3.0:1790773057.404318:0:9484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495964416 00000100:00100000:3.0:1790773057.404322:0:9484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495964416 00000100:00100000:3.0:1790773057.404337:0:9484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790773057.404345:0:9484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+4:6494:x1877761495964288:12345-0@lo:104: 00010000:00010000:3.0:1790773057.404364:0:9484:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3000/0xabf1cc0bc7841775 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc784177c expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773057.404503:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6494:1877761495964288:0@lo:104: 00010000:00010000:3.0:1790773057.404522:0:9484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790773057.404527:0:9484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+4:6494:x1877761495964288:12345-0@lo:104: Request processed in 184us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773057.404535:0:9484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1790773057.404552:0:6466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790773057.404558:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3000/0xabf1cc0bc7841775 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc784177c expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.404564:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a3000 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:3.0:1790773057.404568:0:6466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3000/0xabf1cc0bc7841775 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc784177c expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.404576:0:6466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3000/0xabf1cc0bc7841775 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc784177c expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790773057.404582:0:6466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3000/0xabf1cc0bc7841775 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc784177c expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773057.404587:0:6466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790773057.404610:0:6466:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3000/0xabf1cc0bc7841775 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc784177c expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.404617:0:6466:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790773057.404634:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3000/0xabf1cc0bc7841775 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc784177c expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.404651:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3000/0xabf1cc0bc7841775 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc784177c expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.404662:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773057.404663:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773057.404665:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773057.404675:0:9484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790773057.404682:0:9484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+3:6494:x1877761495964416:12345-0@lo:104: 00010000:00010000:3.0:1790773057.404689:0:9484:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d241527800/0xabf1cc0bc784172f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7841736 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773057.405672:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6494:1877761495964416:0@lo:104: 00010000:00010000:3.0:1790773057.405794:0:6494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93d24166fa00/0xabf1cc0bc7841840 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.405829:0:9484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790773057.405835:0:9484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+3:6494:x1877761495964416:12345-0@lo:104: Request processed in 1154us (1596us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773057.405843:0:9484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1790773057.405865:0:8409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790773057.405870:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d241527800/0xabf1cc0bc784172f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7841736 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.405877:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d241527800 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:3.0:1790773057.405881:0:8409:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d241527800/0xabf1cc0bc784172f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc7841736 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.405903:0:8409:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d241527800/0xabf1cc0bc784172f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc7841736 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790773057.405909:0:8409:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d241527800/0xabf1cc0bc784172f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc7841736 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773057.405914:0:8409:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790773057.405936:0:8409:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d241527800/0xabf1cc0bc784172f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841736 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.405942:0:8409:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790773057.405949:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d241527800/0xabf1cc0bc784172f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841736 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.405955:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d241527800/0xabf1cc0bc784172f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841736 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.405970:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773057.405971:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773057.405973:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773057.406077:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce0675b4-b0c5-48e7-b182-565e22fed04c:3606:1877761495964544:0@lo:103: 00000100:00100000:0.0:1790773057.406126:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773057.406164:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790773057.406170:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce0675b4-b0c5-48e7-b182-565e22fed04c:3606:1877761495964672:0@lo:103: 00000100:00100000:0.0:1790773057.406190:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773057.406240:0:8410:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495964544 00000100:00100000:0.0:1790773057.406247:0:8410:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495964544 00010000:00010000:0.0:1790773057.406270:0:8410:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d27b12a400/0xabf1cc0bc784177c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7841775 expref: 17 pid: 6472 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773057.406292:0:8410:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495964672 00000100:00100000:0.0:1790773057.406295:0:8410:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495964672 00010000:00010000:0.0:1790773057.406304:0:8410:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d241526a00/0xabf1cc0bc7841736 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc784172f expref: 18 pid: 6471 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773057.406329:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790773057.406337:0:8410:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f977800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:3606:x1877761495964544:12345-0@lo:103: 00010000:00010000:0.0:1790773057.406349:0:8410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773057.406354:0:8410:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d27b12a400/0xabf1cc0bc784177c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7841775 expref: 18 pid: 6472 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773057.406365:0:8410:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d27b12a400/0xabf1cc0bc784177c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc7841775 expref: 18 pid: 6472 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773057.406377:0:8410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d27b12a400/0xabf1cc0bc784177c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc7841775 expref: 18 pid: 6472 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773057.406395:0:8410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790773057.406443:0:8410:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f977800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:3606:x1877761495964544:12345-0@lo:103: Request processed in 107us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773057.406449:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790773057.406465:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790773057.406471:0:8410:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f974e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:3606:x1877761495964672:12345-0@lo:103: 00010000:00010000:0.0:1790773057.406479:0:8410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773057.406482:0:8410:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d241526a00/0xabf1cc0bc7841736 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc784172f expref: 16 pid: 6471 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773057.406643:0:8410:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d241526a00/0xabf1cc0bc7841736 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc784172f expref: 16 pid: 6471 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773057.406653:0:8410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d241526a00/0xabf1cc0bc7841736 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc784172f expref: 16 pid: 6471 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773057.406664:0:8410:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93d24166fa00/0xabf1cc0bc7841840 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773057.406671:0:8410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d24166fa00/0xabf1cc0bc7841840 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790773057.406684:0:8410:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005490034s 00010000:00010000:0.0:1790773057.406689:0:8410:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d24166fa00/0xabf1cc0bc7841840 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773057.406695:0:8410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d24166fa00/0xabf1cc0bc7841840 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773057.406718:0:8410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93d24166fa00/0xabf1cc0bc7841840 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773057.406724:0:8410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93d24166fa00/0xabf1cc0bc7841840 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773057.406799:0:8410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d24166fa00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:0.0:1790773057.406803:0:8410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93d24166fa00/0xabf1cc0bc7841840 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773057.406811:0:8410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93d24166fa00/0xabf1cc0bc7841840 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773057.406831:0:8410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93d24166fa00/0xabf1cc0bc7841840 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773057.406842:0:8410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790773057.406867:0:8410:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f974e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:3606:x1877761495964672:12345-0@lo:103: Request processed in 396us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773057.406872:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790773057.406923:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce0675b4-b0c5-48e7-b182-565e22fed04c:3606:1877761495964672:0@lo:103: 00000100:00100000:0.0:1790773057.406930:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce0675b4-b0c5-48e7-b182-565e22fed04c:3606:1877761495964544:0@lo:103: 00010000:00010000:3.0:1790773057.407520:0:6494:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93d24166fa00/0xabf1cc0bc7841840 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.407531:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93d24166fa00/0xabf1cc0bc7841840 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773057.407537:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d24166fa00/0xabf1cc0bc7841840 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1790773057.412370:0:9473:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1790773057.412553:0:9473:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1790773057.412727:0:9473:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1790773057.412873:0:9473:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1790773057.413130:0:9473:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1790773057.413359:0:9473:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1790773057.416120:0:9473:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1790773057.425934:0:9473:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1790773057.425954:0:9473:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1790773057.426026:0:9473:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790773057.426069:0:9473:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.119@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790773057.426088:0:9473:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1790773057.426116:0:9473:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1790773057.426900:0:9473:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790773057.427098:0:9473:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:2.0:1790773057.872678:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790773057.872703:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761495964800:0@lo:13: 00000100:00100000:2.0:1790773057.872773:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773057.873291:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495964800 00000100:00100000:1.0:1790773057.873299:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495964800 00000100:00100000:1.0:1790773057.873357:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790773057.873367:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26beea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761495964800:12345-0@lo:13: 00002000:00000024:1.0:1790773057.873401:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790773057.873457:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26beea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761495964800:12345-0@lo:13: Request processed in 91us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773057.873473:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1790773057.873519:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f976300 x1877761495964800/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773073 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773057.873536:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761495964800:0@lo:13: 00000100:00100000:3.0:1790773057.875104:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761495964928:0@lo:13: 00000100:00100000:3.0:1790773057.875152:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773057.875195:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495964928 00000100:00100000:3.0:1790773057.875201:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495964928 00000100:00100000:3.0:1790773057.875248:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790773057.875255:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761495964928:12345-0@lo:13: 00002000:00000024:3.0:1790773057.875274:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790773057.875307:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761495964928:12345-0@lo:13: Request processed in 52us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773057.875313:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1790773057.875340:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d281b9e680 x1877761495964928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773073 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773057.875355:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761495964928:0@lo:13: 00000020:00000004:1.0:1790773058.138971:0:9547:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790773058.139250:0:9547:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790773058.381458:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773059.405346:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773059.917995:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ec61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761495965056:0@lo:41: 00000100:00100000:2.0:1790773059.918093:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773059.918254:0:6484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495965056 00000100:00100000:3.0:1790773059.918264:0:6484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495965056 00000100:00100000:3.0:1790773059.918314:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790773059.918325:0:6484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1434baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761495965056:12345-0@lo:41: 00000004:00000024:3.0:1790773059.918359:0:6484:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1790773059.918409:0:6484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1434baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761495965056:12345-0@lo:41: Request processed in 86us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773059.918426:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790773059.918579:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ec61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761495965056:0@lo:41: 00000100:00100000:2.0:1790773059.918595:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790773059.918601:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1434b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761495965184:0@lo:41: 00000100:00100000:2.0:1790773059.918625:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773059.918650:0:7666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495965184 00000100:00100000:2.0:1790773059.918654:0:7666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495965184 00000100:00100000:2.0:1790773059.918680:0:7666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790773059.918687:0:7666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1434b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761495965184:12345-0@lo:41: 00000004:00000024:2.0:1790773059.918703:0:7666:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:2.0:1790773059.918733:0:7666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1434b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761495965184:12345-0@lo:41: Request processed in 47us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773059.918739:0:7666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790773059.918766:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1434b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761495965184:0@lo:41: 00010000:00010000:3.0:1790773060.429973:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773061.458855:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773062.480715:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761495965696:0@lo:400: 00000100:00100000:1.0:1790773062.481106:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773062.481178:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761495966208:0@lo:400: 00000100:00100000:1.0:1790773062.481225:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773062.481260:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1790773062.481267:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761495965568:0@lo:400: 00000100:00100000:1.0:1790773062.481292:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773062.481551:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3605:1877761495965440:0@lo:400: 00000100:00100000:2.0:1790773062.481586:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773062.481848:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ed68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3605:1877761495965952:0@lo:400: 00000100:00100000:2.0:1790773062.481872:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773062.481890:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3605:1877761495966464:0@lo:400: 00000100:00100000:2.0:1790773062.481911:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773062.481931:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1790773062.481949:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce0675b4-b0c5-48e7-b182-565e22fed04c:3605:1877761495965312:0@lo:400: 00010000:00010000:3.0:1790773062.482174:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773062.482535:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773062.482572:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3605:1877761495965824:0@lo:400: 00000100:00100000:1.0:1790773062.483423:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3607:1877761495966080:0@lo:400: 00000100:00100000:1.0:1790773062.483550:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773062.483581:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3607:1877761495966592:0@lo:400: 00000100:00100000:2.0:1790773062.483826:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773062.483842:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761495966336:0@lo:400: 00000100:00100000:2.0:1790773062.483868:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773062.483952:0:7666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495965696 00000100:00100000:2.0:1790773062.483961:0:7666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495965696 00000100:00100000:1.0:1790773062.485292:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773062.485583:0:7666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495965568 00000100:00100000:1.0:1790773062.485831:0:8393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495966208 00000100:00100000:1.0:1790773062.485839:0:8393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495966208 00000100:00100000:1.0:1790773062.485880:0:8393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495966336 00000100:00100000:1.0:1790773062.485883:0:8393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495966336 00000100:00100000:1.0:1790773062.485909:0:8393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790773062.485919:0:8393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ec63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761495966208:12345-0@lo:400: 00000100:00100000:2.0:1790773062.486827:0:7666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495965568 00000100:00100000:2.0:1790773062.486865:0:7666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790773062.486873:0:7666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ec61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761495965696:12345-0@lo:400: 00000100:00100000:0.0:1790773062.487604:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495965312 00000100:00100000:0.0:1790773062.487613:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495965312 00000100:00100000:0.0:1790773062.487833:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1790773062.487842:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:3605:x1877761495965312:12345-0@lo:400: 00000100:00100000:2.0:1790773062.490260:0:7666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ec61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761495965696:12345-0@lo:400: Request processed in 3376us (9144us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773062.490277:0:7666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790773062.490321:0:7666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790773062.490344:0:7666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ec61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761495965568:12345-0@lo:400: 00000100:00100000:2.0:1790773062.490411:0:7666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ec61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761495965568:12345-0@lo:400: Request processed in 72us (9117us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773062.490417:0:7666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790773062.490444:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495965440 00000100:00100000:2.0:1790773062.490464:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495965440 00000100:00100000:2.0:1790773062.490509:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495965952 00000100:00100000:2.0:1790773062.490512:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495965952 00000100:00100000:2.0:1790773062.490527:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495966464 00000100:00100000:2.0:1790773062.490530:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495966464 00000100:00100000:2.0:1790773062.490543:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495966080 00000100:00100000:2.0:1790773062.490546:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495966080 00000100:00100000:2.0:1790773062.490561:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495965824 00000100:00100000:2.0:1790773062.490564:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495965824 00000100:00100000:2.0:1790773062.490574:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495966592 00000100:00100000:2.0:1790773062.490577:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495966592 00000100:00100000:2.0:1790773062.490603:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790773062.490610:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1434b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3605:x1877761495965440:12345-0@lo:400: 00000100:00100000:2.0:1790773062.490667:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1434b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3605:x1877761495965440:12345-0@lo:400: Request processed in 57us (9081us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773062.490673:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790773062.490687:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790773062.490693:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1434ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3605:x1877761495965952:12345-0@lo:400: 00000100:00100000:2.0:1790773062.490722:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1434ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3605:x1877761495965952:12345-0@lo:400: Request processed in 30us (8849us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773062.490727:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790773062.490738:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790773062.490756:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1434b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3605:x1877761495966464:12345-0@lo:400: 00000100:00100000:2.0:1790773062.490784:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1434b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3605:x1877761495966464:12345-0@lo:400: Request processed in 29us (8872us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773062.490790:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790773062.490800:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790773062.490806:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ec62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1877761495966080:12345-0@lo:400: 00000100:00100000:2.0:1790773062.490833:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ec62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1877761495966080:12345-0@lo:400: Request processed in 27us (7284us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773062.490846:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790773062.490860:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790773062.490865:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1434b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3605:x1877761495965824:12345-0@lo:400: 00000100:00100000:2.0:1790773062.490893:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1434b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3605:x1877761495965824:12345-0@lo:400: Request processed in 28us (7068us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773062.490899:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790773062.490909:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790773062.490915:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ec62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1877761495966592:12345-0@lo:400: 00000100:00100000:2.0:1790773062.490952:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ec62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1877761495966592:12345-0@lo:400: Request processed in 36us (5663us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773062.490957:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790773062.491423:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790773062.491435:0:8392:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1434bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761495966336:12345-0@lo:400: 00000100:00100000:2.0:1790773062.491482:0:8392:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1434bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761495966336:12345-0@lo:400: Request processed in 51us (7613us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773062.491489:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790773062.493483:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761495965568:0@lo:400: 00010000:00080000:3.0:1790773062.493507:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1437dea00 x1877761495966080/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773062.493519:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3607:1877761495966080:0@lo:400: 00010000:00080000:3.0:1790773062.493537:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1437dca80 x1877761495966592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773062.493545:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3607:1877761495966592:0@lo:400: 00000100:00100000:3.0:1790773062.493557:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761495965696:0@lo:400: 00010000:00080000:3.0:1790773062.494948:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d281b9f100 x1877761495965824/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773062.494967:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3605:1877761495965824:0@lo:400: 00010000:00080000:3.0:1790773062.494992:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1437dc700 x1877761495966336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773062.495002:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761495966336:0@lo:400: 00010000:00080000:3.0:1790773062.495015:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d281b9d880 x1877761495965440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773062.495023:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3605:1877761495965440:0@lo:400: 00010000:00080000:3.0:1790773062.495035:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d26ed68380 x1877761495965952/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773062.495058:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ed68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3605:1877761495965952:0@lo:400: 00010000:00080000:3.0:1790773062.495078:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1437de300 x1877761495966464/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773062.495087:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3605:1877761495966464:0@lo:400: 00000100:00100000:1.0:1790773062.495267:0:8393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ec63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761495966208:12345-0@lo:400: Request processed in 9346us (14038us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773062.495288:0:8393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1790773062.495341:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790773062.495346:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790773062.495350:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790773062.497482:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1437ddf80 x1877761495966208/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773062.497500:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761495966208:0@lo:400: 00000100:00100000:0.0:1790773062.504780:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:3605:x1877761495965312:12345-0@lo:400: Request processed in 16929us (22791us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773062.504803:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1790773062.510053:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce0675b4-b0c5-48e7-b182-565e22fed04c:3605:1877761495965312:0@lo:400: 00000100:00100000:1.0:1790773062.992995:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790773062.993020:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ec61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761495966720:0@lo:13: 00000100:00100000:1.0:1790773062.993088:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773062.993137:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495966720 00000100:00100000:1.0:1790773062.993145:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495966720 00000100:00100000:1.0:1790773062.993187:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790773062.993196:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ec60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761495966720:12345-0@lo:13: 00002000:00000024:1.0:1790773062.993243:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790773062.993287:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ec60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761495966720:12345-0@lo:13: Request processed in 92us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773062.993294:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1790773062.993341:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d26ec61180 x1877761495966720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773078 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773062.993357:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ec61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761495966720:0@lo:13: 00000100:00100000:2.0:1790773062.993598:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761495966848:0@lo:13: 00000100:00100000:2.0:1790773062.993629:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773062.994593:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495966848 00000100:00100000:0.0:1790773062.994601:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495966848 00000100:00100000:0.0:1790773062.994642:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790773062.994650:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1434bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761495966848:12345-0@lo:13: 00002000:00000024:0.0:1790773062.994668:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790773062.994715:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1434bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761495966848:12345-0@lo:13: Request processed in 66us (1085us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773062.994723:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1790773062.994882:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f975f80 x1877761495966848/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773078 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773062.994901:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761495966848:0@lo:13: 00010000:00010000:3.0:1790773063.501487:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790773064.125795:0:9837:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg219-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:0.0:1790773064.525513:0:6475:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1790773064.525521:0:6475:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93d26ff80800 from 39 10000000:01000000:0.0:1790773064.525528:0:6475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790773064.525572:0:6475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2800/0xabf1cc0bc7841847 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773064.525585:0:6475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2800/0xabf1cc0bc7841847 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773064.525677:0:6475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2800/0xabf1cc0bc7841847 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773064.525704:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f975880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495966976:0@lo:101: 00000100:00100000:0.0:1790773064.525774:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773064.525822:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d14323a780 going to sleep for 11 seconds 00010000:00010000:1.0:1790773064.530185:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773064.530233:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495966976 00000100:00100000:1.0:1790773064.530244:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495966976 00000100:00100000:1.0:1790773064.530295:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1790773064.530312:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:6475:x1877761495966976:12345-0@lo:101: 00010000:00010000:1.0:1790773064.530329:0:6471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773064.530346:0:6471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d27b12ae00/0xabf1cc0bc784184e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7841847 expref: -99 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773064.530386:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d27b12ae00/0xabf1cc0bc784184e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7841847 expref: 16 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773064.530394:0:6471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d27b12ae00/0xabf1cc0bc784184e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7841847 expref: 16 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773064.530403:0:6471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12ae00, rc 0) 00000100:00100000:1.0:1790773064.532086:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:6475:x1877761495966976:12345-0@lo:101: Request processed in 1771us (6308us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773064.532096:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1790773064.532231:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f975880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495966976:0@lo:101: 00010000:00010000:3.0:1790773064.532256:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2800/0xabf1cc0bc7841847 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc784184e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773064.532269:0:6475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2800/0xabf1cc0bc7841847 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc784184e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773064.532364:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495967104:0@lo:501: 00000100:00100000:3.0:1790773064.532403:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773064.532451:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ef103c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790773064.533061:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495967104 00000100:00100000:1.0:1790773064.533070:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495967104 00000100:00100000:1.0:1790773064.533116:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1790773064.533125:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:6475:x1877761495967104:12345-0@lo:501: 00000100:00100000:1.0:1790773064.533278:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:6475:x1877761495967104:12345-0@lo:501: Request processed in 154us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773064.533285:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1790773064.533760:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495967104:0@lo:501: 00000100:00100000:3.0:1790773064.533801:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495967232:0@lo:503: 00000100:00100000:3.0:1790773064.533857:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773064.533892:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ef103c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790773064.534288:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495967232 00000100:00100000:1.0:1790773064.534294:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495967232 00000100:00100000:1.0:1790773064.534344:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1790773064.534351:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:6475:x1877761495967232:12345-0@lo:503: 00000100:00100000:1.0:1790773064.534607:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:6475:x1877761495967232:12345-0@lo:503: Request processed in 256us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773064.534695:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495967232:0@lo:503: 00000100:00100000:3.0:1790773064.534913:0:9858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437ddf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:9858:1877761495967360:0@lo:502: 00000100:00100000:3.0:1790773064.535032:0:9858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773064.535055:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495967360 00000100:00100000:3.0:1790773064.535059:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495967360 00000100:00100000:3.0:1790773064.535083:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1790773064.535089:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:9858:x1877761495967360:12345-0@lo:502: 00000100:00100000:3.0:1790773064.535174:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:9858:x1877761495967360:12345-0@lo:502: Request processed in 84us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773064.535181:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1790773064.535241:0:9858:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ef10480 going to sleep for 11 seconds 00000100:00100000:3.0:1790773064.535255:0:9858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437ddf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:9858:1877761495967360:0@lo:502: 00000100:00100000:3.0:1790773064.535292:0:9858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437ddf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:9858:1877761495967488:0@lo:502: 00000100:00100000:1.0:1790773064.535513:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1790773064.536140:0:9858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773064.536257:0:9858:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ef10480 going to sleep for 11 seconds 00000100:00100000:2.0:1790773064.536745:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495967488 00000100:00100000:2.0:1790773064.536753:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495967488 00000100:00100000:2.0:1790773064.536833:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1790773064.536842:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:9858:x1877761495967488:12345-0@lo:502: 00000100:00100000:2.0:1790773064.536983:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:9858:x1877761495967488:12345-0@lo:502: Request processed in 141us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773064.536990:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1790773064.537238:0:9858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437ddf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:9858:1877761495967488:0@lo:502: 00000040:00080000:1.0:1790773064.537269:0:9858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1790773064.537832:0:6475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1790773064.537854:0:6475:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790773064.537865:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2800/0xabf1cc0bc7841847 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc784184e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773064.537889:0:6475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2800/0xabf1cc0bc7841847 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc784184e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790773064.537899:0:6475:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1790773064.537901:0:6475:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1790773064.537904:0:6475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1790773064.537949:0:6475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3a00/0xabf1cc0bc7841855 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773064.537967:0:6475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3a00/0xabf1cc0bc7841855 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773064.537976:0:6475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3a00/0xabf1cc0bc7841855 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773064.537994:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f976680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495967616:0@lo:101: 00000100:00100000:0.0:1790773064.538035:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773064.538865:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d14323a000 going to sleep for 11 seconds 00000100:00100000:3.0:1790773064.542566:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495967616 00000100:00100000:3.0:1790773064.542585:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495967616 00000100:00100000:3.0:1790773064.542666:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1790773064.542678:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:6475:x1877761495967616:12345-0@lo:101: 00010000:00010000:3.0:1790773064.542698:0:6472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773064.542718:0:6472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d24166fc00/0xabf1cc0bc784185c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7841855 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773064.542747:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d24166fc00/0xabf1cc0bc784185c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7841855 expref: 17 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773064.542767:0:6472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d24166fc00/0xabf1cc0bc784185c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7841855 expref: 17 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773064.542777:0:6472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d24166fc00, rc 0) 00000100:00100000:3.0:1790773064.542876:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:6475:x1877761495967616:12345-0@lo:101: Request processed in 199us (4840us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773064.542882:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1790773064.542975:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f976680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495967616:0@lo:101: 00010000:00010000:3.0:1790773064.542994:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3a00/0xabf1cc0bc7841855 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc784185c expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773064.543005:0:6475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3a00/0xabf1cc0bc7841855 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc784185c expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773064.543091:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495967744:0@lo:501: 00000100:00100000:3.0:1790773064.543127:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773064.543156:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ef106c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790773064.543170:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495967744 00000100:00100000:3.0:1790773064.543173:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495967744 00000100:00100000:3.0:1790773064.543191:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1790773064.543197:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c696050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:6475:x1877761495967744:12345-0@lo:501: 00000100:00100000:3.0:1790773064.544201:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c696050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:6475:x1877761495967744:12345-0@lo:501: Request processed in 1000us (1069us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773064.544231:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1790773064.544281:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495967744:0@lo:501: 00000100:00100000:3.0:1790773064.544327:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495967872:0@lo:503: 00000100:00100000:3.0:1790773064.544372:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773064.544387:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ef106c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790773064.544400:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495967872 00000100:00100000:3.0:1790773064.544405:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495967872 00000100:00100000:3.0:1790773064.544548:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1790773064.544557:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c696850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:6475:x1877761495967872:12345-0@lo:503: 00000100:00100000:3.0:1790773064.544704:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c696850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:6475:x1877761495967872:12345-0@lo:503: Request processed in 149us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773064.544711:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1790773064.544750:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495967872:0@lo:503: 00000100:00100000:3.0:1790773064.545102:0:9860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437de300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:9860:1877761495968000:0@lo:502: 00000100:00100000:3.0:1790773064.545140:0:9860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773064.545164:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495968000 00000100:00100000:3.0:1790773064.545168:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495968000 00000100:00100000:3.0:1790773064.545187:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1790773064.545193:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c694c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:9860:x1877761495968000:12345-0@lo:502: 00000100:00100000:3.0:1790773064.545286:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c694c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:9860:x1877761495968000:12345-0@lo:502: Request processed in 93us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773064.545293:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1790773064.545335:0:9860:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ef10180 going to sleep for 11 seconds 00000100:00100000:3.0:1790773064.545348:0:9860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437de300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:9860:1877761495968000:0@lo:502: 00000020:01000000:3.0:1790773064.545369:0:9860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790773064.545379:0:9860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773064.545381:0:9860:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790773064.545387:0:9860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790773064.545390:0:9860:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1790773064.545405:0:9860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437de300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:9860:1877761495968128:0@lo:502: 00000100:00100000:3.0:1790773064.545748:0:9860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773064.545771:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495968128 00000100:00100000:3.0:1790773064.545774:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495968128 00000100:00100000:3.0:1790773064.545792:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1790773064.545799:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c695450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:9860:x1877761495968128:12345-0@lo:502: 00000100:00100000:3.0:1790773064.545859:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c695450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:9860:x1877761495968128:12345-0@lo:502: Request processed in 60us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773064.545866:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1790773064.545895:0:9860:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ef10180 going to sleep for 11 seconds 00000100:00100000:3.0:1790773064.545908:0:9860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437de300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:9860:1877761495968128:0@lo:502: 00000020:01000000:3.0:1790773064.545935:0:9860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790773064.545940:0:9860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773064.545941:0:9860:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:3.0:1790773064.545945:0:9860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1790773064.546936:0:6475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1790773064.548160:0:6475:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1790773064.548175:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3a00/0xabf1cc0bc7841855 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc784185c expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773064.548189:0:6475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3a00/0xabf1cc0bc7841855 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc784185c expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773064.548199:0:6475:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1790773064.548214:0:6475:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93d26ed89000 from 39 10000000:01000000:3.0:1790773064.548218:0:6475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790773064.548253:0:6475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d24166fa00/0xabf1cc0bc7841863 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773064.548262:0:6475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d24166fa00/0xabf1cc0bc7841863 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773064.548281:0:6475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d24166fa00/0xabf1cc0bc7841863 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773064.548729:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495968256:0@lo:101: 00000100:00100000:3.0:1790773064.548794:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773064.548827:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ef10180 going to sleep for 11 seconds 00000100:00100000:3.0:1790773064.548855:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495968256 00000100:00100000:3.0:1790773064.548862:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495968256 00000100:00100000:3.0:1790773064.548904:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1790773064.548912:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c697850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:6475:x1877761495968256:12345-0@lo:101: 00010000:00010000:3.0:1790773064.548937:0:6472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773064.548949:0:6472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d24166ee00/0xabf1cc0bc784186a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7841863 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773064.549468:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d24166ee00/0xabf1cc0bc784186a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7841863 expref: 18 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773064.549480:0:6472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d24166ee00/0xabf1cc0bc784186a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7841863 expref: 18 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773064.549490:0:6472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d24166ee00, rc 0) 00000100:00100000:3.0:1790773064.549534:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c697850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:6475:x1877761495968256:12345-0@lo:101: Request processed in 621us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773064.549540:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1790773064.549603:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495968256:0@lo:101: 00010000:00010000:3.0:1790773064.550078:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d24166fa00/0xabf1cc0bc7841863 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc784186a expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773064.550100:0:6475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d24166fa00/0xabf1cc0bc7841863 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc784186a expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773064.550164:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495968384:0@lo:501: 00000100:00100000:3.0:1790773064.550200:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773064.550250:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ef10180 going to sleep for 11 seconds 00000100:00100000:3.0:1790773064.550267:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495968384 00000100:00100000:3.0:1790773064.550273:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495968384 00000100:00100000:3.0:1790773064.550903:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1790773064.550927:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c696c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:6475:x1877761495968384:12345-0@lo:501: 00000100:00100000:3.0:1790773064.551197:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c696c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:6475:x1877761495968384:12345-0@lo:501: Request processed in 283us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773064.551229:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1790773064.551757:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495968384:0@lo:501: 00000100:00100000:0.0:1790773064.551789:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f975500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495968512:0@lo:503: 00000100:00100000:0.0:1790773064.551837:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773064.551863:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d14323a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790773064.552060:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495968512 00000100:00100000:3.0:1790773064.552065:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495968512 00000100:00100000:3.0:1790773064.552098:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1790773064.552103:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c694850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:6475:x1877761495968512:12345-0@lo:503: 00000100:00100000:3.0:1790773064.552180:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c694850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:6475:x1877761495968512:12345-0@lo:503: Request processed in 77us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773064.552185:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1790773064.552377:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f975500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495968512:0@lo:503: 00000100:00100000:2.0:1790773064.557253:0:9861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1434bad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:9861:1877761495968640:0@lo:502: 00000100:00100000:2.0:1790773064.557362:0:9861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773064.557404:0:9861:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279ed93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790773064.561490:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495968640 00000100:00100000:1.0:1790773064.561506:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495968640 00000100:00100000:1.0:1790773064.561562:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1790773064.561571:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c694050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:9861:x1877761495968640:12345-0@lo:502: 00000100:00100000:1.0:1790773064.561754:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c694050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:9861:x1877761495968640:12345-0@lo:502: Request processed in 183us (4391us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773064.561762:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1790773064.562418:0:9861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1434bad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:9861:1877761495968640:0@lo:502: 00000100:00100000:2.0:1790773064.562498:0:9861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1434bad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:9861:1877761495968768:0@lo:502: 00000100:00100000:2.0:1790773064.562545:0:9861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773064.562579:0:9861:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279ed93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790773064.562984:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495968768 00000100:00100000:1.0:1790773064.562991:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495968768 00000100:00100000:1.0:1790773064.563027:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1790773064.563040:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c696450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:9861:x1877761495968768:12345-0@lo:502: 00000100:00100000:1.0:1790773064.563144:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c696450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:9861:x1877761495968768:12345-0@lo:502: Request processed in 102us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773064.563152:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1790773064.563244:0:9861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1434bad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:9861:1877761495968768:0@lo:502: 00000040:00080000:2.0:1790773064.563266:0:9861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1790773064.563504:0:6475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1790773064.563525:0:6475:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790773064.563534:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d24166fa00/0xabf1cc0bc7841863 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc784186a expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773064.563546:0:6475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d24166fa00/0xabf1cc0bc7841863 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc784186a expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790773064.563555:0:6475:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790773064.563558:0:6475:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93d26ed89000 from 6 10000000:01000000:1.0:1790773064.563561:0:6475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790773064.563586:0:6475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12aa00/0xabf1cc0bc7841871 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773064.563601:0:6475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d27b12aa00/0xabf1cc0bc7841871 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773064.563726:0:6475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d27b12aa00/0xabf1cc0bc7841871 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773064.563742:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ec61180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495968896:0@lo:101: 00000100:00100000:1.0:1790773064.563768:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773064.563795:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d143130e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790773064.563813:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495968896 00000100:00100000:0.0:1790773064.563819:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495968896 00000100:00100000:0.0:1790773064.563846:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1790773064.563852:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c695c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:6475:x1877761495968896:12345-0@lo:101: 00010000:00010000:0.0:1790773064.563867:0:6473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773064.563881:0:6473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d26c4a3e00/0xabf1cc0bc7841878 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7841871 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773064.563902:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d26c4a3e00/0xabf1cc0bc7841878 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7841871 expref: 19 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773064.563913:0:6473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d26c4a3e00/0xabf1cc0bc7841878 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7841871 expref: 19 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773064.563929:0:6473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26c4a3e00, rc 0) 00000100:00100000:0.0:1790773064.563970:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c695c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+19:6475:x1877761495968896:12345-0@lo:101: Request processed in 117us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773064.563976:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1790773064.564091:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ec61180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495968896:0@lo:101: 00010000:00010000:1.0:1790773064.564102:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d27b12aa00/0xabf1cc0bc7841871 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841878 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773064.564108:0:6475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d27b12aa00/0xabf1cc0bc7841871 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7841878 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773064.564142:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ec61180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495969024:0@lo:256: 00000100:00100000:1.0:1790773064.564172:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773064.564196:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d143130e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790773064.564477:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495969024 00000100:00100000:0.0:1790773064.564483:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495969024 00000100:00100000:0.0:1790773064.564510:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1790773064.564516:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c695050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+19:6475:x1877761495969024:12345-0@lo:256: 20000000:01000000:0.0:1790773064.564531:0:6472:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790773064.564548:0:6472:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790773064.564550:0:6472:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1790773064.564883:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c695050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+19:6475:x1877761495969024:12345-0@lo:256: Request processed in 365us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773064.564890:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1790773064.565094:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ec61180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495969024:0@lo:256: 10000000:01000000:1.0:1790773064.565135:0:6475:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790773064.565142:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12aa00/0xabf1cc0bc7841871 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841878 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773064.565152:0:6475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d27b12aa00/0xabf1cc0bc7841871 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841878 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790773064.565161:0:6475:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1790773064.565163:0:6475:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:1.0:1790773064.565170:0:6475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1790773064.565189:0:6475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12ba00/0xabf1cc0bc784187f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773064.565197:0:6475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d27b12ba00/0xabf1cc0bc784187f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773064.565237:0:6475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d27b12ba00/0xabf1cc0bc784187f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773064.565250:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ec61180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495969152:0@lo:101: 00000100:00100000:1.0:1790773064.565274:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773064.565350:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d143130e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790773064.566397:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495969152 00000100:00100000:1.0:1790773064.566407:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495969152 00000100:00100000:1.0:1790773064.566511:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1790773064.566520:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c697c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+19:6475:x1877761495969152:12345-0@lo:101: 00010000:00010000:1.0:1790773064.566533:0:6471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773064.566546:0:6471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d27b12a800/0xabf1cc0bc7841886 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc784187f expref: -99 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773064.566567:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d27b12a800/0xabf1cc0bc7841886 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc784187f expref: 20 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773064.566578:0:6471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d27b12a800/0xabf1cc0bc7841886 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc784187f expref: 20 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773064.566586:0:6471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12a800, rc 0) 00000100:00100000:1.0:1790773064.566766:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c697c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+20:6475:x1877761495969152:12345-0@lo:101: Request processed in 247us (1491us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773064.566787:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1790773064.566836:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ec61180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495969152:0@lo:101: 00010000:00010000:1.0:1790773064.566850:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d27b12ba00/0xabf1cc0bc784187f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841886 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773064.566860:0:6475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d27b12ba00/0xabf1cc0bc784187f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7841886 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773064.566934:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ec61180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495969280:0@lo:501: 00000100:00100000:1.0:1790773064.566976:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773064.567003:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d143130e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790773064.567017:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495969280 00000100:00100000:1.0:1790773064.567021:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495969280 00000100:00100000:1.0:1790773064.567043:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1790773064.567048:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c697050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+20:6475:x1877761495969280:12345-0@lo:501: 00000100:00100000:1.0:1790773064.567156:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c697050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+20:6475:x1877761495969280:12345-0@lo:501: Request processed in 107us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773064.567162:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1790773064.567188:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ec61180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495969280:0@lo:501: 00000100:00100000:1.0:1790773064.567232:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ec61180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495969408:0@lo:503: 00000100:00100000:1.0:1790773064.567269:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773064.567285:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d143130e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790773064.567310:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495969408 00000100:00100000:1.0:1790773064.567314:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495969408 00000100:00100000:1.0:1790773064.567330:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1790773064.567334:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c697450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+20:6475:x1877761495969408:12345-0@lo:503: 00000100:00100000:1.0:1790773064.567411:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c697450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+20:6475:x1877761495969408:12345-0@lo:503: Request processed in 76us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773064.567418:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1790773064.567426:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ec61180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495969408:0@lo:503: 00000100:00100000:3.0:1790773064.576319:0:9862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437dc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:9862:1877761495969536:0@lo:502: 00000100:00100000:3.0:1790773064.576412:0:9862:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773064.576465:0:9862:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ef103c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790773064.578457:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495969536 00000100:00100000:3.0:1790773064.578470:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495969536 00000100:00100000:3.0:1790773064.578540:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1790773064.578564:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c695850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+20:9862:x1877761495969536:12345-0@lo:502: 00000100:00100000:3.0:1790773064.578767:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c695850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+20:9862:x1877761495969536:12345-0@lo:502: Request processed in 205us (2355us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773064.578776:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1790773064.578844:0:9862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437dc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:9862:1877761495969536:0@lo:502: 00000020:01000000:3.0:1790773064.578877:0:9862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790773064.578886:0:9862:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1790773064.578892:0:9862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773064.578895:0:9862:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1790773064.578901:0:9862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1790773064.578905:0:9862:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.119@tcp to nid 0x20000c0a8ca77 (192.168.202.119@tcp) 00000020:01000000:3.0:1790773064.578938:0:9862:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1790773064.578941:0:9862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790773064.579740:0:9862:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff93d281bacd40) 00000020:00000080:3.0:1790773064.579771:0:9862:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1790773064.579781:0:9862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790773064.579882:0:9862:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1790773064.579890:0:9862:0:(osd_handler.c:8931:osd_obd_connect()) connect #5 00000020:00000080:3.0:1790773064.579896:0:9862:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xabf1cc0bc7841894 00010000:00080000:3.0:1790773064.579938:0:9862:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d27c37f800@lustre-OST0001-osc-MDT0001: add connection 192.168.202.119@tcp at head 00010000:00010000:3.0:1790773064.580942:0:9862:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:3.0:1790773064.582900:0:9862:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1790773064.582929:0:9862:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1790773064.584282:0:9862:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790773064.584750:0:9862:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790773064.584904:0:9862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1790773064.586549:0:9862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1790773064.595897:0:9863:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790773064.595907:0:9863:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1790773064.606659:0:9862:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1790773064.606673:0:9862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1790773064.606718:0:9862:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1790773064.606750:0:9862:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xabf1cc0bc784189b 00000100:00080000:0.0:1790773064.606759:0:9862:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790773064.606778:0:9862:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff93d27c37f800 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:0.0:1790773064.606812:0:9862:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d27f975500 x1877761495969664/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790773064.606838:0:9862:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1790773064.607024:0:9862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790773064.607029:0:9862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773064.607031:0:9862:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1790773064.607034:0:9862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790773064.607039:0:9862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773064.607040:0:9862:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790773064.607043:0:9862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790773064.607045:0:9862:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1790773064.607070:0:9862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f977480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:9862:1877761495971072:0@lo:502: 00000100:00100000:0.0:1790773064.607145:0:9862:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773064.607180:0:9862:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d14323a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790773064.607852:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f975500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761495969664:0@lo:8: 00000100:00100000:3.0:1790773064.607897:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773064.607976:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495971072 00000100:00100000:3.0:1790773064.607983:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495971072 00000100:00100000:3.0:1790773064.608030:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1790773064.608038:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c694450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+20:9862:x1877761495971072:12345-0@lo:502: 00000100:00100000:3.0:1790773064.608174:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c694450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+20:9862:x1877761495971072:12345-0@lo:502: Request processed in 136us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773064.608181:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1790773064.608413:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f974380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3605:1877761495969792:0@lo:400: 00000100:00100000:1.0:1790773064.608566:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773064.608714:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3605:1877761495970304:0@lo:400: 00000100:00100000:1.0:1790773064.608744:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773064.608765:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3605:1877761495970816:0@lo:400: 00000100:00100000:1.0:1790773064.608801:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773064.608824:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1790773064.608831:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3605:1877761495970176:0@lo:400: 00000100:00100000:1.0:1790773064.608867:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773064.608886:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f977b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761495970688:0@lo:400: 00000100:00100000:1.0:1790773064.608914:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773064.609056:0:8906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495969664 00000100:00100000:0.0:1790773064.609063:0:8906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495969664 00000100:00100000:0.0:1790773064.609088:0:8906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495970688 00000100:00100000:0.0:1790773064.609091:0:8906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495970688 00000100:00100000:0.0:1790773064.609125:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790773064.609134:0:8906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761495970688:12345-0@lo:400: 00000100:00100000:0.0:1790773064.609179:0:8906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761495970688:12345-0@lo:400: Request processed in 47us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773064.609185:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790773064.609199:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790773064.609226:0:8906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3603:x1877761495969664:12345-0@lo:8: 00010000:00080000:0.0:1790773064.609249:0:8906:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 207 last 0 00000020:00000080:0.0:1790773064.609279:0:8906:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xabf1cc0bc78418a2 00002000:00100000:0.0:1790773064.609293:0:8906:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff93d143271800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b04 ocd_grant: 0 ocd_index: 1 ocd_group 1 00000100:00100000:2.0:1790773064.609409:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f976680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761495970048:0@lo:400: 00000100:00100000:1.0:1790773064.609578:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761495969920:0@lo:400: 00000100:00100000:3.0:1790773064.609773:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495969792 00000100:00100000:3.0:1790773064.609778:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495969792 00000100:00100000:3.0:1790773064.609801:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495970304 00000100:00100000:3.0:1790773064.609803:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495970304 00000100:00100000:3.0:1790773064.609816:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495970816 00000100:00100000:3.0:1790773064.609818:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495970816 00000100:00100000:3.0:1790773064.609828:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495970176 00000100:00100000:3.0:1790773064.609831:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495970176 00000100:00100000:3.0:1790773064.609845:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790773064.609851:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ec60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3605:x1877761495969792:12345-0@lo:400: 00002000:00080000:0.0:1790773064.609893:0:8906:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:0.0:1790773064.609897:0:8906:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1790773064.609978:0:8906:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1790773064.610227:0:8906:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1790773064.610261:0:8906:0:(import.c:65:import_set_state_nolock()) ffff93d143275800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790773064.614811:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773064.614869:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761495970560:0@lo:400: 00000100:00100000:2.0:1790773064.614911:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773064.614997:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790773064.615011:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ec61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3605:x1877761495970304:12345-0@lo:400: 00000100:00100000:2.0:1790773064.615069:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ec61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3605:x1877761495970304:12345-0@lo:400: Request processed in 64us (6324us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773064.615077:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790773064.615100:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790773064.615107:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ec61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3605:x1877761495970816:12345-0@lo:400: 00000100:00100000:2.0:1790773064.615155:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ec61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3605:x1877761495970816:12345-0@lo:400: Request processed in 49us (6353us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773064.615162:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790773064.615176:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790773064.615182:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ec63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3605:x1877761495970176:12345-0@lo:400: 00000100:00100000:2.0:1790773064.615231:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ec63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3605:x1877761495970176:12345-0@lo:400: Request processed in 49us (6364us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773064.615237:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790773064.615263:0:8392:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495970560 00000100:00100000:2.0:1790773064.615270:0:8392:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495970560 00000100:00100000:2.0:1790773064.615313:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790773064.615320:0:8392:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1434bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761495970560:12345-0@lo:400: 00000100:00100000:2.0:1790773064.615355:0:8392:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1434bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761495970560:12345-0@lo:400: Request processed in 35us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773064.615361:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790773064.615385:0:7666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495970048 00000100:00100000:2.0:1790773064.615389:0:7666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495970048 00000100:00100000:2.0:1790773064.615413:0:7666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790773064.615419:0:7666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1434bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761495970048:12345-0@lo:400: 00000100:00100000:2.0:1790773064.615813:0:7666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1434bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761495970048:12345-0@lo:400: Request processed in 393us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773064.615820:0:7666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790773064.615863:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f976680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761495970048:0@lo:400: 00010000:00080000:2.0:1790773064.615877:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f976d80 x1877761495970560/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773080 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773064.615886:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761495970560:0@lo:400: 00000100:00100000:1.0:1790773064.620715:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773064.620792:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3606:1877761495970432:0@lo:400: 00000100:00100000:1.0:1790773064.620844:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773064.620864:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3606:1877761495970944:0@lo:400: 00000100:00100000:1.0:1790773064.620888:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790773064.620952:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790773064.621083:0:6483:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495969920 00000100:00100000:2.0:1790773064.621093:0:6483:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495969920 00000100:00100000:2.0:1790773064.621144:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790773064.621155:0:6483:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761495969920:12345-0@lo:400: 00000100:00100000:2.0:1790773064.621267:0:6483:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761495969920:12345-0@lo:400: Request processed in 113us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773064.621275:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790773064.621318:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495970432 00000100:00100000:2.0:1790773064.621322:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495970432 00000100:00100000:2.0:1790773064.621348:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495970944 00000100:00100000:2.0:1790773064.621351:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495970944 00000100:00100000:2.0:1790773064.621365:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790773064.621371:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1877761495970432:12345-0@lo:400: 00000100:00100000:2.0:1790773064.621402:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1877761495970432:12345-0@lo:400: Request processed in 32us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773064.621409:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790773064.621421:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790773064.621438:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3606:x1877761495970944:12345-0@lo:400: 00000100:00080000:1.0:1790773064.621768:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790773064.621772:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790773064.621822:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f975880 x1877761495970176/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773080 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773064.621837:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3605:1877761495970176:0@lo:400: 00010000:00080000:1.0:1790773064.621850:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f977b80 x1877761495970688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773080 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773064.621859:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f977b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761495970688:0@lo:400: 00010000:00080000:1.0:1790773064.621873:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f975f80 x1877761495970304/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773080 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773064.621880:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3605:1877761495970304:0@lo:400: 00010000:00080000:1.0:1790773064.621891:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f976a00 x1877761495970816/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773080 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773064.621898:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3605:1877761495970816:0@lo:400: 00000100:00100000:3.0:1790773064.622271:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ec60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3605:x1877761495969792:12345-0@lo:400: Request processed in 12417us (13703us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773064.622279:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1790773064.622329:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f974380 x1877761495969792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773080 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773064.622339:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f974380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3605:1877761495969792:0@lo:400: 00000100:00100000:2.0:1790773064.622507:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3606:x1877761495970944:12345-0@lo:400: Request processed in 1079us (1617us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773064.622514:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790773064.622558:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761495969920:0@lo:400: 00010000:00080000:2.0:1790773064.622570:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f976300 x1877761495970432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773080 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773064.622578:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3606:1877761495970432:0@lo:400: 00010000:00080000:2.0:1790773064.622586:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f974a80 x1877761495970944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773080 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773064.622791:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3606:1877761495970944:0@lo:400: 00000100:00100000:1.0:1790773064.626778:0:9862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f977480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:9862:1877761495971072:0@lo:502: 00000020:01000000:1.0:1790773064.626824:0:9862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790773064.626834:0:9862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790773064.626836:0:9862:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:1.0:1790773064.626842:0:9862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000100:00100000:0.0:1790773064.627717:0:8906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3603:x1877761495969664:12345-0@lo:8: Request processed in 18484us (19813us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773064.627730:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1790773064.627904:0:3603:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f975500 x1877761495969664/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790773074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773064.627924:0:3603:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790773064.627934:0:3603:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1790773064.627942:0:3603:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1790773064.627947:0:3603:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1790773064.627951:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d27c37f800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1790773064.627979:0:3603:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1790773064.627993:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f975500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761495969664:0@lo:8: 00000004:00080000:1.0:1790773064.628019:0:9863:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1790773064.628097:0:9863:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 207429891708ns, next at 0ns, rc = 0 00080000:00080000:1.0:1790773064.628104:0:9863:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1790773064.629487:0:9864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f974700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9864:1877761495971200:0@lo:700: 00000100:00100000:0.0:1790773064.629552:0:9864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773064.629602:0:8402:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495971200 00000100:00100000:0.0:1790773064.629669:0:8402:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495971200 00000100:00100000:0.0:1790773064.629725:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790773064.629733:0:8402:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f974000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9864:x1877761495971200:12345-0@lo:700: 00000100:00100000:0.0:1790773064.629767:0:8402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f975500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8402:1877761495971328:0@lo:700: 00000100:00100000:0.0:1790773064.629798:0:8402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773064.629822:0:8402:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d14323a840 going to sleep for 11 seconds 00000100:00080000:0.0:1790773064.629837:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790773064.629846:0:9864:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d14323a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790773064.629966:0:6485:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495971328 00000100:00100000:2.0:1790773064.629970:0:6485:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495971328 00000100:00100000:2.0:1790773064.630003:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790773064.630010:0:6485:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8402:x1877761495971328:12345-0@lo:700: 00000004:00080000:1.0:1790773064.631284:0:7410:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000020:01000000:3.0:1790773064.634141:0:6475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:3.0:1790773064.634182:0:6475:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1790773064.634195:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12ba00/0xabf1cc0bc784187f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841886 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773064.634379:0:6475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d27b12ba00/0xabf1cc0bc784187f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841886 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773064.634402:0:6475:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1790773064.634405:0:6475:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93d25268e800 from 39 10000000:01000000:3.0:1790773064.634408:0:6475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790773064.634981:0:6475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d279de2000/0xabf1cc0bc78418a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773064.634992:0:6475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d279de2000/0xabf1cc0bc78418a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773064.635005:0:6475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d279de2000/0xabf1cc0bc78418a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773064.635029:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495971456:0@lo:101: 00000100:00100000:3.0:1790773064.635097:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773064.635144:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c380600 going to sleep for 11 seconds 00000100:00100000:2.0:1790773064.636128:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495971456 00000100:00100000:2.0:1790773064.636140:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495971456 00000100:00100000:2.0:1790773064.636194:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1790773064.636223:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+20:6475:x1877761495971456:12345-0@lo:101: 00010000:00010000:2.0:1790773064.636240:0:6471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773064.636255:0:6471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d26efc4000/0xabf1cc0bc78418b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc78418a9 expref: -99 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773064.636280:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d26efc4000/0xabf1cc0bc78418b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc78418a9 expref: 21 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773064.636292:0:6471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d26efc4000/0xabf1cc0bc78418b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78418a9 expref: 21 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773064.636310:0:6471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26efc4000, rc 0) 00000100:00100000:2.0:1790773064.636365:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:6475:x1877761495971456:12345-0@lo:101: Request processed in 163us (1268us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773064.636373:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1790773064.637977:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495971456:0@lo:101: 00010000:00010000:3.0:1790773064.638000:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d279de2000/0xabf1cc0bc78418a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78418b0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773064.638010:0:6475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d279de2000/0xabf1cc0bc78418a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc78418b0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773064.638081:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495971584:0@lo:501: 00000100:00100000:3.0:1790773064.638129:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773064.638170:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c380600 going to sleep for 11 seconds 00000100:00100000:2.0:1790773064.638588:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495971584 00000100:00100000:2.0:1790773064.638607:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495971584 00000100:00100000:2.0:1790773064.638652:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1790773064.638662:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:6475:x1877761495971584:12345-0@lo:501: 00000100:00100000:2.0:1790773064.638801:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:6475:x1877761495971584:12345-0@lo:501: Request processed in 140us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773064.638809:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1790773064.639102:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495971584:0@lo:501: 00000100:00100000:3.0:1790773064.639133:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495971712:0@lo:503: 00000100:00100000:3.0:1790773064.639179:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773064.639240:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c380600 going to sleep for 11 seconds 00000100:00100000:3.0:1790773064.639265:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495971712 00000100:00100000:3.0:1790773064.639269:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495971712 00000100:00100000:3.0:1790773064.639367:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1790773064.639375:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:6475:x1877761495971712:12345-0@lo:503: 00000100:00100000:3.0:1790773064.639526:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:6475:x1877761495971712:12345-0@lo:503: Request processed in 151us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773064.639533:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1790773064.639577:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495971712:0@lo:503: 00000100:00100000:3.0:1790773064.649087:0:9866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437dca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:9866:1877761495971840:0@lo:502: 00000100:00100000:3.0:1790773064.649173:0:9866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773064.649234:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495971840 00000100:00100000:3.0:1790773064.649241:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495971840 00000100:00100000:3.0:1790773064.649284:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1790773064.649293:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:9866:x1877761495971840:12345-0@lo:502: 00000100:00100000:3.0:1790773064.649416:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:9866:x1877761495971840:12345-0@lo:502: Request processed in 123us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773064.649425:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1790773064.649481:0:9866:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c380300 going to sleep for 11 seconds 00000100:00100000:3.0:1790773064.649501:0:9866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437dca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:9866:1877761495971840:0@lo:502: 00000100:00100000:3.0:1790773064.649546:0:9866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437dca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:9866:1877761495971968:0@lo:502: 00000100:00100000:3.0:1790773064.649578:0:9866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773064.649594:0:9866:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c380300 going to sleep for 11 seconds 40000000:02000000:0.0:1790773064.650894:0:6485:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:0.0:1790773064.657347:0:6485:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8402:x1877761495971328:12345-0@lo:700: Request processed in 27329us (27539us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773064.657362:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1790773064.657490:0:8402:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f975500 x1877761495971328/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1790773080 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773064.657506:0:8402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f975500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8402:1877761495971328:0@lo:700: 40000000:02000000:0.0:1790773064.657537:0:8402:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:1.0:1790773064.659595:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495971968 00000100:00100000:1.0:1790773064.659617:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495971968 00000100:00100000:1.0:1790773064.659683:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1790773064.659693:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:9866:x1877761495971968:12345-0@lo:502: 00000100:00100000:1.0:1790773064.659864:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:9866:x1877761495971968:12345-0@lo:502: Request processed in 171us (10284us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773064.659873:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1790773064.660584:0:9866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437dca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:9866:1877761495971968:0@lo:502: 00000040:00080000:3.0:1790773064.660713:0:9866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1790773064.660783:0:6475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1790773064.660804:0:6475:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790773064.660814:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d279de2000/0xabf1cc0bc78418a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78418b0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773064.660825:0:6475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d279de2000/0xabf1cc0bc78418a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78418b0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773064.660835:0:6475:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1790773064.660838:0:6475:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93d25268e800 from 6 10000000:01000000:3.0:1790773064.660841:0:6475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790773064.660875:0:6475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d279de3800/0xabf1cc0bc78418b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773064.660885:0:6475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d279de3800/0xabf1cc0bc78418b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773064.660894:0:6475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d279de3800/0xabf1cc0bc78418b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773064.660927:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495972096:0@lo:101: 00000100:00100000:3.0:1790773064.661050:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773064.661084:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c380300 going to sleep for 11 seconds 00000100:00100000:3.0:1790773064.661101:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495972096 00000100:00100000:3.0:1790773064.661107:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495972096 00000100:00100000:3.0:1790773064.661142:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1790773064.661149:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:6475:x1877761495972096:12345-0@lo:101: 00010000:00010000:3.0:1790773064.661160:0:6471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773064.661178:0:6471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d279de2800/0xabf1cc0bc78418be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc78418b7 expref: -99 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773064.661200:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d279de2800/0xabf1cc0bc78418be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc78418b7 expref: 22 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773064.661230:0:6471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d279de2800/0xabf1cc0bc78418be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78418b7 expref: 22 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773064.661239:0:6471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d279de2800, rc 0) 00000100:00100000:3.0:1790773064.661272:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+22:6475:x1877761495972096:12345-0@lo:101: Request processed in 123us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773064.661278:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1790773064.661384:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495972096:0@lo:101: 00010000:00010000:3.0:1790773064.661396:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d279de3800/0xabf1cc0bc78418b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78418be expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773064.661405:0:6475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d279de3800/0xabf1cc0bc78418b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc78418be expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773064.661511:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495972224:0@lo:256: 00000100:00100000:3.0:1790773064.661544:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773064.661557:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c380300 going to sleep for 11 seconds 00000100:00100000:3.0:1790773064.661570:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495972224 00000100:00100000:3.0:1790773064.661573:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495972224 00000100:00100000:3.0:1790773064.661725:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1790773064.661733:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+22:6475:x1877761495972224:12345-0@lo:256: 20000000:01000000:3.0:1790773064.661747:0:6473:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790773064.661763:0:6473:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790773064.661769:0:6473:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1790773064.661946:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+22:6475:x1877761495972224:12345-0@lo:256: Request processed in 215us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773064.661963:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1790773064.666417:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495972224:0@lo:256: 10000000:01000000:1.0:1790773064.666559:0:6475:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790773064.666571:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d279de3800/0xabf1cc0bc78418b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78418be expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773064.666582:0:6475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d279de3800/0xabf1cc0bc78418b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78418be expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790773064.666948:0:6475:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1790773064.666952:0:6475:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1790773064.666965:0:6475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1790773064.667005:0:6475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12a000/0xabf1cc0bc78418c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773064.667013:0:6475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d27b12a000/0xabf1cc0bc78418c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773064.667038:0:6475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d27b12a000/0xabf1cc0bc78418c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773064.667056:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495972352:0@lo:101: 00000100:00100000:1.0:1790773064.667122:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773064.667167:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d143130240 going to sleep for 11 seconds 00000100:00100000:3.0:1790773064.667378:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495972352 00000100:00100000:3.0:1790773064.667387:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495972352 00000100:00100000:3.0:1790773064.667446:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1790773064.667456:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+22:6475:x1877761495972352:12345-0@lo:101: 00010000:00010000:3.0:1790773064.667469:0:6473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773064.667482:0:6473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d279de2c00/0xabf1cc0bc78418cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc78418c5 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773064.667505:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d279de2c00/0xabf1cc0bc78418cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc78418c5 expref: 23 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773064.667515:0:6473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d279de2c00/0xabf1cc0bc78418cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78418c5 expref: 23 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773064.667523:0:6473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d279de2c00, rc 0) 00000100:00100000:3.0:1790773064.667567:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+23:6475:x1877761495972352:12345-0@lo:101: Request processed in 112us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773064.667574:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1790773064.667633:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495972352:0@lo:101: 00010000:00010000:3.0:1790773064.667646:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d27b12a000/0xabf1cc0bc78418c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78418cc expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773064.667655:0:6475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d27b12a000/0xabf1cc0bc78418c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc78418cc expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773064.667726:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495972480:0@lo:501: 00000100:00100000:3.0:1790773064.667753:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773064.667768:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c3803c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790773064.667783:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495972480 00000100:00100000:3.0:1790773064.667787:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495972480 00000100:00100000:3.0:1790773064.667809:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1790773064.667814:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+23:6475:x1877761495972480:12345-0@lo:501: 00000100:00100000:3.0:1790773064.667940:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+23:6475:x1877761495972480:12345-0@lo:501: Request processed in 125us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773064.667947:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1790773064.667993:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495972480:0@lo:501: 00000100:00100000:3.0:1790773064.668018:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495972608:0@lo:503: 00000100:00100000:3.0:1790773064.668059:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773064.668071:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c3803c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790773064.668082:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495972608 00000100:00100000:3.0:1790773064.668085:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495972608 00000100:00100000:3.0:1790773064.668103:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1790773064.668107:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+23:6475:x1877761495972608:12345-0@lo:503: 00000100:00100000:3.0:1790773064.668180:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+23:6475:x1877761495972608:12345-0@lo:503: Request processed in 72us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773064.668187:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1790773064.668252:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495972608:0@lo:503: 00000100:00100000:1.0:1790773064.669876:0:9867:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:9867:1877761495972736:0@lo:502: 00000100:00100000:1.0:1790773064.669963:0:9867:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773064.670000:0:9867:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d143130240 going to sleep for 11 seconds 00000100:00100000:3.0:1790773064.670096:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495972736 00000100:00100000:3.0:1790773064.670103:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495972736 00000100:00100000:3.0:1790773064.670156:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1790773064.670164:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+23:9867:x1877761495972736:12345-0@lo:502: 00000100:00100000:3.0:1790773064.670561:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+23:9867:x1877761495972736:12345-0@lo:502: Request processed in 396us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773064.670567:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1790773064.670756:0:9867:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:9867:1877761495972736:0@lo:502: 00000020:01000000:3.0:1790773064.670783:0:9867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790773064.670790:0:9867:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1790773064.670798:0:9867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773064.670800:0:9867:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1790773064.670806:0:9867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1790773064.670811:0:9867:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.119@tcp to nid 0x20000c0a8ca77 (192.168.202.119@tcp) 00000020:01000000:3.0:1790773064.670834:0:9867:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1790773064.670837:0:9867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790773064.670851:0:9867:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff93d281bab380) 00000020:00000080:3.0:1790773064.670874:0:9867:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:3.0:1790773064.670878:0:9867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790773064.671048:0:9867:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1790773064.671055:0:9867:0:(osd_handler.c:8931:osd_obd_connect()) connect #7 00000020:00000080:3.0:1790773064.671062:0:9867:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xabf1cc0bc78418da 00010000:00080000:3.0:1790773064.671098:0:9867:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d1437ed800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.119@tcp at head 00010000:00010000:3.0:1790773064.671586:0:9867:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:3.0:1790773064.671860:0:9867:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1790773064.671873:0:9867:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1790773064.672895:0:9867:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790773064.673127:0:9867:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790773064.673500:0:9867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1790773064.673604:0:9867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000001:00100000:0.0:1790773064.675666:0:9475:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1790773064.675822:0:8402:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f974000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9864:x1877761495971200:12345-0@lo:700: Request processed in 46084us (46264us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773064.675836:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1790773064.675977:0:9864:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f974700 x1877761495971200/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790773080 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773064.675995:0:9864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f974700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9864:1877761495971200:0@lo:700: 00000040:00080000:3.0:1790773064.677377:0:9868:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790773064.677391:0:9868:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1790773064.678120:0:9867:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790773064.678132:0:9867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1790773064.678172:0:9867:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1790773064.678198:0:9867:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xabf1cc0bc78418e1 00000100:00080000:3.0:1790773064.678240:0:9867:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790773064.678251:0:9867:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93d1437ed800 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:3.0:1790773064.678287:0:9867:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d1437dea00 x1877761495972864/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790773064.678423:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761495972864:0@lo:8: 00000100:00100000:1.0:1790773064.678510:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790773064.678574:0:9867:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1790773064.678648:0:9867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790773064.678653:0:9867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773064.678655:0:9867:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1790773064.678658:0:9867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790773064.678662:0:9867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773064.678663:0:9867:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790773064.678666:0:9867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790773064.678667:0:9867:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1790773064.678693:0:9867:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437dce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:9867:1877761495972992:0@lo:502: 00000100:00100000:3.0:1790773064.678739:0:9867:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773064.678758:0:9867:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2500eda80 going to sleep for 11 seconds 00000100:00100000:0.0:1790773064.679073:0:8392:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495972864 00000100:00100000:0.0:1790773064.679082:0:8392:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495972864 00000100:00100000:0.0:1790773064.679126:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790773064.679133:0:8392:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3603:x1877761495972864:12345-0@lo:8: 00010000:00080000:0.0:1790773064.679162:0:8392:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 207 last 0 00000020:00000080:0.0:1790773064.679232:0:8392:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xabf1cc0bc78418e8 00002000:00100000:0.0:1790773064.679247:0:8392:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff93d143276800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b04 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1790773064.679251:0:8392:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1790773064.679254:0:8392:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1790773064.679360:0:8392:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1790773064.679389:0:8392:0:(import.c:65:import_set_state_nolock()) ffff93d143272800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790773064.683179:0:8392:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3603:x1877761495972864:12345-0@lo:8: Request processed in 4035us (4659us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773064.683193:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1790773064.683576:0:3603:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1437dea00 x1877761495972864/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790773074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773064.683600:0:3603:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790773064.683726:0:3603:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1790773064.683735:0:3603:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1790773064.683740:0:3603:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1790773064.683743:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d1437ed800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1790773064.683769:0:3603:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1790773064.683776:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761495972864:0@lo:8: 00000100:00100000:1.0:1790773064.683835:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495972992 00000100:00100000:1.0:1790773064.683845:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495972992 00000100:00100000:1.0:1790773064.683897:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1790773064.683931:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+23:9867:x1877761495972992:12345-0@lo:502: 00000100:00100000:0.0:1790773064.686890:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761495973120:0@lo:13: 00000100:00100000:0.0:1790773064.686990:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773064.687047:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495973120 00000100:00100000:0.0:1790773064.687054:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495973120 00000100:00100000:0.0:1790773064.687104:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790773064.687112:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f975500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3607:x1877761495973120:12345-0@lo:13: 00002000:00000024:0.0:1790773064.687152:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:0.0:1790773064.687196:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f975500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3607:x1877761495973120:12345-0@lo:13: Request processed in 83us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773064.687227:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1790773064.687248:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1790773064.687278:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f974700 x1877761495973120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773080 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773064.687309:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761495973120:0@lo:13: 00000004:00080000:0.0:1790773064.687331:0:9869:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1790773064.687351:0:9869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f974700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9869:1877761495973248:0@lo:7: 00000100:00100000:0.0:1790773064.687378:0:9869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773064.687400:0:8907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495973248 00000100:00100000:0.0:1790773064.687404:0:8907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495973248 00000100:00100000:0.0:1790773064.687672:0:8907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790773064.687681:0:8907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f974a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:9869:x1877761495973248:12345-0@lo:7: 00000004:00080000:2.0:1790773064.688063:0:9868:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1790773064.688133:0:9868:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 207489928457ns, next at 0ns, rc = 0 00080000:00080000:2.0:1790773064.688140:0:9868:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1790773064.691481:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+23:9867:x1877761495972992:12345-0@lo:502: Request processed in 7546us (12735us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773064.691495:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1790773064.691819:0:9867:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437dce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:9867:1877761495972992:0@lo:502: 00000020:01000000:3.0:1790773064.691856:0:9867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790773064.691864:0:9867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773064.691867:0:9867:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:3.0:1790773064.691872:0:9867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:2.0:1790773064.692502:0:6475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:2.0:1790773064.692526:0:6475:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1790773064.692536:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12a000/0xabf1cc0bc78418c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78418cc expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773064.692548:0:6475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d27b12a000/0xabf1cc0bc78418c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78418cc expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790773064.692557:0:6475:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1790773064.692559:0:6475:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93d262660000 from 1 10000000:01000000:2.0:1790773064.692562:0:6475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1790773064.693035:0:6475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26efc5600/0xabf1cc0bc78418ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773064.693047:0:6475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d26efc5600/0xabf1cc0bc78418ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773064.693059:0:6475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d26efc5600/0xabf1cc0bc78418ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773064.693081:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1434ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495973376:0@lo:101: 00000100:00100000:2.0:1790773064.693144:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773064.693183:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279ed9840 going to sleep for 11 seconds 00000100:00100000:3.0:1790773064.693520:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495973376 00000100:00100000:3.0:1790773064.693528:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495973376 00000100:00100000:3.0:1790773064.693577:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1790773064.693587:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+23:6475:x1877761495973376:12345-0@lo:101: 00010000:00010000:3.0:1790773064.694041:0:6473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773064.694057:0:6473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d279de2200/0xabf1cc0bc78418f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc78418ef expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773064.694081:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d279de2200/0xabf1cc0bc78418f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc78418ef expref: 24 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773064.694092:0:6473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d279de2200/0xabf1cc0bc78418f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78418ef expref: 24 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773064.694101:0:6473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d279de2200, rc 0) 00000100:00100000:3.0:1790773064.694158:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:6475:x1877761495973376:12345-0@lo:101: Request processed in 572us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773064.694165:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1790773064.694241:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1434ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495973376:0@lo:101: 00010000:00010000:3.0:1790773064.694257:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d26efc5600/0xabf1cc0bc78418ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78418f6 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773064.694266:0:6475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d26efc5600/0xabf1cc0bc78418ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc78418f6 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773064.695044:0:9869:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d14323a840 going to sleep for 11 seconds 00000100:00100000:3.0:1790773064.695142:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437dce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495973504:0@lo:501: 00000100:00100000:3.0:1790773064.695201:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1790773064.695397:0:6457:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1790773064.695778:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2500ed540 going to sleep for 11 seconds 00000100:00100000:1.0:1790773064.695827:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495973504 00000100:00100000:1.0:1790773064.695835:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495973504 00000100:00100000:1.0:1790773064.695881:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1790773064.695889:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:6475:x1877761495973504:12345-0@lo:501: 00000100:00100000:1.0:1790773064.696833:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:6475:x1877761495973504:12345-0@lo:501: Request processed in 940us (1627us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790773064.696845:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1790773064.697550:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437dce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495973504:0@lo:501: 10000000:01000000:2.0:1790773064.698031:0:6475:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1790773064.698043:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26efc5600/0xabf1cc0bc78418ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78418f6 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773064.698053:0:6475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d26efc5600/0xabf1cc0bc78418ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78418f6 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773064.698841:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761495973632:0@lo:13: 00000100:00100000:2.0:1790773064.698905:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1790773064.699029:0:9864:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1790773064.699053:0:9864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9864:1877761495973760:0@lo:7: 00000100:00100000:1.0:1790773064.699082:0:9864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773064.699098:0:9864:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d143130240 going to sleep for 11 seconds 00000100:00100000:1.0:1790773064.700587:0:8906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495973760 00000100:00100000:1.0:1790773064.701389:0:8906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495973760 00000100:00100000:1.0:1790773064.701513:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790773064.701524:0:8906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9864:x1877761495973760:12345-0@lo:7: 00000100:00100000:1.0:1790773064.701583:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495973632 00000100:00100000:1.0:1790773064.701587:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495973632 00000100:00100000:1.0:1790773064.701771:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790773064.701779:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1434b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3604:x1877761495973632:12345-0@lo:13: 00002000:00000024:1.0:1790773064.701793:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:1.0:1790773064.701869:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1434b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3604:x1877761495973632:12345-0@lo:13: Request processed in 91us (2963us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773064.701876:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00002000:00080000:0.0:1790773064.705124:0:8907:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1790773064.705132:0:8907:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1790773064.705232:0:8907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f974a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:9869:x1877761495973248:12345-0@lo:7: Request processed in 17548us (17850us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773064.705243:0:8907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1790773064.711756:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1437d7800 x1877761495973632/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773080 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773064.711783:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761495973632:0@lo:13: 00010000:00080000:2.0:1790773064.712751:0:9869:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f974700 x1877761495973248/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790773080 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773064.712764:0:9869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f974700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9869:1877761495973248:0@lo:7: 00000004:00080000:2.0:1790773064.712777:0:9869:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1790773064.712812:0:9869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1434b8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9869:1877761495973888:0@lo:5: 00000100:00100000:2.0:1790773064.712866:0:9869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773064.712903:0:9869:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279ed9840 going to sleep for 11 seconds 00000100:00100000:0.0:1790773064.713031:0:8392:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495973888 00000100:00100000:0.0:1790773064.713039:0:8392:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495973888 00000100:00100000:0.0:1790773064.713086:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790773064.713095:0:8392:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1434bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9869:x1877761495973888:12345-0@lo:5: 00002000:00080000:0.0:1790773064.713123:0:8392:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1790773064.713127:0:8392:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000001:00080000:0.0:1790773064.724000:0:9475:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1790773064.724024:0:9475:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1790773064.724150:0:8392:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1434bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9869:x1877761495973888:12345-0@lo:5: Request processed in 11051us (11278us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1790773064.724161:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1790773064.724806:0:9869:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1434b8380 x1877761495973888/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790773080 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773064.724819:0:9869:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1790773064.724826:0:9869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1434b8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9869:1877761495973888:0@lo:5: 00000004:00080000:3.0:1790773064.724849:0:9869:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1790773064.724896:0:9869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437df480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9869:1877761495974016:0@lo:700: 00000100:00100000:3.0:1790773064.724949:0:9869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773064.724973:0:9869:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d25146bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790773064.725344:0:8401:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495974016 00000100:00100000:2.0:1790773064.725351:0:8401:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495974016 00000100:00100000:2.0:1790773064.725398:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790773064.725413:0:8401:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9869:x1877761495974016:12345-0@lo:700: 00002000:00080000:0.0:1790773064.730772:0:8906:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1790773064.730784:0:8906:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1790773064.730891:0:8906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9864:x1877761495973760:12345-0@lo:7: Request processed in 29364us (31802us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773064.730902:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1790773064.731134:0:9864:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1437d6d80 x1877761495973760/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790773080 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773064.731165:0:9864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9864:1877761495973760:0@lo:7: 00000004:00080000:1.0:1790773064.731181:0:9864:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1790773064.731243:0:9864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9864:1877761495974144:0@lo:5: 00000100:00100000:3.0:1790773064.731573:0:9864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773064.731612:0:9864:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d143130240 going to sleep for 11 seconds 00000100:00100000:0.0:1790773064.731704:0:8394:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495974144 00000100:00100000:0.0:1790773064.731712:0:8394:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495974144 00000100:00100000:0.0:1790773064.731760:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790773064.731767:0:8394:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9864:x1877761495974144:12345-0@lo:5: 00002000:00080000:0.0:1790773064.731791:0:8394:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1790773064.731832:0:8394:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9864:x1877761495974144:12345-0@lo:5: Request processed in 65us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773064.731839:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1790773064.731870:0:9864:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1437d6d80 x1877761495974144/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790773080 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773064.731882:0:9864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9864:1877761495974144:0@lo:5: 00000004:00080000:3.0:1790773064.731891:0:9864:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1790773064.731930:0:9864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437dfb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9864:1877761495974272:0@lo:5: 00000100:00100000:3.0:1790773064.731955:0:9864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773064.731982:0:9864:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d25146b480 going to sleep for 11 seconds 00000100:00100000:0.0:1790773064.732045:0:8393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495974272 00000100:00100000:0.0:1790773064.732049:0:8393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495974272 00000100:00100000:0.0:1790773064.732074:0:8393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790773064.732078:0:8393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9864:x1877761495974272:12345-0@lo:5: 00002000:00080000:0.0:1790773064.732097:0:8393:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:0.0:1790773064.742227:0:8393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:9864:x1877761495974272:12345-0@lo:5: Request processed in 10123us (10246us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1790773064.742242:0:8393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1790773064.745835:0:9864:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1437dfb80 x1877761495974272/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790773080 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773064.745859:0:9864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437dfb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9864:1877761495974272:0@lo:5: 00000004:00080000:3.0:1790773064.745876:0:9864:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1790773064.745935:0:9864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437dd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9864:1877761495974400:0@lo:900: 00000001:00080000:0.0:1790773064.748178:0:9475:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:1.0:1790773064.748571:0:8401:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9869:x1877761495974016:12345-0@lo:700: Request processed in 23155us (23619us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773064.748584:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790773064.748732:0:9864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773064.748763:0:9864:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d25146b480 going to sleep for 11 seconds 00000100:00100000:3.0:1790773064.748791:0:6490:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495974400 00000100:00100000:3.0:1790773064.748799:0:6490:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495974400 00000100:00100000:3.0:1790773064.748862:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790773064.748870:0:6490:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9864:x1877761495974400:12345-0@lo:900: 00010000:00080000:0.0:1790773064.749571:0:9869:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1437df480 x1877761495974016/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790773080 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773064.749587:0:9869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437df480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9869:1877761495974016:0@lo:700: 00000100:00100000:3.0:1790773064.750061:0:6490:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9864:x1877761495974400:12345-0@lo:900: Request processed in 86us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773064.750071:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1790773064.750131:0:9864:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1437dd500 x1877761495974400/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790773080 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773064.750142:0:9864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437dd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9864:1877761495974400:0@lo:900: 00000004:02000040:0.0:1790773064.766345:0:9869:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:0.0:1790773064.775841:0:9869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f976300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9869:1877761495974528:0@lo:5: 00000100:00100000:0.0:1790773064.775913:0:9869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773064.776810:0:9869:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d14323a840 going to sleep for 11 seconds 00000100:00100000:1.0:1790773064.778881:0:8906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495974528 00000100:00100000:1.0:1790773064.778896:0:8906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495974528 00000100:00100000:2.0:1790773064.779318:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790773064.779330:0:8906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f977100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9869:x1877761495974528:12345-0@lo:5: 00002000:00080000:2.0:1790773064.787963:0:8906:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1790773064.787986:0:8906:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:2.0:1790773064.789547:0:8906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f977100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9869:x1877761495974528:12345-0@lo:5: Request processed in 10213us (13627us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1790773064.789558:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1790773064.789775:0:9869:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f976300 x1877761495974528/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790773080 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773064.789794:0:9869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f976300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9869:1877761495974528:0@lo:5: 00000004:00080000:3.0:1790773064.789810:0:9869:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000100:00100000:2.0:1790773065.038356:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1434b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761495974656:0@lo:41: 00000100:00100000:2.0:1790773065.038432:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773065.038505:0:6484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495974656 00000100:00100000:2.0:1790773065.038513:0:6484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495974656 00000100:00100000:2.0:1790773065.038557:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790773065.038565:0:6484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1434b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761495974656:12345-0@lo:41: 00000004:00000024:2.0:1790773065.038599:0:6484:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1790773065.038658:0:6484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1434b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761495974656:12345-0@lo:41: Request processed in 93us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773065.038665:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790773065.038712:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1434b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761495974656:0@lo:41: 00000100:00100000:1.0:1790773065.039129:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790773065.039141:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761495974784:0@lo:41: 00000100:00100000:1.0:1790773065.039172:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773065.039453:0:7666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495974784 00000100:00100000:2.0:1790773065.039459:0:7666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495974784 00000100:00100000:2.0:1790773065.039499:0:7666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790773065.039507:0:7666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761495974784:12345-0@lo:41: 00000004:00000024:2.0:1790773065.039531:0:7666:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790773065.039571:0:7666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761495974784:12345-0@lo:41: Request processed in 65us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773065.039589:0:7666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790773065.039779:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761495974784:0@lo:41: 00000020:00000004:0.0:1790773065.157782:0:9899:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790773065.158040:0:9899:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790773065.549349:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1790773066.106155:0:9475:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00010000:00010000:3.0:1790773066.573649:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773067.600999:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1790773068.022412:0:10000:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790773068.022929:0:10000:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1790773068.109380:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1434b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761495974912:0@lo:13: 00000100:00100000:2.0:1790773068.109452:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773068.109499:0:8397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495974912 00000100:00100000:3.0:1790773068.109508:0:8397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495974912 00000100:00100000:3.0:1790773068.109567:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790773068.109587:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1434b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761495974912:12345-0@lo:13: 00002000:00000024:3.0:1790773068.109617:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790773068.109682:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1434b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761495974912:12345-0@lo:13: Request processed in 106us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773068.109689:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1790773068.109710:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790773068.109837:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1434b8000 x1877761495974912/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773084 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773068.109856:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1434b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761495974912:0@lo:13: 00000100:00100000:2.0:1790773068.110372:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761495975040:0@lo:13: 00000100:00100000:2.0:1790773068.110407:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773068.110478:0:8397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495975040 00000100:00100000:1.0:1790773068.110485:0:8397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495975040 00000100:00100000:1.0:1790773068.110522:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790773068.110528:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1434b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761495975040:12345-0@lo:13: 00002000:00000024:1.0:1790773068.110540:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790773068.110570:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1434b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761495975040:12345-0@lo:13: Request processed in 42us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773068.110576:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1790773068.110671:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790773068.110692:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1437d4380 x1877761495975040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773084 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773068.110704:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761495975040:0@lo:13: 00010000:00010000:3.0:1790773068.626645:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1790773069.170927:0:10049:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790773069.170936:0:10049:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:3.0:1790773069.645852:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773069.814737:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773069.815083:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484390528 00000100:00100000:2.0:1790773069.815093:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484390528 00000100:00100000:2.0:1790773069.815141:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 180 00000100:00100000:2.0:1790773069.815149:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2396:x1877761484390528:12345-192.168.202.19@tcp:250: 00010000:00080000:2.0:1790773069.815179:0:6472:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 3f7e9812-a56a-4fd4-8715-b93ef4652f29@192.168.202.19@tcp t0 exp 0000000000000000 cur 212 last 0 00000020:00000080:2.0:1790773069.815255:0:6472:0:(genops.c:1384:class_connect()) connect: client 3f7e9812-a56a-4fd4-8715-b93ef4652f29, cookie 0xabf1cc0bc78418fd 00000100:00080000:2.0:1790773069.815391:0:6472:0:(import.c:65:import_set_state_nolock()) ffff93d143c86800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790773069.815456:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+5:2396:x1877761484390528:12345-192.168.202.19@tcp:250: Request processed in 306us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773069.815464:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 180 00000100:00100000:2.0:1790773069.830708:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773069.830951:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484390656 00000100:00100000:1.0:1790773069.830962:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484390656 00000100:00100000:1.0:1790773069.831024:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 181 00000100:00100000:1.0:1790773069.831048:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+5:6155:x1877761484390656:12345-192.168.202.19@tcp:101: 00010000:00010000:1.0:1790773069.831068:0:6471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773069.831090:0:6471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d27b12a400/0xabf1cc0bc7841904 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6ba4a expref: -99 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773069.831121:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d27b12a400/0xabf1cc0bc7841904 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6ba4a expref: 6 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773069.831132:0:6471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d27b12a400/0xabf1cc0bc7841904 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6ba4a expref: 6 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773069.831142:0:6471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12a400, rc 0) 00000100:00100000:1.0:1790773069.831244:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+6:6155:x1877761484390656:12345-192.168.202.19@tcp:101: Request processed in 196us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773069.831252:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 181 00000100:00100000:0.0:1790773069.838036:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773069.838165:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484390784 00000100:00100000:3.0:1790773069.838186:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484390784 00000100:00100000:3.0:1790773069.838279:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 182 00000100:00100000:3.0:1790773069.838289:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d252ea1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+6:6155:x1877761484390784:12345-192.168.202.19@tcp:501: 00000100:00100000:3.0:1790773069.838408:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d252ea1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+6:6155:x1877761484390784:12345-192.168.202.19@tcp:501: Request processed in 120us (381us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790773069.838416:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 182 00000100:00100000:3.0:1790773069.845070:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773069.845275:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484390912 00000100:00100000:2.0:1790773069.845286:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484390912 00000100:00100000:2.0:1790773069.845362:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 183 00000100:00100000:2.0:1790773069.845373:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d252ea0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+6:6155:x1877761484390912:12345-192.168.202.19@tcp:101: 00010000:00010000:2.0:1790773069.845391:0:6472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773069.845410:0:6472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d26efc4400/0xabf1cc0bc784190b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6ba51 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773069.845443:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d26efc4400/0xabf1cc0bc784190b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6ba51 expref: 7 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773069.845455:0:6472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d26efc4400/0xabf1cc0bc784190b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6ba51 expref: 7 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773069.845465:0:6472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26efc4400, rc 0) 00000100:00100000:2.0:1790773069.845538:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d252ea0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+7:6155:x1877761484390912:12345-192.168.202.19@tcp:101: Request processed in 166us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773069.845545:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 183 00000100:00100000:2.0:1790773069.848047:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773069.848151:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484391040 00000100:00100000:1.0:1790773069.848161:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484391040 00000100:00100000:1.0:1790773069.848255:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 184 00000100:00100000:1.0:1790773069.848266:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d252ea3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+7:6155:x1877761484391040:12345-192.168.202.19@tcp:501: 00000100:00100000:1.0:1790773069.848455:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d252ea3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+8:6155:x1877761484391040:12345-192.168.202.19@tcp:501: Request processed in 190us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773069.848464:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 184 00000100:00100000:0.0:1790773069.850807:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773069.851096:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484391168 00000100:00100000:3.0:1790773069.851108:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484391168 00000100:00100000:3.0:1790773069.851166:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 185 00000100:00100000:3.0:1790773069.851177:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d279eaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+8:6155:x1877761484391168:12345-192.168.202.19@tcp:503: 00000100:00100000:3.0:1790773069.851366:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d279eaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+8:6155:x1877761484391168:12345-192.168.202.19@tcp:503: Request processed in 190us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773069.851374:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 185 00000100:00100000:3.0:1790773069.869753:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773069.870134:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484391296 00000100:00100000:2.0:1790773069.870145:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484391296 00000100:00100000:2.0:1790773069.870196:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 186 00000100:00100000:2.0:1790773069.870242:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d279eaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+8:6174:x1877761484391296:12345-192.168.202.19@tcp:502: 00000100:00100000:2.0:1790773069.870405:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d279eaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+8:6174:x1877761484391296:12345-192.168.202.19@tcp:502: Request processed in 201us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773069.870413:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 186 00000100:00100000:2.0:1790773069.916976:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773069.917137:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484391424 00000100:00100000:1.0:1790773069.917149:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484391424 00000100:00100000:1.0:1790773069.917248:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 187 00000100:00100000:1.0:1790773069.917258:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d251208850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+8:6174:x1877761484391424:12345-192.168.202.19@tcp:502: 00000100:00100000:1.0:1790773069.917419:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d251208850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+8:6174:x1877761484391424:12345-192.168.202.19@tcp:502: Request processed in 163us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773069.917432:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 187 00000100:00100000:0.0:1790773069.922025:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773069.922124:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484391552 00000100:00100000:3.0:1790773069.922136:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484391552 00000100:00100000:3.0:1790773069.922199:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 188 00000100:00100000:3.0:1790773069.922262:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25120b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+8:6155:x1877761484391552:12345-192.168.202.19@tcp:101: 00010000:00010000:3.0:1790773069.922282:0:6473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773069.922300:0:6473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d279de3a00/0xabf1cc0bc7841912 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6ba82 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773069.922327:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d279de3a00/0xabf1cc0bc7841912 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6ba82 expref: 9 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773069.922337:0:6473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d279de3a00/0xabf1cc0bc7841912 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6ba82 expref: 9 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773069.922359:0:6473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d279de3a00, rc 0) 00000100:00100000:3.0:1790773069.922423:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25120b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+9:6155:x1877761484391552:12345-192.168.202.19@tcp:101: Request processed in 165us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773069.922430:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 188 00000100:00100000:3.0:1790773069.930285:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773069.930432:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484391680 00000100:00100000:2.0:1790773069.930444:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484391680 00000100:00100000:2.0:1790773069.930498:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 189 00000100:00100000:2.0:1790773069.930520:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25120ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+9:6155:x1877761484391680:12345-192.168.202.19@tcp:256: 20000000:01000000:2.0:1790773069.930546:0:6472:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1790773069.930573:0:6472:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1790773069.930578:0:6472:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1790773069.930581:0:6472:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1790773069.930584:0:6472:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1790773069.930586:0:6472:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:3.0:1790773069.932177:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25120ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+9:6155:x1877761484391680:12345-192.168.202.19@tcp:256: Request processed in 1649us (1896us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773069.932189:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 189 00000100:00100000:0.0:1790773069.940364:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773069.940481:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484391808 00000100:00100000:1.0:1790773069.940491:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484391808 00000100:00100000:1.0:1790773069.940551:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 190 00000100:00100000:1.0:1790773069.940570:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d251209450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+9:6155:x1877761484391808:12345-192.168.202.19@tcp:101: 00010000:00010000:1.0:1790773069.940587:0:6471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773069.940604:0:6471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d27b12a600/0xabf1cc0bc7841919 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6ba89 expref: -99 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773069.940635:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d27b12a600/0xabf1cc0bc7841919 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6ba89 expref: 10 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773069.940648:0:6471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d27b12a600/0xabf1cc0bc7841919 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6ba89 expref: 10 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773069.940658:0:6471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12a600, rc 0) 00000100:00100000:1.0:1790773069.940722:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d251209450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+10:6155:x1877761484391808:12345-192.168.202.19@tcp:101: Request processed in 162us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773069.940729:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 190 00000100:00100000:1.0:1790773069.943992:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773069.944080:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484391936 00000100:00100000:3.0:1790773069.944090:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484391936 00000100:00100000:3.0:1790773069.944144:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 191 00000100:00100000:3.0:1790773069.944153:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d251208c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+10:6155:x1877761484391936:12345-192.168.202.19@tcp:501: 00000100:00100000:3.0:1790773069.944349:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d251208c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+10:6155:x1877761484391936:12345-192.168.202.19@tcp:501: Request processed in 196us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773069.944356:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 191 00000100:00100000:2.0:1790773069.946983:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773069.947069:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484392064 00000100:00100000:3.0:1790773069.947080:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484392064 00000100:00100000:3.0:1790773069.947139:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 192 00000100:00100000:3.0:1790773069.947150:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26be9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+10:6155:x1877761484392064:12345-192.168.202.19@tcp:503: 00000100:00100000:3.0:1790773069.947346:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26be9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+10:6155:x1877761484392064:12345-192.168.202.19@tcp:503: Request processed in 198us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773069.947355:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 192 00000100:00100000:0.0:1790773069.952281:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773069.952645:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484392192 00000100:00100000:1.0:1790773069.952657:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484392192 00000100:00100000:1.0:1790773069.952722:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 193 00000100:00100000:1.0:1790773069.952732:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26be9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+10:6179:x1877761484392192:12345-192.168.202.19@tcp:502: 00000100:00100000:1.0:1790773069.952943:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26be9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+10:6179:x1877761484392192:12345-192.168.202.19@tcp:502: Request processed in 212us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773069.952952:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 193 00000100:00100000:1.0:1790773069.956661:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773069.956799:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484392320 00000100:00100000:2.0:1790773069.956810:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484392320 00000100:00100000:2.0:1790773069.956879:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 194 00000100:00100000:2.0:1790773069.956890:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26be9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+10:6179:x1877761484392320:12345-192.168.202.19@tcp:502: 00000100:00100000:2.0:1790773069.957069:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26be9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+10:6179:x1877761484392320:12345-192.168.202.19@tcp:502: Request processed in 180us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773069.957077:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 194 00000100:00100000:2.0:1790773069.962137:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773069.962186:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773069.962523:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484392448 00000100:00100000:3.0:1790773069.962536:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484392448 00000100:00100000:3.0:1790773069.962587:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484392704 00000100:00100000:3.0:1790773069.962603:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484392704 00000100:00100000:3.0:1790773069.962634:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:3.0:1790773069.962643:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1434b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2396:x1877761484392448:12345-192.168.202.19@tcp:38: 00010000:00080000:3.0:1790773069.962674:0:6478:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 110130ab-04fa-4d7c-984e-562032df4432@192.168.202.19@tcp t0 exp 0000000000000000 cur 212 last 0 00000020:00000080:3.0:1790773069.962728:0:6478:0:(genops.c:1384:class_connect()) connect: client 110130ab-04fa-4d7c-984e-562032df4432, cookie 0xabf1cc0bc7841920 00000004:00100000:3.0:1790773069.962754:0:6478:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1790773069.962998:0:6478:0:(import.c:65:import_set_state_nolock()) ffff93d1437ea000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790773069.963065:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1434b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+6:2396:x1877761484392448:12345-192.168.202.19@tcp:38: Request processed in 422us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773069.963073:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:3.0:1790773069.963091:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 8 00000100:00100000:3.0:1790773069.963095:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1434b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2396:x1877761484392704:12345-192.168.202.19@tcp:38: 00010000:00080000:3.0:1790773069.963111:0:6478:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 110130ab-04fa-4d7c-984e-562032df4432@192.168.202.19@tcp t0 exp 0000000000000000 cur 212 last 0 00000020:00000080:3.0:1790773069.963138:0:6478:0:(genops.c:1384:class_connect()) connect: client 110130ab-04fa-4d7c-984e-562032df4432, cookie 0xabf1cc0bc7841927 00000004:00100000:3.0:1790773069.963149:0:6478:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1790773069.963306:0:6478:0:(import.c:65:import_set_state_nolock()) ffff93d1437e9800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790773069.963330:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1434b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+6:2396:x1877761484392704:12345-192.168.202.19@tcp:38: Request processed in 233us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773069.963338:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 8 00000100:00100000:1.0:1790773070.157644:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761495975424:0@lo:400: 00000100:00100000:1.0:1790773070.157735:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773070.157791:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3607:1877761495975936:0@lo:400: 00000100:00100000:1.0:1790773070.157818:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773070.157834:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3607:1877761495976448:0@lo:400: 00000100:00100000:1.0:1790773070.157853:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773070.157923:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1790773070.157929:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3607:1877761495975296:0@lo:400: 00000100:00100000:1.0:1790773070.157951:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773070.157967:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3607:1877761495975808:0@lo:400: 00000100:00100000:1.0:1790773070.157988:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773070.158001:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3607:1877761495976320:0@lo:400: 00000100:00100000:1.0:1790773070.158020:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773070.158047:0:6483:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495975424 00000100:00100000:1.0:1790773070.158055:0:6483:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495975424 00000100:00100000:1.0:1790773070.158099:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790773070.158108:0:6483:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f985180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761495975424:12345-0@lo:400: 00000100:00100000:1.0:1790773070.158162:0:6483:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f985180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761495975424:12345-0@lo:400: Request processed in 54us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773070.158169:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790773070.158191:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495975936 00000100:00100000:1.0:1790773070.158195:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495975936 00000100:00100000:1.0:1790773070.158241:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495976448 00000100:00100000:1.0:1790773070.158244:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495976448 00000100:00100000:1.0:1790773070.158255:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495975296 00000100:00100000:1.0:1790773070.158257:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495975296 00000100:00100000:1.0:1790773070.158277:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495975808 00000100:00100000:1.0:1790773070.158280:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495975808 00000100:00100000:1.0:1790773070.158288:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495976320 00000100:00100000:1.0:1790773070.158290:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495976320 00000100:00100000:1.0:1790773070.158301:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790773070.158305:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f985c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1877761495975936:12345-0@lo:400: 00000100:00100000:1.0:1790773070.158335:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f985c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1877761495975936:12345-0@lo:400: Request processed in 29us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773070.158340:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790773070.158351:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790773070.158356:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f985880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1877761495976448:12345-0@lo:400: 00000100:00100000:1.0:1790773070.158378:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f985880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1877761495976448:12345-0@lo:400: Request processed in 23us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773070.158383:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790773070.158393:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790773070.158399:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f986a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1877761495975296:12345-0@lo:400: 00000100:00100000:1.0:1790773070.158421:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f986a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1877761495975296:12345-0@lo:400: Request processed in 23us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773070.158425:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790773070.158434:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790773070.158438:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1877761495975808:12345-0@lo:400: 00000100:00100000:1.0:1790773070.158459:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1877761495975808:12345-0@lo:400: Request processed in 21us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773070.158465:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790773070.158476:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790773070.158481:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f984700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1877761495976320:12345-0@lo:400: 00000100:00100000:1.0:1790773070.158507:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f984700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1877761495976320:12345-0@lo:400: Request processed in 26us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773070.158519:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1790773070.158553:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1437d4000 x1877761495975296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773070.158568:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3607:1877761495975296:0@lo:400: 00010000:00080000:1.0:1790773070.158579:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1437d4380 x1877761495975808/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773070.158588:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3607:1877761495975808:0@lo:400: 00010000:00080000:1.0:1790773070.158597:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1437d4e00 x1877761495976320/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773070.158605:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3607:1877761495976320:0@lo:400: 00000100:00100000:1.0:1790773070.158614:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761495975424:0@lo:400: 00010000:00080000:1.0:1790773070.158623:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1437d6680 x1877761495975936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773070.158630:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3607:1877761495975936:0@lo:400: 00010000:00080000:1.0:1790773070.158639:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1437d4a80 x1877761495976448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773070.158647:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3607:1877761495976448:0@lo:400: 00000100:00100000:3.0:1790773070.158883:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce0675b4-b0c5-48e7-b182-565e22fed04c:3605:1877761495975168:0@lo:400: 00000100:00100000:3.0:1790773070.158931:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773070.158966:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3605:1877761495975680:0@lo:400: 00000100:00100000:3.0:1790773070.158989:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773070.159008:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761495976192:0@lo:400: 00000100:00100000:3.0:1790773070.159032:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773070.159057:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f984000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761495976704:0@lo:400: 00000100:00100000:3.0:1790773070.159080:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773070.159098:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1790773070.159105:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761495975552:0@lo:400: 00000100:00100000:3.0:1790773070.159139:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773070.159155:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761495976064:0@lo:400: 00000100:00100000:3.0:1790773070.159174:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773070.159190:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f987100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761495976576:0@lo:400: 00000100:00100000:3.0:1790773070.159230:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773070.159257:0:8394:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495976192 00000100:00100000:3.0:1790773070.159262:0:8394:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495976192 00000100:00100000:3.0:1790773070.159290:0:8394:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495976704 00000100:00100000:3.0:1790773070.159292:0:8394:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495976704 00000100:00100000:3.0:1790773070.159303:0:8394:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495976064 00000100:00100000:3.0:1790773070.159306:0:8394:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495976064 00000100:00100000:3.0:1790773070.159316:0:8394:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495976576 00000100:00100000:3.0:1790773070.159318:0:8394:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495976576 00000100:00100000:3.0:1790773070.159329:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790773070.159335:0:8394:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761495976192:12345-0@lo:400: 00000100:00100000:3.0:1790773070.159373:0:8394:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761495976192:12345-0@lo:400: Request processed in 38us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773070.159380:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790773070.159391:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790773070.159397:0:8394:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761495976704:12345-0@lo:400: 00000100:00100000:3.0:1790773070.159423:0:8394:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761495976704:12345-0@lo:400: Request processed in 27us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773070.159429:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790773070.159439:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790773070.159451:0:8394:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761495976064:12345-0@lo:400: 00000100:00100000:3.0:1790773070.159481:0:8394:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761495976064:12345-0@lo:400: Request processed in 31us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773070.159487:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790773070.159498:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790773070.159503:0:8394:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761495976576:12345-0@lo:400: 00000100:00100000:3.0:1790773070.159524:0:8394:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761495976576:12345-0@lo:400: Request processed in 22us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773070.159529:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790773070.159544:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495975680 00000100:00100000:3.0:1790773070.159548:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495975680 00000100:00100000:3.0:1790773070.159563:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790773070.159569:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3605:x1877761495975680:12345-0@lo:400: 00000100:00100000:3.0:1790773070.159597:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3605:x1877761495975680:12345-0@lo:400: Request processed in 29us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773070.159603:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1790773070.159629:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1437d6d80 x1877761495976064/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773070.159639:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761495976064:0@lo:400: 00010000:00080000:3.0:1790773070.159648:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f987100 x1877761495976576/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773070.159654:0:3605:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1790773070.159665:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f987100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761495976576:0@lo:400: 00010000:00080000:3.0:1790773070.159674:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1437d5880 x1877761495975680/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773070.159693:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3605:1877761495975680:0@lo:400: 00010000:00080000:3.0:1790773070.159706:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1437d7800 x1877761495976192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773070.159713:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761495976192:0@lo:400: 00010000:00080000:3.0:1790773070.159721:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f984000 x1877761495976704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773070.159728:0:3605:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1790773070.159735:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f984000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761495976704:0@lo:400: 00000100:00100000:1.0:1790773070.160245:0:6484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495975552 00000100:00100000:1.0:1790773070.160250:0:6484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495975552 00000100:00100000:1.0:1790773070.160323:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790773070.160331:0:6484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761495975552:12345-0@lo:400: 00000100:00100000:1.0:1790773070.160371:0:6484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761495975552:12345-0@lo:400: Request processed in 41us (1231us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773070.160384:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790773070.160590:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761495975552:0@lo:400: 00000100:00080000:3.0:1790773070.160626:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790773070.160631:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790773070.160633:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790773070.160636:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790773070.160698:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761495977216:0@lo:41: 00000100:00100000:3.0:1790773070.160727:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773070.168917:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790773070.168939:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761495977088:0@lo:41: 00000100:00100000:3.0:1790773070.169031:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773070.169078:0:6483:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495977216 00000100:00100000:0.0:1790773070.169086:0:6483:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495977216 00000100:00100000:0.0:1790773070.169129:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790773070.169137:0:6483:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761495977216:12345-0@lo:41: 00000004:00000024:0.0:1790773070.169173:0:6483:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1790773070.169234:0:6483:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761495977216:12345-0@lo:41: Request processed in 97us (8506us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773070.169242:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790773070.169274:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761495976832:0@lo:13: 00000100:00100000:0.0:1790773070.169301:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773070.169330:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790773070.169337:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761495976960:0@lo:13: 00000100:00100000:0.0:1790773070.169357:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773070.169385:0:8397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495976832 00000100:00100000:0.0:1790773070.169389:0:8397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495976832 00000100:00100000:0.0:1790773070.169415:0:8397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495976960 00000100:00100000:0.0:1790773070.169417:0:8397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495976960 00000100:00100000:0.0:1790773070.169428:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790773070.169434:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761495976832:12345-0@lo:13: 00002000:00000024:0.0:1790773070.169453:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790773070.169488:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761495976832:12345-0@lo:13: Request processed in 54us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773070.169494:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790773070.169505:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790773070.169511:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f976a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761495976960:12345-0@lo:13: 00002000:00000024:0.0:1790773070.169519:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790773070.169543:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f976a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761495976960:12345-0@lo:13: Request processed in 33us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773070.169549:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1790773070.169593:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1437df480 x1877761495976960/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773086 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773070.169611:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761495976960:0@lo:13: 00010000:00080000:0.0:1790773070.169623:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1437dfb80 x1877761495976832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773086 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773070.169634:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761495976832:0@lo:13: 00000100:00100000:0.0:1790773070.169690:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495975168 00000100:00100000:0.0:1790773070.169694:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495975168 00000100:00100000:0.0:1790773070.169721:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1790773070.169727:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26be9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3605:x1877761495975168:12345-0@lo:400: 00000100:00100000:0.0:1790773070.169758:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26be9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3605:x1877761495975168:12345-0@lo:400: Request processed in 32us (10827us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773070.169773:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1790773070.174750:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761495977216:0@lo:41: 00000100:00100000:3.0:1790773070.174767:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce0675b4-b0c5-48e7-b182-565e22fed04c:3605:1877761495975168:0@lo:400: 00000100:00100000:0.0:1790773070.175024:0:6483:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495977088 00000100:00100000:0.0:1790773070.175032:0:6483:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495977088 00000100:00100000:0.0:1790773070.175087:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790773070.175097:0:6483:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761495977088:12345-0@lo:41: 00000004:00000024:0.0:1790773070.175132:0:6483:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1790773070.175242:0:6483:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761495977088:12345-0@lo:41: Request processed in 147us (6211us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773070.175249:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790773070.176717:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761495977088:0@lo:41: 00010000:00010000:1.0:1790773070.670056:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773070.967805:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773070.967853:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773070.969845:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773070.973106:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484392832 00000100:00100000:1.0:1790773070.973121:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484392576 00000100:00100000:0.0:1790773070.973124:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484392832 00000100:00100000:1.0:1790773070.973129:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484392576 00000100:00100000:1.0:1790773070.973236:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484392960 00000100:00100000:1.0:1790773070.973241:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484392960 00000100:00100000:1.0:1790773070.973262:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:1.0:1790773070.973273:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+6:0:x1877761484392832:12345-192.168.202.19@tcp:41: 00000100:00100000:0.0:1790773070.973306:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:0.0:1790773070.973317:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+7:0:x1877761484392576:12345-192.168.202.19@tcp:41: 00000004:00000024:1.0:1790773070.973323:0:8697:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000004:00000024:0.0:1790773070.973344:0:6478:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1790773070.973400:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+6:0:x1877761484392832:12345-192.168.202.19@tcp:41: Request processed in 128us (5604us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773070.973407:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:1.0:1790773070.973425:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00100000:1.0:1790773070.973432:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1434ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+7:6155:x1877761484392960:12345-192.168.202.19@tcp:41: 00000100:00100000:0.0:1790773070.973454:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+7:0:x1877761484392576:12345-192.168.202.19@tcp:41: Request processed in 138us (5598us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773070.973463:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 10 00000004:00000024:1.0:1790773070.974738:0:8697:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1790773070.974794:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1434ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+6:6155:x1877761484392960:12345-192.168.202.19@tcp:41: Request processed in 1359us (4953us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773070.974802:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00080000:2.0:1790773070.974950:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790773070.974956:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790773070.977140:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773070.977377:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484393088 00000100:00100000:0.0:1790773070.977388:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484393088 00000100:00100000:0.0:1790773070.977488:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00100000:0.0:1790773070.977500:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+6:6155:x1877761484393088:12345-192.168.202.19@tcp:40: 00000100:00100000:0.0:1790773070.977599:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+6:6155:x1877761484393088:12345-192.168.202.19@tcp:40: Request processed in 102us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773070.977608:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00100000:3.0:1790773070.984342:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773070.984393:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773070.984424:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773070.984458:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773070.984559:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484393600 00000100:00100000:2.0:1790773070.984569:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484393600 00000100:00100000:2.0:1790773070.984626:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 196 00000100:00100000:2.0:1790773070.984636:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26be9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+10:2399:x1877761484393600:12345-192.168.202.19@tcp:400: 00000100:00100000:2.0:1790773070.984712:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26be9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+10:2399:x1877761484393600:12345-192.168.202.19@tcp:400: Request processed in 77us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773070.984720:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 196 00000100:00100000:0.0:1790773070.985077:0:8393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484393216 00000100:00100000:0.0:1790773070.985082:0:8393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484393216 00000100:00100000:0.0:1790773070.985129:0:8393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484393344 00000100:00100000:0.0:1790773070.985132:0:8393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484393344 00000100:00100000:0.0:1790773070.985152:0:8393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:0.0:1790773070.985158:0:8393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2396:x1877761484393216:12345-192.168.202.19@tcp:8: 00010000:00080000:0.0:1790773070.985187:0:8393:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 110130ab-04fa-4d7c-984e-562032df4432@192.168.202.19@tcp t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:0.0:1790773070.985241:0:8393:0:(genops.c:1384:class_connect()) connect: client 110130ab-04fa-4d7c-984e-562032df4432, cookie 0xabf1cc0bc784192e 00002000:00100000:0.0:1790773070.985253:0:8393:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 110130ab-04fa-4d7c-984e-562032df4432/ffff93d141ceb800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790773070.985271:0:8393:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790773070.985441:0:8393:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790773070.985472:0:8393:0:(import.c:65:import_set_state_nolock()) ffff93d141cea000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790773070.985509:0:8393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:110130ab-04fa-4d7c-984e-562032df4432+6:2396:x1877761484393216:12345-192.168.202.19@tcp:8: Request processed in 350us (1083us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773070.985516:0:8393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:0.0:1790773070.985530:0:8393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:0.0:1790773070.985534:0:8393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ed68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2396:x1877761484393344:12345-192.168.202.19@tcp:8: 00010000:00080000:0.0:1790773070.985551:0:8393:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 110130ab-04fa-4d7c-984e-562032df4432@192.168.202.19@tcp t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:0.0:1790773070.985575:0:8393:0:(genops.c:1384:class_connect()) connect: client 110130ab-04fa-4d7c-984e-562032df4432, cookie 0xabf1cc0bc7841935 00002000:00100000:0.0:1790773070.985579:0:8393:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 110130ab-04fa-4d7c-984e-562032df4432/ffff93d143273800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790773070.985585:0:8393:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790773070.986137:0:8393:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1790773070.986170:0:8393:0:(import.c:65:import_set_state_nolock()) ffff93d143270800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790773070.987572:0:8393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ed68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:110130ab-04fa-4d7c-984e-562032df4432+6:2396:x1877761484393344:12345-192.168.202.19@tcp:8: Request processed in 2026us (3104us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773070.987584:0:8393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:1.0:1790773070.987795:0:6490:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484393472 00000100:00100000:1.0:1790773070.987804:0:6490:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484393472 00000100:00100000:1.0:1790773070.987870:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00100000:1.0:1790773070.987878:0:6490:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:110130ab-04fa-4d7c-984e-562032df4432+6:6155:x1877761484393472:12345-192.168.202.19@tcp:900: 00000100:00100000:1.0:1790773070.989090:0:6490:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:110130ab-04fa-4d7c-984e-562032df4432+6:6155:x1877761484393472:12345-192.168.202.19@tcp:900: Request processed in 1208us (4753us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773070.989100:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00100000:2.0:1790773070.992880:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773070.995238:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484393728 00000100:00100000:2.0:1790773070.995253:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484393728 00000100:00100000:2.0:1790773070.995351:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:2.0:1790773070.995362:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:110130ab-04fa-4d7c-984e-562032df4432+6:6155:x1877761484393728:12345-192.168.202.19@tcp:33: 00000004:00080000:3.0:1790773071.026883:0:6481:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 31428us 00000004:00200000:3.0:1790773071.048061:0:6481:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1790773071.048183:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:110130ab-04fa-4d7c-984e-562032df4432+6:6155:x1877761484393728:12345-192.168.202.19@tcp:33: Request processed in 52817us (55307us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773071.048194:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:3.0:1790773071.240413:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773071.240807:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484393856 00000100:00100000:0.0:1790773071.240832:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484393856 00000100:00100000:0.0:1790773071.240910:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 13 00000100:00100000:0.0:1790773071.240922:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+6:6197:x1877761484393856:12345-192.168.202.19@tcp:101: 00010000:00010000:0.0:1790773071.240950:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773071.241035:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3600/0xabf1cc0bc784193c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6baba expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773071.241109:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2a00/0xabf1cc0bc7841943 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773071.241124:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2a00/0xabf1cc0bc7841943 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773071.241140:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2a00/0xabf1cc0bc7841943 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790773071.241190:0:6480:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1790773071.241194:0:6480:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790773071.241374:0:6480:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2a00/0xabf1cc0bc7841943 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773071.241404:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3600/0xabf1cc0bc784193c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6baba expref: 8 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773071.241423:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2a00/0xabf1cc0bc7841943 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6baba expref: 7 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773071.241433:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d26ede0400) 00010000:00010000:0.0:1790773071.241436:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790773071.241439:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26c4a2a00, rc 0) 00000100:00100000:0.0:1790773071.241650:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+7:6197:x1877761484393856:12345-192.168.202.19@tcp:101: Request processed in 730us (1248us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773071.241658:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 13 00010000:00010000:3.0:1790773071.697695:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773072.717953:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773073.229412:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761495977472:0@lo:13: 00000100:00100000:0.0:1790773073.229496:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773073.238151:0:8397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495977472 00000100:00100000:0.0:1790773073.238172:0:8397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495977472 00000100:00100000:0.0:1790773073.238260:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790773073.238270:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f975f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761495977472:12345-0@lo:13: 00000100:00080000:2.0:1790773073.238287:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1790773073.238322:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790773073.238386:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f975f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761495977472:12345-0@lo:13: Request processed in 118us (8890us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773073.238392:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1790773073.238488:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f9e6a00 x1877761495977472/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773089 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773073.238508:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761495977472:0@lo:13: 00000100:00100000:0.0:1790773073.238519:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f986300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761495977344:0@lo:13: 00000100:00100000:0.0:1790773073.238550:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773073.238614:0:8397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495977344 00000100:00100000:2.0:1790773073.238619:0:8397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495977344 00000100:00100000:2.0:1790773073.238724:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790773073.238731:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f977b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761495977344:12345-0@lo:13: 00002000:00000024:2.0:1790773073.238743:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790773073.238781:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f977b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761495977344:12345-0@lo:13: Request processed in 50us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773073.238788:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1790773073.239756:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790773073.239797:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f986300 x1877761495977344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773089 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773073.239816:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f986300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761495977344:0@lo:13: 00000100:00100000:2.0:1790773073.307649:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773073.307736:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484393984 00000100:00100000:3.0:1790773073.307755:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484393984 00000100:00100000:3.0:1790773073.307827:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 14 00000100:00100000:3.0:1790773073.307869:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+7:6250:x1877761484393984:12345-192.168.202.19@tcp:41: 00000004:00000024:3.0:1790773073.307906:0:6479:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00080000:0.0:1790773073.307938:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790773073.307980:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+7:6250:x1877761484393984:12345-192.168.202.19@tcp:41: Request processed in 144us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773073.307988:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 14 00000100:00100000:3.0:1790773073.310807:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773073.310963:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484394112 00000100:00100000:1.0:1790773073.310989:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484394112 00000100:00100000:1.0:1790773073.311142:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 15 00000100:00100000:1.0:1790773073.311153:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+6:6250:x1877761484394112:12345-192.168.202.19@tcp:41: 00000004:00000024:1.0:1790773073.311230:0:8697:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1790773073.311309:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+6:6250:x1877761484394112:12345-192.168.202.19@tcp:41: Request processed in 157us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773073.311317:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 15 00000100:00080000:0.0:1790773073.311388:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790773073.318967:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773073.319376:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484394240 00000100:00100000:1.0:1790773073.319388:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484394240 00000100:00100000:1.0:1790773073.319469:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:1.0:1790773073.319480:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f975880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:110130ab-04fa-4d7c-984e-562032df4432+6:6250:x1877761484394240:12345-192.168.202.19@tcp:13: 00002000:00000024:1.0:1790773073.319506:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790773073.319590:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f975880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:110130ab-04fa-4d7c-984e-562032df4432+6:6250:x1877761484394240:12345-192.168.202.19@tcp:13: Request processed in 111us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773073.319597:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00080000:0.0:1790773073.319723:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790773073.322099:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773073.322182:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484394368 00000100:00100000:1.0:1790773073.322191:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484394368 00000100:00080000:0.0:1790773073.322457:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790773073.322509:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:1.0:1790773073.322522:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:110130ab-04fa-4d7c-984e-562032df4432+6:6250:x1877761484394368:12345-192.168.202.19@tcp:13: 00002000:00000024:1.0:1790773073.322561:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790773073.322716:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:110130ab-04fa-4d7c-984e-562032df4432+6:6250:x1877761484394368:12345-192.168.202.19@tcp:13: Request processed in 197us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773073.322725:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 17 00010000:00010000:1.0:1790773073.741514:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773074.766082:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773075.281013:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761495977600:0@lo:41: 00000100:00100000:3.0:1790773075.281124:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773075.281568:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f984e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce0675b4-b0c5-48e7-b182-565e22fed04c:3605:1877761495977856:0@lo:400: 00000100:00100000:1.0:1790773075.281606:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773075.281644:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f987b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3605:1877761495978368:0@lo:400: 00000100:00100000:1.0:1790773075.281669:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773075.281688:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f986300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3605:1877761495978880:0@lo:400: 00000100:00100000:1.0:1790773075.281707:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773075.281739:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1790773075.281745:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f984a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761495977728:0@lo:41: 00000100:00100000:1.0:1790773075.281782:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773075.281798:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f986d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3605:1877761495978240:0@lo:400: 00000100:00100000:1.0:1790773075.281830:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773075.282100:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f984380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761495978752:0@lo:400: 00000100:00100000:1.0:1790773075.282145:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773075.282166:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761495979264:0@lo:400: 00000100:00100000:1.0:1790773075.282186:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773075.282246:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761495978112:0@lo:400: 00000100:00100000:1.0:1790773075.282269:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773075.282284:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f985500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761495978624:0@lo:400: 00000100:00100000:1.0:1790773075.282302:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773075.282315:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f987100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761495979136:0@lo:400: 00000100:00100000:1.0:1790773075.282333:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773075.282351:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1790773075.282356:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f987480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3607:1877761495977984:0@lo:400: 00000100:00100000:1.0:1790773075.282376:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773075.282394:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f986680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3607:1877761495978496:0@lo:400: 00000100:00100000:1.0:1790773075.282430:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773075.282445:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f984000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3607:1877761495979008:0@lo:400: 00000100:00100000:1.0:1790773075.282473:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773075.282496:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495978368 00000100:00100000:1.0:1790773075.282503:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495978368 00000100:00100000:2.0:1790773075.282636:0:7666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495977600 00000100:00100000:2.0:1790773075.282641:0:7666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495977600 00000100:00100000:2.0:1790773075.282676:0:7666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495977728 00000100:00100000:2.0:1790773075.282679:0:7666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495977728 00000100:00100000:2.0:1790773075.282689:0:7666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495978112 00000100:00100000:2.0:1790773075.282692:0:7666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495978112 00000100:00100000:2.0:1790773075.282703:0:7666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790773075.282712:0:7666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761495977600:12345-0@lo:41: 00000004:00000024:2.0:1790773075.282747:0:7666:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1790773075.282809:0:7666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761495977600:12345-0@lo:41: Request processed in 98us (1685us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773075.282829:0:7666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790773075.282982:0:7666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790773075.282990:0:7666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3605:x1877761495977728:12345-0@lo:41: 00000004:00000024:2.0:1790773075.283008:0:7666:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790773075.283042:0:7666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3605:x1877761495977728:12345-0@lo:41: Request processed in 53us (1259us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773075.283048:0:7666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790773075.283061:0:7666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790773075.283067:0:7666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761495978112:12345-0@lo:400: 00000100:00100000:2.0:1790773075.283094:0:7666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761495978112:12345-0@lo:400: Request processed in 27us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773075.283100:0:7666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790773075.283117:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495978880 00000100:00100000:2.0:1790773075.283122:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495978880 00000100:00100000:2.0:1790773075.283147:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495978240 00000100:00100000:2.0:1790773075.283150:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495978240 00000100:00100000:2.0:1790773075.283159:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495977984 00000100:00100000:2.0:1790773075.283161:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495977984 00000100:00100000:2.0:1790773075.283168:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495978496 00000100:00100000:2.0:1790773075.283171:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495978496 00000100:00100000:2.0:1790773075.283181:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495979008 00000100:00100000:2.0:1790773075.283184:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495979008 00000100:00100000:2.0:1790773075.283197:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790773075.283222:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3605:x1877761495978880:12345-0@lo:400: 00000100:00100000:2.0:1790773075.283268:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3605:x1877761495978880:12345-0@lo:400: Request processed in 64us (1559us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773075.283275:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790773075.283289:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790773075.283294:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3605:x1877761495978240:12345-0@lo:400: 00000100:00100000:2.0:1790773075.283329:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3605:x1877761495978240:12345-0@lo:400: Request processed in 35us (1498us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773075.283335:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790773075.283346:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790773075.283352:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1877761495977984:12345-0@lo:400: 00000100:00100000:2.0:1790773075.283377:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1877761495977984:12345-0@lo:400: Request processed in 25us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773075.283382:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790773075.283393:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790773075.283398:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143caca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1877761495978496:12345-0@lo:400: 00000100:00100000:2.0:1790773075.283421:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143caca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1877761495978496:12345-0@lo:400: Request processed in 23us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773075.283426:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790773075.283436:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790773075.283442:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1877761495979008:12345-0@lo:400: 00000100:00100000:2.0:1790773075.283465:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1877761495979008:12345-0@lo:400: Request processed in 23us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773075.283470:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790773075.283489:0:8907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495978752 00000100:00100000:2.0:1790773075.283492:0:8907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495978752 00000100:00100000:1.0:1790773075.283832:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790773075.283839:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3605:x1877761495978368:12345-0@lo:400: 00000100:00100000:2.0:1790773075.284091:0:8907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495979264 00000100:00100000:2.0:1790773075.284096:0:8907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495979264 00000100:00100000:2.0:1790773075.284112:0:8907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495978624 00000100:00100000:2.0:1790773075.284114:0:8907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495978624 00000100:00100000:2.0:1790773075.284124:0:8907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495979136 00000100:00100000:2.0:1790773075.284127:0:8907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495979136 00000100:00100000:2.0:1790773075.284140:0:8907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790773075.284146:0:8907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761495978752:12345-0@lo:400: 00000100:00100000:2.0:1790773075.284191:0:8907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761495978752:12345-0@lo:400: Request processed in 46us (2046us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773075.284198:0:8907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790773075.284238:0:8907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790773075.284244:0:8907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761495979264:12345-0@lo:400: 00000100:00100000:2.0:1790773075.284273:0:8907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761495979264:12345-0@lo:400: Request processed in 30us (2086us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773075.284279:0:8907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790773075.284290:0:8907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790773075.284295:0:8907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761495978624:12345-0@lo:400: 00000100:00100000:2.0:1790773075.284321:0:8907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761495978624:12345-0@lo:400: Request processed in 25us (2017us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773075.284326:0:8907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790773075.284336:0:8907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790773075.284342:0:8907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761495979136:12345-0@lo:400: 00000100:00100000:2.0:1790773075.284368:0:8907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761495979136:12345-0@lo:400: Request processed in 26us (2034us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773075.284373:0:8907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1790773075.284404:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790773075.284408:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790773075.284411:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790773075.284413:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790773075.284447:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f987480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3607:1877761495977984:0@lo:400: 00010000:00080000:2.0:1790773075.284464:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f986680 x1877761495978496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773075.284475:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f986680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3607:1877761495978496:0@lo:400: 00010000:00080000:2.0:1790773075.284496:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f984000 x1877761495979008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773075.284504:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f984000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3607:1877761495979008:0@lo:400: 00000100:00100000:1.0:1790773075.284687:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3605:x1877761495978368:12345-0@lo:400: Request processed in 848us (3015us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773075.284694:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790773075.285293:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f984a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761495977728:0@lo:41: 00000100:00100000:3.0:1790773075.285308:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f986d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3605:1877761495978240:0@lo:400: 00010000:00080000:3.0:1790773075.285330:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f984380 x1877761495978752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773075.285340:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f984380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761495978752:0@lo:400: 00010000:00080000:3.0:1790773075.285351:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1437d7100 x1877761495979264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773075.285359:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761495979264:0@lo:400: 00000100:00100000:3.0:1790773075.285370:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f987b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3605:1877761495978368:0@lo:400: 00000100:00100000:3.0:1790773075.285380:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f986300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3605:1877761495978880:0@lo:400: 00000100:00100000:2.0:1790773075.289708:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761495978112:0@lo:400: 00010000:00080000:2.0:1790773075.289726:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f985500 x1877761495978624/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773075.289736:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f985500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761495978624:0@lo:400: 00010000:00080000:2.0:1790773075.289748:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f987100 x1877761495979136/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773075.290108:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f987100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761495979136:0@lo:400: 00000100:00100000:2.0:1790773075.290139:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761495977600:0@lo:41: 00000100:00100000:2.0:1790773075.290265:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495977856 00000100:00100000:2.0:1790773075.290273:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495977856 00000100:00100000:2.0:1790773075.290325:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1790773075.290334:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26be9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3605:x1877761495977856:12345-0@lo:400: 00000100:00100000:2.0:1790773075.290422:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26be9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3605:x1877761495977856:12345-0@lo:400: Request processed in 88us (8813us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773075.290429:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1790773075.290478:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f984e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce0675b4-b0c5-48e7-b182-565e22fed04c:3605:1877761495977856:0@lo:400: 00000001:00100000:0.0:1790773075.296268:0:9475:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 110130ab-04fa-4d7c-984e-562032df4432 00000100:00100000:2.0:1790773075.296523:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790773075.296548:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761495979520:0@lo:13: 00000100:00100000:2.0:1790773075.296663:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773075.296712:0:8397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495979520 00000100:00100000:2.0:1790773075.296733:0:8397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495979520 00000100:00100000:2.0:1790773075.297107:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790773075.297117:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761495979520:12345-0@lo:13: 00002000:00000024:2.0:1790773075.297152:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790773075.297232:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761495979520:12345-0@lo:13: Request processed in 86us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773075.297241:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790773075.297273:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143caf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761495979392:0@lo:13: 00000100:00100000:2.0:1790773075.297301:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773075.297331:0:8397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495979392 00000100:00100000:2.0:1790773075.297336:0:8397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495979392 00000100:00100000:2.0:1790773075.297358:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790773075.297363:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761495979392:12345-0@lo:13: 00002000:00000024:2.0:1790773075.297373:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790773075.297403:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761495979392:12345-0@lo:13: Request processed in 39us (101us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773075.297409:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1790773075.297449:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f9e6300 x1877761495979520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773091 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773075.297470:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761495979520:0@lo:13: 00010000:00080000:2.0:1790773075.297502:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143caf480 x1877761495979392/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773091 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773075.298583:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143caf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761495979392:0@lo:13: 00000001:02000400:3.0:1790773075.693136:0:10146:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1790773075.790414:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773076.012646:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773076.012713:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773076.013126:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484394496 00000100:00100000:0.0:1790773076.013137:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484394496 00000100:00100000:0.0:1790773076.013245:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 198 00000100:00100000:0.0:1790773076.013264:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+10:2399:x1877761484394496:12345-192.168.202.19@tcp:400: 00000100:00100000:0.0:1790773076.013333:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+10:2399:x1877761484394496:12345-192.168.202.19@tcp:400: Request processed in 71us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773076.013340:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 198 00000100:00100000:2.0:1790773076.016126:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484394624 00000100:00100000:2.0:1790773076.016141:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484394624 00000100:00100000:2.0:1790773076.016389:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 57 00000100:00100000:2.0:1790773076.016414:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+7:2399:x1877761484394624:12345-192.168.202.19@tcp:400: 00000100:00100000:2.0:1790773076.016748:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+7:2399:x1877761484394624:12345-192.168.202.19@tcp:400: Request processed in 335us (4033us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773076.016757:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 57 00000100:00100000:1.0:1790773076.020039:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773076.020096:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773076.020107:0:8907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484394880 00000100:00100000:2.0:1790773076.020116:0:8907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484394880 00000100:00100000:1.0:1790773076.020163:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773076.020245:0:8394:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484395008 00000100:00100000:1.0:1790773076.020250:0:8394:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484395008 00000100:00100000:0.0:1790773076.020340:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484394752 00000100:00100000:0.0:1790773076.020346:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484394752 00000100:00100000:2.0:1790773076.023442:0:8393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:2.0:1790773076.023457:0:8393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143caf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:110130ab-04fa-4d7c-984e-562032df4432+6:2400:x1877761484394880:12345-192.168.202.19@tcp:400: 00000100:00100000:2.0:1790773076.023531:0:8393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143caf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:110130ab-04fa-4d7c-984e-562032df4432+6:2400:x1877761484394880:12345-192.168.202.19@tcp:400: Request processed in 79us (3504us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773076.023537:0:8393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:0.0:1790773076.023668:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 58 00000100:00100000:0.0:1790773076.023678:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143caed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+6:2400:x1877761484394752:12345-192.168.202.19@tcp:400: 00000100:00100000:0.0:1790773076.023740:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143caed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+6:2400:x1877761484394752:12345-192.168.202.19@tcp:400: Request processed in 65us (3644us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773076.023747:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 58 00000100:00080000:3.0:1790773076.027130:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790773076.027241:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790773076.027246:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790773076.027260:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790773076.032890:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 18 00000100:00100000:1.0:1790773076.032913:0:8394:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:110130ab-04fa-4d7c-984e-562032df4432+5:2400:x1877761484395008:12345-192.168.202.19@tcp:400: 00000100:00100000:1.0:1790773076.033010:0:8394:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:110130ab-04fa-4d7c-984e-562032df4432+5:2400:x1877761484395008:12345-192.168.202.19@tcp:400: Request processed in 107us (12846us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773076.033018:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 18 00000001:00100000:2.0:1790773076.303267:0:6457:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 110130ab-04fa-4d7c-984e-562032df4432 00000001:00100000:2.0:1790773076.304240:0:7410:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 110130ab-04fa-4d7c-984e-562032df4432 00010000:00010000:0.0:1790773076.816027:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1790773077.338063:0:8388:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 110130ab-04fa-4d7c-984e-562032df4432 00010000:00010000:3.0:1790773077.837313:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773078.350003:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790773078.350030:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761495979776:0@lo:13: 00000100:00100000:2.0:1790773078.350101:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773078.350279:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761495979648:0@lo:13: 00000100:00100000:3.0:1790773078.350320:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773078.350568:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495979776 00000100:00100000:2.0:1790773078.350576:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495979776 00000100:00100000:2.0:1790773078.350623:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495979648 00000100:00100000:2.0:1790773078.350626:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495979648 00000100:00100000:2.0:1790773078.350642:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790773078.350650:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761495979776:12345-0@lo:13: 00002000:00000024:2.0:1790773078.350680:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790773078.350813:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761495979776:12345-0@lo:13: Request processed in 163us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773078.350837:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790773078.350856:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790773078.350862:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761495979648:12345-0@lo:13: 00002000:00000024:2.0:1790773078.350872:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790773078.350902:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761495979648:12345-0@lo:13: Request processed in 40us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773078.350908:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1790773078.351052:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143cae680 x1877761495979776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773094 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773078.351073:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761495979776:0@lo:13: 00000100:00080000:3.0:1790773078.351253:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790773078.351277:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f9e6300 x1877761495979648/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773094 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773078.351300:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761495979648:0@lo:13: 00010000:00010000:3.0:1790773078.861360:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790773079.243836:0:10294:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff0e8aeb10 20000000:00000080:1.0:1790773079.243856:0:10294:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93d27f9e8000 uarg=0000000000000000 20000000:01000000:1.0:1790773079.243899:0:10294:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1790773079.243902:0:10294:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1790773079.243905:0:10294:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1790773079.243910:0:10294:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1790773079.243916:0:10294:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1790773079.243980:0:10294:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1790773079.243983:0:10294:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1790773079.244532:0:10295:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:1.0:1790773079.244695:0:10294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:1.0:1790773079.244736:0:10294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:1.0:1790773079.244754:0:10294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:1.0:1790773079.244763:0:10294:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1790773079.244765:0:10294:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1790773079.245791:0:10296:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:1.0:1790773079.246023:0:10294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:1.0:1790773079.246048:0:10294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:1.0:1790773079.246064:0:10294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:1.0:1790773079.246076:0:10294:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1790773079.246078:0:10294:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1790773079.260443:0:10297:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:1.0:1790773079.260915:0:10294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:1.0:1790773079.260949:0:10294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:1.0:1790773079.260965:0:10294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:1.0:1790773079.260976:0:10294:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1790773079.260979:0:10294:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1790773079.265705:0:10298:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:2.0:1790773079.266088:0:10294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:2.0:1790773079.266123:0:10294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:2.0:1790773079.266142:0:10294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:2.0:1790773079.266155:0:10294:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1790773079.266158:0:10294:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1790773079.266652:0:10299:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:2.0:1790773079.266864:0:10294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:2.0:1790773079.266884:0:10294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:2.0:1790773079.266898:0:10294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 10000000:01000000:2.0:1790773079.266912:0:10294:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1790773079.266931:0:10294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93d26efc4600/0xabf1cc0bc784194a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773079.266949:0:10294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d27b12bc00/0xabf1cc0bc78417e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78417de expref: 23 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773079.266957:0:10294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d24166fe00/0xabf1cc0bc784180f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7841808 expref: 23 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773079.266965:0:10294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d27b12ae00/0xabf1cc0bc784184e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7841847 expref: 23 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773079.266971:0:10294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d24166fc00/0xabf1cc0bc784185c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7841855 expref: 23 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773079.266987:0:10294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d24166ee00/0xabf1cc0bc784186a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7841863 expref: 23 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773079.266994:0:10294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d27b12a800/0xabf1cc0bc7841886 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc784187f expref: 23 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773079.267001:0:10294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d26efc4000/0xabf1cc0bc78418b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78418a9 expref: 23 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773079.267007:0:10294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d279de2c00/0xabf1cc0bc78418cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78418c5 expref: 23 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773079.267014:0:10294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d279de2200/0xabf1cc0bc78418f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78418ef expref: 23 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773079.267023:0:10294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d27b12a400/0xabf1cc0bc7841904 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6ba4a expref: 9 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773079.267031:0:10294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d26efc4400/0xabf1cc0bc784190b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6ba51 expref: 9 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773079.267039:0:10294:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93d26efc4600/0xabf1cc0bc784194a lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773079.267079:0:10294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d26efc4400/0xabf1cc0bc784190b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6ba51 expref: 9 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773079.267094:0:10294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d26efc4400/0xabf1cc0bc784190b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6ba51 expref: 9 pid: 6472 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773079.267120:0:10294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9e7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10294:1877761495979904:192.168.202.19@tcp:104: 00010000:00010000:2.0:1790773079.267252:0:10294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d27b12a400/0xabf1cc0bc7841904 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6ba4a expref: 9 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773079.267260:0:10294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d27b12a400/0xabf1cc0bc7841904 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6ba4a expref: 9 pid: 6471 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773079.267269:0:10294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9e6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10294:1877761495980032:192.168.202.19@tcp:104: 00010000:00010000:2.0:1790773079.267315:0:10294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d279de2200/0xabf1cc0bc78418f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc78418ef expref: 23 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773079.267324:0:10294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d279de2200/0xabf1cc0bc78418f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc78418ef expref: 23 pid: 6473 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773079.267334:0:10294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9e7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10294:1877761495980160:0@lo:104: 00000100:00100000:2.0:1790773079.267499:0:10294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790773079.267545:0:10294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d279de2c00/0xabf1cc0bc78418cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc78418c5 expref: 23 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773079.267552:0:10294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d279de2c00/0xabf1cc0bc78418cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc78418c5 expref: 23 pid: 6473 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773079.267560:0:10294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9e5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10294:1877761495980288:0@lo:104: 00000100:00100000:2.0:1790773079.267580:0:10294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790773079.267609:0:10294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d26efc4000/0xabf1cc0bc78418b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc78418a9 expref: 23 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773079.267617:0:10294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d26efc4000/0xabf1cc0bc78418b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc78418a9 expref: 23 pid: 6471 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773079.267632:0:10294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9e7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10294:1877761495980416:0@lo:104: 00000100:00100000:2.0:1790773079.267665:0:10294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790773079.267689:0:10294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d27b12a800/0xabf1cc0bc7841886 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc784187f expref: 23 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773079.267697:0:10294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d27b12a800/0xabf1cc0bc7841886 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc784187f expref: 23 pid: 6471 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773079.267704:0:10294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9e4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10294:1877761495980544:0@lo:104: 00010000:00010000:2.0:1790773079.267724:0:10294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d24166ee00/0xabf1cc0bc784186a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc7841863 expref: 23 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773079.267731:0:10294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d24166ee00/0xabf1cc0bc784186a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc7841863 expref: 23 pid: 6472 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773079.267739:0:10294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9e5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10294:1877761495980672:0@lo:104: 00010000:00010000:2.0:1790773079.267761:0:10294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d24166fc00/0xabf1cc0bc784185c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc7841855 expref: 23 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773079.267769:0:10294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d24166fc00/0xabf1cc0bc784185c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc7841855 expref: 23 pid: 6472 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773079.267786:0:10294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9e5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10294:1877761495980800:0@lo:104: 00000100:00100000:1.0:1790773079.267786:0:6462:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1790773079.267804:0:6462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773079.267821:0:10294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773079.267837:0:6462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790773079.267843:0:10294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d27b12ae00/0xabf1cc0bc784184e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc7841847 expref: 23 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773079.267845:0:6462:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495980160 00010000:00010000:2.0:1790773079.267851:0:10294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d27b12ae00/0xabf1cc0bc784184e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc7841847 expref: 23 pid: 6471 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773079.267851:0:6462:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495980160 00000100:00100000:2.0:1790773079.267865:0:10294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9e6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10294:1877761495980928:0@lo:104: 00000100:00100000:1.0:1790773079.267882:0:6462:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495980288 00000100:00100000:1.0:1790773079.267885:0:6462:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495980288 00000100:00100000:2.0:1790773079.267892:0:10294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773079.267894:0:6462:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495980416 00000100:00100000:1.0:1790773079.267896:0:6462:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495980416 00000100:00100000:1.0:1790773079.267905:0:6462:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495980544 00000100:00100000:1.0:1790773079.267907:0:6462:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495980544 00010000:00010000:2.0:1790773079.267909:0:10294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d24166fe00/0xabf1cc0bc784180f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc7841808 expref: 23 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773079.267916:0:6462:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495980800 00010000:00010000:2.0:1790773079.267918:0:10294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d24166fe00/0xabf1cc0bc784180f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc7841808 expref: 23 pid: 6471 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773079.267918:0:6462:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495980800 00000100:00100000:1.0:1790773079.267925:0:6462:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495980672 00000100:00100000:2.0:1790773079.267926:0:10294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143c7c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10294:1877761495981056:0@lo:104: 00000100:00100000:1.0:1790773079.267927:0:6462:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495980672 00000100:00100000:1.0:1790773079.267935:0:6462:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495980928 00000100:00100000:1.0:1790773079.267937:0:6462:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495980928 00000100:00100000:2.0:1790773079.267944:0:10294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773079.267946:0:6462:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495981056 00000100:00100000:1.0:1790773079.267954:0:6462:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495981056 00010000:00010000:2.0:1790773079.267958:0:10294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d27b12bc00/0xabf1cc0bc78417e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc78417de expref: 23 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773079.267965:0:10294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d27b12bc00/0xabf1cc0bc78417e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc78417de expref: 23 pid: 6471 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773079.267969:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790773079.267973:0:10294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143c7c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10294:1877761495981184:0@lo:104: 00000100:00100000:1.0:1790773079.267976:0:6462:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+10:10294:x1877761495980160:12345-0@lo:104: 00010000:00010000:1.0:1790773079.267988:0:6462:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d26efc5600/0xabf1cc0bc78418ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc78418f6 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773079.267989:0:10294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773079.267998:0:10294:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2512d89c0 going to sleep for 11 seconds 00010000:00010000:1.0:1790773079.268035:0:6462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790773079.268041:0:6462:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+10:10294:x1877761495980160:12345-0@lo:104: Request processed in 66us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773079.268047:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790773079.268054:0:10294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9e7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10294:1877761495980160:0@lo:104: 00000100:00100000:1.0:1790773079.268061:0:6462:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495981184 00000100:00100000:1.0:1790773079.268064:0:6462:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495981184 00000100:00100000:1.0:1790773079.268076:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790773079.268081:0:6462:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+10:10294:x1877761495980288:12345-0@lo:104: 00010000:00010000:1.0:1790773079.268089:0:6462:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d27b12a000/0xabf1cc0bc78418c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc78418cc expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773079.268132:0:6462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1790773079.268137:0:6462:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+10:10294:x1877761495980288:12345-0@lo:104: Request processed in 56us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773079.268143:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790773079.268163:0:10294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9e5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10294:1877761495980288:0@lo:104: 00000100:00100000:1.0:1790773079.268166:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790773079.268171:0:6462:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b98850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+9:10294:x1877761495980416:12345-0@lo:104: 00010000:00010000:1.0:1790773079.268178:0:6462:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d279de2000/0xabf1cc0bc78418a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc78418b0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773079.268239:0:6462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1790773079.268245:0:6462:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b98850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+9:10294:x1877761495980416:12345-0@lo:104: Request processed in 74us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773079.268256:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790773079.268285:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790773079.268291:0:6462:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+8:10294:x1877761495980544:12345-0@lo:104: 00010000:00010000:1.0:1790773079.268300:0:6462:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d27b12ba00/0xabf1cc0bc784187f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7841886 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773079.268328:0:6462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1790773079.268333:0:6462:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+8:10294:x1877761495980544:12345-0@lo:104: Request processed in 42us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773079.268338:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790773079.268349:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790773079.268355:0:6462:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+7:10294:x1877761495980800:12345-0@lo:104: 00010000:00010000:1.0:1790773079.268362:0:6462:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3a00/0xabf1cc0bc7841855 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc784185c expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773079.268387:0:6462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1790773079.268392:0:6462:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+7:10294:x1877761495980800:12345-0@lo:104: Request processed in 37us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773079.268397:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790773079.268408:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790773079.268413:0:6462:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+6:10294:x1877761495980672:12345-0@lo:104: 00010000:00010000:1.0:1790773079.268420:0:6462:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d24166fa00/0xabf1cc0bc7841863 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc784186a expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773079.268445:0:6462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1790773079.268448:0:10294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9e7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10294:1877761495980416:0@lo:104: 00000100:00100000:1.0:1790773079.268450:0:6462:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+6:10294:x1877761495980672:12345-0@lo:104: Request processed in 38us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773079.268456:0:10294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9e4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10294:1877761495980544:0@lo:104: 00000100:00100000:1.0:1790773079.268461:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790773079.268462:0:10294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9e5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10294:1877761495980672:0@lo:104: 00000100:00100000:2.0:1790773079.268468:0:10294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9e5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10294:1877761495980800:0@lo:104: 00000100:00100000:1.0:1790773079.268473:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790773079.268478:0:6462:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143c7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+5:10294:x1877761495980928:12345-0@lo:104: 00010000:00010000:1.0:1790773079.268486:0:6462:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2800/0xabf1cc0bc7841847 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc784184e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773079.268524:0:6462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1790773079.268529:0:6462:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143c7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+5:10294:x1877761495980928:12345-0@lo:104: Request processed in 52us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773079.268534:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790773079.268545:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790773079.268550:0:6462:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143c7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+4:10294:x1877761495981056:12345-0@lo:104: 00010000:00010000:1.0:1790773079.268557:0:6462:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d27b12be00/0xabf1cc0bc7841808 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc784180f expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773079.268581:0:6462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:1.0:1790773079.268585:0:6462:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143c7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+4:10294:x1877761495981056:12345-0@lo:104: Request processed in 36us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773079.268590:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790773079.268601:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790773079.268606:0:6462:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143c7d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+3:10294:x1877761495981184:12345-0@lo:104: 00010000:00010000:1.0:1790773079.268612:0:6462:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc78417de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc78417e5 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773079.268635:0:6462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:1.0:1790773079.268639:0:6462:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143c7d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+3:10294:x1877761495981184:12345-0@lo:104: Request processed in 34us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773079.268649:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:1.0:1790773079.268665:0:6466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:1.0:1790773079.268671:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d26efc5600/0xabf1cc0bc78418ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc78418f6 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773079.268679:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc5600 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:1.0:1790773079.268683:0:6466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d26efc5600/0xabf1cc0bc78418ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc78418f6 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773079.268693:0:6466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d26efc5600/0xabf1cc0bc78418ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc78418f6 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790773079.268700:0:6466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d26efc5600/0xabf1cc0bc78418ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc78418f6 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790773079.268707:0:6466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790773079.268733:0:6466:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d26efc5600/0xabf1cc0bc78418ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78418f6 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773079.268740:0:6466:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790773079.268756:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d26efc5600/0xabf1cc0bc78418ef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78418f6 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773079.268762:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d26efc5600/0xabf1cc0bc78418ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78418f6 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773079.268788:0:6466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1790773079.268792:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d27b12a000/0xabf1cc0bc78418c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc78418cc expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773079.268808:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12a000 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:1.0:1790773079.268811:0:6466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d27b12a000/0xabf1cc0bc78418c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc78418cc expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773079.268818:0:6466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d27b12a000/0xabf1cc0bc78418c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc78418cc expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790773079.268824:0:6466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d27b12a000/0xabf1cc0bc78418c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc78418cc expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790773079.268829:0:6466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1790773079.268832:0:10294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9e6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10294:1877761495980928:0@lo:104: 00010000:00010000:1.0:1790773079.268845:0:6466:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d27b12a000/0xabf1cc0bc78418c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78418cc expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773079.268847:0:10294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143c7c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10294:1877761495981056:0@lo:104: 00010000:00010000:1.0:1790773079.268852:0:6466:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1790773079.268854:0:10294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143c7c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10294:1877761495981184:0@lo:104: 00010000:00010000:1.0:1790773079.268867:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d27b12a000/0xabf1cc0bc78418c5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78418cc expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773079.268874:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d27b12a000/0xabf1cc0bc78418c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78418cc expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773079.268883:0:6466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1790773079.268886:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d279de2000/0xabf1cc0bc78418a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc78418b0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773079.268893:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d279de2000 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:1.0:1790773079.268896:0:6466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d279de2000/0xabf1cc0bc78418a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc78418b0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773079.268913:0:6466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d279de2000/0xabf1cc0bc78418a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc78418b0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790773079.268920:0:6466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d279de2000/0xabf1cc0bc78418a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc78418b0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790773079.268925:0:6466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790773079.268952:0:6466:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d279de2000/0xabf1cc0bc78418a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78418b0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773079.268959:0:6466:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790773079.268964:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d279de2000/0xabf1cc0bc78418a9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78418b0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773079.268971:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d279de2000/0xabf1cc0bc78418a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78418b0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773079.268981:0:6466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1790773079.268984:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d27b12ba00/0xabf1cc0bc784187f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7841886 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773079.268990:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12ba00 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:1.0:1790773079.268992:0:6466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d27b12ba00/0xabf1cc0bc784187f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc7841886 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773079.268999:0:6466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d27b12ba00/0xabf1cc0bc784187f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc7841886 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790773079.269005:0:6466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d27b12ba00/0xabf1cc0bc784187f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc7841886 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790773079.269017:0:6466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790773079.269031:0:6466:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d27b12ba00/0xabf1cc0bc784187f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841886 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773079.269037:0:6466:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790773079.269043:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d27b12ba00/0xabf1cc0bc784187f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841886 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773079.269049:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d27b12ba00/0xabf1cc0bc784187f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841886 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773079.269059:0:6466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1790773079.269062:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3a00/0xabf1cc0bc7841855 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc784185c expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773079.269067:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a3a00 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:1.0:1790773079.269070:0:6466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3a00/0xabf1cc0bc7841855 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc784185c expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773079.269077:0:6466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3a00/0xabf1cc0bc7841855 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc784185c expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790773079.269083:0:6466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3a00/0xabf1cc0bc7841855 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc784185c expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790773079.269088:0:6466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790773079.269099:0:6466:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3a00/0xabf1cc0bc7841855 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc784185c expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773079.269105:0:6466:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790773079.269115:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3a00/0xabf1cc0bc7841855 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc784185c expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773079.269122:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3a00/0xabf1cc0bc7841855 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc784185c expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773079.269130:0:6466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1790773079.269133:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d24166fa00/0xabf1cc0bc7841863 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc784186a expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773079.269139:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d24166fa00 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:1.0:1790773079.269142:0:6466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d24166fa00/0xabf1cc0bc7841863 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc784186a expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773079.269149:0:6466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d24166fa00/0xabf1cc0bc7841863 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc784186a expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790773079.269155:0:6466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d24166fa00/0xabf1cc0bc7841863 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc784186a expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790773079.269160:0:6466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790773079.269170:0:6466:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d24166fa00/0xabf1cc0bc7841863 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc784186a expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773079.269175:0:6466:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790773079.269178:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d24166fa00/0xabf1cc0bc7841863 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc784186a expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773079.269184:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d24166fa00/0xabf1cc0bc7841863 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc784186a expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773079.269191:0:6466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1790773079.269199:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2800/0xabf1cc0bc7841847 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc784184e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773079.269223:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a2800 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:1.0:1790773079.269226:0:6466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2800/0xabf1cc0bc7841847 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc784184e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773079.269233:0:6466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2800/0xabf1cc0bc7841847 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc784184e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790773079.269239:0:6466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2800/0xabf1cc0bc7841847 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc784184e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790773079.269244:0:6466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790773079.269256:0:6466:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2800/0xabf1cc0bc7841847 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc784184e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773079.269262:0:6466:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790773079.269266:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2800/0xabf1cc0bc7841847 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc784184e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773079.269273:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2800/0xabf1cc0bc7841847 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc784184e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773079.269282:0:6466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790773079.269285:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d27b12be00/0xabf1cc0bc7841808 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc784180f expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773079.269291:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12be00 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:1.0:1790773079.269293:0:6466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d27b12be00/0xabf1cc0bc7841808 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc784180f expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773079.269309:0:6466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d27b12be00/0xabf1cc0bc7841808 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc784180f expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790773079.269315:0:6466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d27b12be00/0xabf1cc0bc7841808 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc784180f expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790773079.269320:0:6466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790773079.269337:0:6466:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d27b12be00/0xabf1cc0bc7841808 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc784180f expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773079.269344:0:6466:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790773079.269348:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d27b12be00/0xabf1cc0bc7841808 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc784180f expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773079.269353:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d27b12be00/0xabf1cc0bc7841808 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc784180f expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773079.269363:0:6466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790773079.269366:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc78417de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc78417e5 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773079.269370:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a2000 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:1.0:1790773079.269373:0:6466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc78417de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc78417e5 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773079.269378:0:6466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc78417de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc78417e5 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790773079.269384:0:6466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc78417de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc78417e5 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790773079.269394:0:6466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790773079.269406:0:6466:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc78417de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78417e5 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773079.269412:0:6466:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790773079.269415:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc78417de lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78417e5 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773079.269421:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc78417de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78417e5 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773079.269435:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773079.269437:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773079.269439:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773079.269446:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773079.269458:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce0675b4-b0c5-48e7-b182-565e22fed04c:3606:1877761495981440:0@lo:103: 00000100:00100000:1.0:1790773079.269498:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773079.269537:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143caea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce0675b4-b0c5-48e7-b182-565e22fed04c:3606:1877761495981952:0@lo:103: 00000100:00100000:2.0:1790773079.269549:0:8410:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495981440 00000100:00100000:2.0:1790773079.269555:0:8410:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495981440 00000100:00100000:1.0:1790773079.269558:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773079.269575:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00010000:00010000:2.0:1790773079.269576:0:8410:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d279de2c00/0xabf1cc0bc78418cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc78418c5 expref: 24 pid: 6473 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773079.269580:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce0675b4-b0c5-48e7-b182-565e22fed04c:3606:1877761495981568:0@lo:103: 00000100:00100000:2.0:1790773079.269597:0:8410:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495981952 00000100:00100000:1.0:1790773079.269597:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773079.269600:0:8410:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495981952 00010000:00010000:2.0:1790773079.269610:0:8410:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d24166ee00/0xabf1cc0bc784186a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7841863 expref: 25 pid: 6472 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773079.269611:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce0675b4-b0c5-48e7-b182-565e22fed04c:3606:1877761495982080:0@lo:103: 00000100:00100000:2.0:1790773079.269621:0:8410:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495981568 00000100:00100000:2.0:1790773079.269623:0:8410:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495981568 00000100:00100000:1.0:1790773079.269628:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790773079.269632:0:8410:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d26efc4000/0xabf1cc0bc78418b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc78418a9 expref: 26 pid: 6471 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773079.269641:0:8410:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495982080 00000100:00100000:2.0:1790773079.269644:0:8410:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495982080 00000100:00100000:1.0:1790773079.269652:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790773079.269659:0:6463:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ca850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce0675b4-b0c5-48e7-b182-565e22fed04c+27:3606:x1877761495981440:12345-0@lo:103: 00010000:00010000:2.0:1790773079.269665:0:8410:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d27b12ae00/0xabf1cc0bc784184e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7841847 expref: 27 pid: 6471 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773079.269669:0:6463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790773079.269677:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00010000:00010000:1.0:1790773079.269678:0:6463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d279de2c00/0xabf1cc0bc78418cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc78418c5 expref: 27 pid: 6473 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773079.269682:0:8410:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ce0675b4-b0c5-48e7-b182-565e22fed04c+27:3606:x1877761495981952:12345-0@lo:103: 00010000:00010000:2.0:1790773079.269688:0:8410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790773079.269689:0:6463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d279de2c00/0xabf1cc0bc78418cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc78418c5 expref: 27 pid: 6473 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773079.269692:0:8410:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d24166ee00/0xabf1cc0bc784186a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7841863 expref: 27 pid: 6472 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773079.269703:0:6463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d279de2c00/0xabf1cc0bc78418cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc78418c5 expref: 27 pid: 6473 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773079.269870:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773079.269881:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143caf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce0675b4-b0c5-48e7-b182-565e22fed04c:3605:1877761495981312:0@lo:103: 00000100:00100000:0.0:1790773079.269906:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773079.269917:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce0675b4-b0c5-48e7-b182-565e22fed04c:3605:1877761495981824:0@lo:103: 00000100:00100000:0.0:1790773079.269932:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773079.269948:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce0675b4-b0c5-48e7-b182-565e22fed04c:3605:1877761495982336:0@lo:103: 00000100:00100000:0.0:1790773079.269966:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773079.269976:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1790773079.269981:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce0675b4-b0c5-48e7-b182-565e22fed04c:3605:1877761495981696:0@lo:103: 00000100:00100000:0.0:1790773079.270000:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773079.270009:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce0675b4-b0c5-48e7-b182-565e22fed04c:3605:1877761495982208:0@lo:103: 00000100:00100000:0.0:1790773079.270026:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773079.270047:0:6464:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1790773079.270054:0:6464:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:0.0:1790773079.270242:0:6464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495981312 00000100:00100000:0.0:1790773079.270246:0:6464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495981312 00010000:00010000:0.0:1790773079.270263:0:6464:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d279de2200/0xabf1cc0bc78418f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc78418ef expref: 28 pid: 6473 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773079.270279:0:6464:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1790773079.270284:0:6464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495981824 00000100:00100000:0.0:1790773079.270287:0:6464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495981824 00010000:00010000:0.0:1790773079.270296:0:6464:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d24166fc00/0xabf1cc0bc784185c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7841855 expref: 29 pid: 6472 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773079.270306:0:6464:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1790773079.270309:0:6464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495982336 00000100:00100000:0.0:1790773079.270311:0:6464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495982336 00010000:00010000:0.0:1790773079.270319:0:6464:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d27b12bc00/0xabf1cc0bc78417e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc78417de expref: 30 pid: 6471 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773079.270329:0:6464:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1790773079.270333:0:6464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495981696 00000100:00100000:0.0:1790773079.270336:0:6464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495981696 00010000:00010000:0.0:1790773079.270345:0:6464:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d27b12a800/0xabf1cc0bc7841886 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc784187f expref: 31 pid: 6471 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773079.270368:0:6464:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1790773079.270372:0:6464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495982208 00000100:00100000:0.0:1790773079.270375:0:6464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495982208 00010000:00010000:0.0:1790773079.270386:0:6464:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d24166fe00/0xabf1cc0bc784180f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7841808 expref: 32 pid: 6471 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773079.270396:0:6464:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1790773079.270402:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790773079.270408:0:6464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143caf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+32:3606:x1877761495981568:12345-0@lo:103: 00010000:00010000:0.0:1790773079.270416:0:6464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773079.270421:0:6464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d26efc4000/0xabf1cc0bc78418b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc78418a9 expref: 32 pid: 6471 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773079.273594:0:8410:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d24166ee00/0xabf1cc0bc784186a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc7841863 expref: 31 pid: 6472 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773079.273647:0:8410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d24166ee00/0xabf1cc0bc784186a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc7841863 expref: 31 pid: 6472 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773079.273666:0:8410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790773079.273749:0:8410:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ce0675b4-b0c5-48e7-b182-565e22fed04c+30:3606:x1877761495981952:12345-0@lo:103: Request processed in 4065us (4188us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773079.273759:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790773079.273803:0:8410:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1790773079.273817:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790773079.273827:0:8410:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ce0675b4-b0c5-48e7-b182-565e22fed04c+29:3606:x1877761495982080:12345-0@lo:103: 00010000:00010000:2.0:1790773079.273843:0:8410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790773079.273850:0:8410:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d27b12ae00/0xabf1cc0bc784184e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7841847 expref: 29 pid: 6471 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773079.273858:0:8410:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d27b12ae00/0xabf1cc0bc784184e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc7841847 expref: 29 pid: 6471 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773079.273867:0:8410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d27b12ae00/0xabf1cc0bc784184e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc7841847 expref: 29 pid: 6471 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773079.273875:0:8410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790773079.273898:0:8410:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ce0675b4-b0c5-48e7-b182-565e22fed04c+28:3606:x1877761495982080:12345-0@lo:103: Request processed in 74us (4268us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773079.273904:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790773079.273915:0:8410:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1790773079.273920:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790773079.273926:0:8410:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f976d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ce0675b4-b0c5-48e7-b182-565e22fed04c+27:3605:x1877761495981312:12345-0@lo:103: 00010000:00010000:2.0:1790773079.273933:0:8410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790773079.273944:0:8410:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d279de2200/0xabf1cc0bc78418f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc78418ef expref: 27 pid: 6473 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773079.273953:0:8410:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d279de2200/0xabf1cc0bc78418f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc78418ef expref: 27 pid: 6473 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773079.273962:0:8410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d279de2200/0xabf1cc0bc78418f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc78418ef expref: 27 pid: 6473 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773079.273970:0:8410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790773079.274001:0:8410:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f976d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ce0675b4-b0c5-48e7-b182-565e22fed04c+26:3605:x1877761495981312:12345-0@lo:103: Request processed in 75us (4094us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773079.274008:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790773079.274021:0:8410:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1790773079.274028:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790773079.274033:0:8410:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f976680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ce0675b4-b0c5-48e7-b182-565e22fed04c+25:3605:x1877761495981824:12345-0@lo:103: 00010000:00010000:2.0:1790773079.274041:0:8410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790773079.274045:0:8410:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d24166fc00/0xabf1cc0bc784185c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7841855 expref: 25 pid: 6472 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773079.274054:0:8410:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d24166fc00/0xabf1cc0bc784185c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc7841855 expref: 25 pid: 6472 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773079.274062:0:8410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d24166fc00/0xabf1cc0bc784185c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc7841855 expref: 25 pid: 6472 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773079.274071:0:8410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790773079.274092:0:8410:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f976680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3605:x1877761495981824:12345-0@lo:103: Request processed in 59us (4159us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773079.274097:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790773079.274116:0:8410:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1790773079.274122:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790773079.274127:0:8410:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f976300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ce0675b4-b0c5-48e7-b182-565e22fed04c+23:3605:x1877761495982336:12345-0@lo:103: 00010000:00010000:2.0:1790773079.274135:0:8410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790773079.274140:0:8410:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d27b12bc00/0xabf1cc0bc78417e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc78417de expref: 23 pid: 6471 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773079.274148:0:8410:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d27b12bc00/0xabf1cc0bc78417e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc78417de expref: 23 pid: 6471 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773079.274158:0:8410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d27b12bc00/0xabf1cc0bc78417e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc78417de expref: 23 pid: 6471 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773079.274166:0:8410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790773079.274188:0:8410:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f976300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ce0675b4-b0c5-48e7-b182-565e22fed04c+22:3605:x1877761495982336:12345-0@lo:103: Request processed in 61us (4221us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773079.274193:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790773079.274220:0:8410:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1790773079.274226:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790773079.274232:0:8410:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:3605:x1877761495981696:12345-0@lo:103: 00010000:00010000:2.0:1790773079.274239:0:8410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790773079.274242:0:8410:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d27b12a800/0xabf1cc0bc7841886 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc784187f expref: 21 pid: 6471 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773079.274250:0:8410:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d27b12a800/0xabf1cc0bc7841886 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc784187f expref: 21 pid: 6471 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773079.274258:0:8410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d27b12a800/0xabf1cc0bc7841886 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc784187f expref: 21 pid: 6471 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773079.274274:0:8410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790773079.274295:0:8410:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ce0675b4-b0c5-48e7-b182-565e22fed04c+20:3605:x1877761495981696:12345-0@lo:103: Request processed in 63us (4295us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773079.274301:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790773079.274312:0:8410:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1790773079.274317:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790773079.274323:0:8410:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f974700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ce0675b4-b0c5-48e7-b182-565e22fed04c+19:3605:x1877761495982208:12345-0@lo:103: 00010000:00010000:2.0:1790773079.274330:0:8410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790773079.274334:0:8410:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d24166fe00/0xabf1cc0bc784180f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7841808 expref: 19 pid: 6471 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773079.274342:0:8410:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d24166fe00/0xabf1cc0bc784180f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc7841808 expref: 19 pid: 6471 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773079.274351:0:8410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d24166fe00/0xabf1cc0bc784180f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc7841808 expref: 19 pid: 6471 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773079.274549:0:8410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790773079.274574:0:8410:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f974700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:3605:x1877761495982208:12345-0@lo:103: Request processed in 251us (4547us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773079.274581:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790773079.274631:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce0675b4-b0c5-48e7-b182-565e22fed04c:3605:1877761495981696:0@lo:103: 00000100:00100000:2.0:1790773079.274641:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce0675b4-b0c5-48e7-b182-565e22fed04c:3605:1877761495982208:0@lo:103: 00000100:00100000:2.0:1790773079.274649:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143caf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce0675b4-b0c5-48e7-b182-565e22fed04c:3605:1877761495981312:0@lo:103: 00000100:00100000:2.0:1790773079.274656:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce0675b4-b0c5-48e7-b182-565e22fed04c:3605:1877761495981824:0@lo:103: 00000100:00100000:2.0:1790773079.274676:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce0675b4-b0c5-48e7-b182-565e22fed04c:3605:1877761495982336:0@lo:103: 00000100:00100000:3.0:1790773079.275937:0:10294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9e7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10294:1877761495979904:192.168.202.19@tcp:104: 00000100:00100000:2.0:1790773079.275975:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773079.276025:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773079.276067:0:8410:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1790773079.276075:0:8410:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484395136 00000100:00100000:3.0:1790773079.276082:0:8410:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484395136 00010000:00010000:3.0:1790773079.276108:0:8410:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d26efc4400/0xabf1cc0bc784190b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6ba51 expref: 10 pid: 6472 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773079.276128:0:8410:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1790773079.276132:0:8410:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484395264 00000100:00100000:3.0:1790773079.276135:0:8410:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484395264 00010000:00010000:3.0:1790773079.276145:0:8410:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d27b12a400/0xabf1cc0bc7841904 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6ba4a expref: 11 pid: 6471 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773079.276156:0:8410:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1790773079.276163:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 33 00000100:00100000:3.0:1790773079.276171:0:8410:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3f7e9812-a56a-4fd4-8715-b93ef4652f29+11:2398:x1877761484395136:12345-192.168.202.19@tcp:103: 00010000:00010000:3.0:1790773079.276183:0:8410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773079.276188:0:8410:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d26efc4400/0xabf1cc0bc784190b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6ba51 expref: 11 pid: 6472 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773079.276199:0:8410:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d26efc4400/0xabf1cc0bc784190b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6ba51 expref: 11 pid: 6472 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773079.276249:0:8410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d26efc4400/0xabf1cc0bc784190b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6ba51 expref: 11 pid: 6472 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773079.276261:0:8410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790773079.276324:0:8410:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3f7e9812-a56a-4fd4-8715-b93ef4652f29+10:2398:x1877761484395136:12345-192.168.202.19@tcp:103: Request processed in 152us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773079.276345:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 33 00000100:00100000:3.0:1790773079.276604:0:8410:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1790773079.276613:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 34 00000100:00100000:3.0:1790773079.276621:0:8410:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143c7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3f7e9812-a56a-4fd4-8715-b93ef4652f29+9:2397:x1877761484395264:12345-192.168.202.19@tcp:103: 00010000:00010000:3.0:1790773079.276628:0:8410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773079.276633:0:8410:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d27b12a400/0xabf1cc0bc7841904 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6ba4a expref: 9 pid: 6471 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773079.276643:0:8410:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d27b12a400/0xabf1cc0bc7841904 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6ba4a expref: 9 pid: 6471 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773079.276652:0:8410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790773079.276684:0:8410:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143c7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3f7e9812-a56a-4fd4-8715-b93ef4652f29+9:2397:x1877761484395264:12345-192.168.202.19@tcp:103: Request processed in 64us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773079.276690:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 34 00010000:00010000:3.0:1790773079.276720:0:10294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d27b12a400/0xabf1cc0bc7841904 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6ba4a expref: 8 pid: 6471 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773079.276729:0:10294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9e6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10294:1877761495980032:192.168.202.19@tcp:104: 00010000:00010000:3.0:1790773079.276766:0:10294:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93d26efc4600/0xabf1cc0bc784194a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773079.278315:0:6464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d26efc4000/0xabf1cc0bc78418b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc78418a9 expref: 17 pid: 6471 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773079.278337:0:6464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d26efc4000/0xabf1cc0bc78418b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc78418a9 expref: 17 pid: 6471 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773079.278353:0:6464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93d26efc4600/0xabf1cc0bc784194a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773079.278361:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d26efc4600/0xabf1cc0bc784194a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773079.278381:0:6464:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d26efc4600/0xabf1cc0bc784194a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773079.278388:0:6464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d26efc4600/0xabf1cc0bc784194a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773079.278410:0:6464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93d26efc4600/0xabf1cc0bc784194a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773079.278418:0:6464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93d26efc4600/0xabf1cc0bc784194a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773079.278424:0:6464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc4600 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:0.0:1790773079.278428:0:6464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93d26efc4600/0xabf1cc0bc784194a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773079.278437:0:6464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93d26efc4600/0xabf1cc0bc784194a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773079.278455:0:6464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93d26efc4600/0xabf1cc0bc784194a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773079.278466:0:6464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790773079.278541:0:6464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143caf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:3606:x1877761495981568:12345-0@lo:103: Request processed in 8132us (8942us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773079.278550:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1790773079.278875:0:10294:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93d26efc4600/0xabf1cc0bc784194a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773079.278884:0:10294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93d26efc4600/0xabf1cc0bc784194a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773079.278901:0:10294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d26efc4600/0xabf1cc0bc784194a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773079.279607:0:6463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790773079.279651:0:6463:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ca850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:3606:x1877761495981440:12345-0@lo:103: Request processed in 9990us (10151us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773079.279660:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790773079.279728:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce0675b4-b0c5-48e7-b182-565e22fed04c:3606:1877761495981568:0@lo:103: 00000100:00100000:1.0:1790773079.279739:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce0675b4-b0c5-48e7-b182-565e22fed04c:3606:1877761495982080:0@lo:103: 00000100:00100000:1.0:1790773079.279745:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce0675b4-b0c5-48e7-b182-565e22fed04c:3606:1877761495981440:0@lo:103: 00000100:00100000:1.0:1790773079.279753:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143caea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce0675b4-b0c5-48e7-b182-565e22fed04c:3606:1877761495981952:0@lo:103: 00010000:00010000:1.0:1790773079.888595:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773080.044591:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773080.044756:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484395392 00000100:00100000:0.0:1790773080.044777:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484395392 00000100:00100000:0.0:1790773080.044835:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 199 00000100:00100000:0.0:1790773080.044845:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+8:6170:x1877761484395392:12345-192.168.202.19@tcp:101: 00010000:00010000:0.0:1790773080.044866:0:6471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773080.044890:0:6471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d26c4a3400/0xabf1cc0bc7841951 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bac1 expref: -99 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773080.044920:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d26c4a3400/0xabf1cc0bc7841951 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bac1 expref: 9 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773080.044947:0:6471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d26c4a3400/0xabf1cc0bc7841951 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bac1 expref: 9 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773080.044955:0:6471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26c4a3400, rc 0) 00000100:00100000:0.0:1790773080.045012:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+9:6170:x1877761484395392:12345-192.168.202.19@tcp:101: Request processed in 168us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773080.045018:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 199 00000100:00100000:2.0:1790773080.049298:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773080.051891:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484395520 00000100:00100000:3.0:1790773080.051906:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484395520 00000100:00100000:3.0:1790773080.051986:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 200 00000100:00100000:3.0:1790773080.051998:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+9:6170:x1877761484395520:12345-192.168.202.19@tcp:501: 00000100:00100000:3.0:1790773080.052282:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+9:6170:x1877761484395520:12345-192.168.202.19@tcp:501: Request processed in 285us (2991us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773080.052290:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 200 00000100:00100000:2.0:1790773080.071721:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773080.071828:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484395648 00000100:00100000:0.0:1790773080.071839:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484395648 00000100:00100000:0.0:1790773080.071896:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 201 00000100:00100000:0.0:1790773080.071907:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+9:6170:x1877761484395648:12345-192.168.202.19@tcp:503: 00000100:00100000:0.0:1790773080.072057:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+9:6170:x1877761484395648:12345-192.168.202.19@tcp:503: Request processed in 152us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773080.072065:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 201 00000100:00100000:2.0:1790773080.082269:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773080.083688:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484395776 00000100:00100000:0.0:1790773080.083701:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484395776 00000100:00100000:0.0:1790773080.083783:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 202 00000100:00100000:0.0:1790773080.083794:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+9:6644:x1877761484395776:12345-192.168.202.19@tcp:502: 00000100:00100000:0.0:1790773080.084625:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+9:6644:x1877761484395776:12345-192.168.202.19@tcp:502: Request processed in 827us (2360us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773080.084636:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 202 00000100:00100000:2.0:1790773080.091892:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773080.091970:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484395904 00000100:00100000:3.0:1790773080.091980:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484395904 00000100:00100000:3.0:1790773080.092034:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 203 00000100:00100000:3.0:1790773080.092043:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+9:6644:x1877761484395904:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790773080.092200:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+9:6644:x1877761484395904:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 158us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773080.092245:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 203 00000100:00100000:1.0:1790773080.095958:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773080.096267:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484396032 00000100:00100000:0.0:1790773080.096290:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484396032 00000100:00100000:0.0:1790773080.096445:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 204 00000100:00100000:0.0:1790773080.096457:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+9:6170:x1877761484396032:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790773080.096497:0:6473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773080.096518:0:6473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d26c4a3800/0xabf1cc0bc7841958 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bac8 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773080.096548:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d26c4a3800/0xabf1cc0bc7841958 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bac8 expref: 10 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773080.096560:0:6473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d26c4a3800/0xabf1cc0bc7841958 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bac8 expref: 10 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773080.096569:0:6473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26c4a3800, rc 0) 00000100:00100000:0.0:1790773080.096629:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+10:6170:x1877761484396032:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 Request processed in 173us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773080.106817:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 204 00000100:00100000:2.0:1790773080.111920:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773080.112015:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484396160 00000100:00100000:0.0:1790773080.112027:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484396160 00000100:00100000:0.0:1790773080.112087:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 205 00000100:00100000:0.0:1790773080.112098:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+10:6170:x1877761484396160:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790773080.112234:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+10:6170:x1877761484396160:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 Request processed in 138us (326us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790773080.112243:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 205 00000100:00100000:0.0:1790773080.397647:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143c7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761495982464:0@lo:13: 00000100:00100000:0.0:1790773080.397718:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773080.397788:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495982464 00000100:00100000:0.0:1790773080.397796:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495982464 00000100:00100000:0.0:1790773080.397847:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790773080.397858:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f976d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761495982464:12345-0@lo:13: 00002000:00000024:0.0:1790773080.397903:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790773080.397949:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f976d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761495982464:12345-0@lo:13: Request processed in 94us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773080.397956:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1790773080.397994:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143c7ea00 x1877761495982464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773096 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773080.398012:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143c7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761495982464:0@lo:13: 00000100:00080000:3.0:1790773080.398269:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790773080.398314:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790773080.398324:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761495982592:0@lo:41: 00000100:00100000:2.0:1790773080.398370:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773080.398510:0:7666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495982592 00000100:00100000:3.0:1790773080.398516:0:7666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495982592 00000100:00100000:3.0:1790773080.398553:0:7666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790773080.398561:0:7666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143c7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761495982592:12345-0@lo:41: 00000004:00000024:3.0:1790773080.398584:0:7666:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1790773080.398783:0:7666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143c7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761495982592:12345-0@lo:41: Request processed in 222us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773080.398800:0:7666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790773080.398869:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761495982592:0@lo:41: 00000100:00100000:1.0:1790773080.399009:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761495982720:0@lo:13: 00000100:00100000:1.0:1790773080.399041:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773080.399074:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495982720 00000100:00100000:1.0:1790773080.399078:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495982720 00000100:00100000:1.0:1790773080.399108:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790773080.399114:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761495982720:12345-0@lo:13: 00002000:00000024:1.0:1790773080.399126:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790773080.399156:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761495982720:12345-0@lo:13: Request processed in 43us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773080.399169:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1790773080.399198:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f9e4380 x1877761495982720/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773096 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773080.399230:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761495982720:0@lo:13: 00000100:00100000:2.0:1790773080.399380:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143c7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3606:1877761495982976:0@lo:400: 00000100:00100000:2.0:1790773080.399408:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773080.399425:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143c7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3606:1877761495983488:0@lo:400: 00000100:00100000:2.0:1790773080.399445:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773080.399460:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143c7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3606:1877761495984000:0@lo:400: 00000100:00100000:2.0:1790773080.399674:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773080.399695:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1790773080.399701:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143c7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761495983104:0@lo:400: 00000100:00100000:2.0:1790773080.399724:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773080.399739:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143c7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761495983616:0@lo:400: 00000100:00100000:2.0:1790773080.399759:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773080.399796:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495982976 00000100:00100000:2.0:1790773080.399806:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495982976 00000100:00100000:2.0:1790773080.399831:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495983488 00000100:00100000:2.0:1790773080.399834:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495983488 00000100:00100000:2.0:1790773080.399848:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495984000 00000100:00100000:2.0:1790773080.399850:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495984000 00000100:00100000:2.0:1790773080.399862:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790773080.399869:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143c7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1877761495982976:12345-0@lo:400: 00000100:00100000:2.0:1790773080.399907:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143c7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1877761495982976:12345-0@lo:400: Request processed in 39us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773080.399914:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790773080.399928:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790773080.399935:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143c7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1877761495983488:12345-0@lo:400: 00000100:00100000:2.0:1790773080.399962:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143c7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1877761495983488:12345-0@lo:400: Request processed in 29us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773080.399968:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790773080.399979:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790773080.399985:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143caea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3606:x1877761495984000:12345-0@lo:400: 00000100:00100000:2.0:1790773080.400011:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143caea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3606:x1877761495984000:12345-0@lo:400: Request processed in 27us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773080.400017:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790773080.400049:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143c7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3606:1877761495982976:0@lo:400: 00010000:00080000:2.0:1790773080.400062:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143c7f800 x1877761495983488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773096 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773080.400072:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143c7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3606:1877761495983488:0@lo:400: 00010000:00080000:2.0:1790773080.400081:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143c7ea00 x1877761495984000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773096 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773080.400100:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143c7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3606:1877761495984000:0@lo:400: 00000100:00080000:3.0:1790773080.400193:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790773080.400197:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790773080.400276:0:8392:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495983616 00000100:00100000:1.0:1790773080.400281:0:8392:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495983616 00000100:00100000:1.0:1790773080.400370:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790773080.400377:0:8392:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761495983616:12345-0@lo:400: 00000100:00100000:1.0:1790773080.400416:0:8392:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761495983616:12345-0@lo:400: Request processed in 40us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773080.400422:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790773080.400440:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143c7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce0675b4-b0c5-48e7-b182-565e22fed04c:3605:1877761495982848:0@lo:400: 00000100:00100000:1.0:1790773080.400469:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773080.400506:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143c7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3605:1877761495983360:0@lo:400: 00000100:00100000:1.0:1790773080.400527:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773080.400543:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143c7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3605:1877761495983872:0@lo:400: 00000100:00100000:1.0:1790773080.400562:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773080.400580:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1790773080.400586:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143c7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3605:1877761495983232:0@lo:400: 00000100:00100000:1.0:1790773080.400854:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773080.400872:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143c7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761495983744:0@lo:400: 00000100:00100000:1.0:1790773080.400893:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773080.400921:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495983360 00000100:00100000:1.0:1790773080.400925:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495983360 00000100:00100000:2.0:1790773080.400974:0:8393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495983744 00000100:00100000:2.0:1790773080.400979:0:8393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495983744 00000100:00100000:0.0:1790773080.401062:0:6483:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495983104 00000100:00100000:0.0:1790773080.401066:0:6483:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495983104 00000100:00100000:0.0:1790773080.401096:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790773080.401102:0:6483:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761495983104:12345-0@lo:400: 00000100:00100000:0.0:1790773080.401137:0:6483:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761495983104:12345-0@lo:400: Request processed in 36us (1412us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773080.401143:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790773080.401161:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495983872 00000100:00100000:0.0:1790773080.401164:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495983872 00000100:00080000:3.0:1790773080.401896:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790773080.401903:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790773080.401945:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495983232 00000100:00100000:3.0:1790773080.401950:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495983232 00000100:00100000:3.0:1790773080.401977:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790773080.401983:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3605:x1877761495983232:12345-0@lo:400: 00000100:00100000:3.0:1790773080.402028:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3605:x1877761495983232:12345-0@lo:400: Request processed in 45us (1174us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773080.402034:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790773080.402076:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143c7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761495983104:0@lo:400: 00010000:00080000:3.0:1790773080.402089:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143c7ed80 x1877761495983616/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773096 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773080.402099:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143c7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761495983616:0@lo:400: 00000100:00100000:3.0:1790773080.402115:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790773080.402122:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f976680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761495984128:0@lo:41: 00000100:00100000:3.0:1790773080.402146:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773080.402171:0:7666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495984128 00000100:00100000:3.0:1790773080.402174:0:7666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495984128 00000100:00100000:3.0:1790773080.402198:0:7666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790773080.402224:0:7666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761495984128:12345-0@lo:41: 00000004:00000024:3.0:1790773080.402253:0:7666:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1790773080.402287:0:7666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761495984128:12345-0@lo:41: Request processed in 83us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773080.402308:0:7666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790773080.402339:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f976680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761495984128:0@lo:41: 00000100:00100000:3.0:1790773080.408253:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495982848 00000100:00100000:3.0:1790773080.408269:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495982848 00000100:00100000:3.0:1790773080.408336:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1790773080.408348:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:3605:x1877761495982848:12345-0@lo:400: 00000100:00100000:3.0:1790773080.408577:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:3605:x1877761495982848:12345-0@lo:400: Request processed in 231us (8106us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773080.408585:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1790773080.408739:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143c7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3605:1877761495983232:0@lo:400: 00000100:00100000:3.0:1790773080.408753:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143c7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce0675b4-b0c5-48e7-b182-565e22fed04c:3605:1877761495982848:0@lo:400: 00000100:00100000:1.0:1790773080.409031:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1790773080.409055:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3605:x1877761495983360:12345-0@lo:400: 00000100:00100000:1.0:1790773080.409097:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3605:x1877761495983360:12345-0@lo:400: Request processed in 45us (8569us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773080.409103:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1790773080.409130:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143c7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3605:1877761495983360:0@lo:400: 00000100:00100000:2.0:1790773080.413847:0:8393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790773080.413863:0:8393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761495983744:12345-0@lo:400: 00000100:00100000:2.0:1790773080.413962:0:8393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761495983744:12345-0@lo:400: Request processed in 103us (13066us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773080.413969:0:8393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1790773080.415856:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143c7fb80 x1877761495983744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773096 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773080.415873:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143c7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761495983744:0@lo:400: 00000100:00100000:0.0:1790773080.417048:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790773080.417059:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3605:x1877761495983872:12345-0@lo:400: 00000100:00100000:0.0:1790773080.417134:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3605:x1877761495983872:12345-0@lo:400: Request processed in 77us (16570us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773080.417141:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790773080.417402:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143c7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3605:1877761495983872:0@lo:400: 10000000:01000000:2.0:1790773080.527883:0:6475:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1790773080.527891:0:6475:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93d141fee800 from 48 10000000:01000000:2.0:1790773080.527897:0:6475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790773080.527946:0:6475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26efc4400/0xabf1cc0bc784195f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773080.527959:0:6475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d26efc4400/0xabf1cc0bc784195f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773080.527972:0:6475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d26efc4400/0xabf1cc0bc784195f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773080.527995:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495984256:0@lo:101: 00000100:00100000:2.0:1790773080.528065:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773080.528114:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2512d8540 going to sleep for 11 seconds 00000100:00100000:3.0:1790773080.530906:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495984256 00000100:00100000:3.0:1790773080.530921:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495984256 00000100:00100000:3.0:1790773080.530995:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1790773080.531006:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+15:6475:x1877761495984256:12345-0@lo:101: 00010000:00010000:3.0:1790773080.531026:0:6472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773080.531046:0:6472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d279de2400/0xabf1cc0bc7841966 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc784195f expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773080.531075:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d279de2400/0xabf1cc0bc7841966 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc784195f expref: 16 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773080.531087:0:6472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d279de2400/0xabf1cc0bc7841966 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc784195f expref: 16 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773080.531097:0:6472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d279de2400, rc 0) 00000100:00100000:3.0:1790773080.531200:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:6475:x1877761495984256:12345-0@lo:101: Request processed in 195us (3134us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773080.531257:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1790773080.532123:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495984256:0@lo:101: 00010000:00010000:2.0:1790773080.532145:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d26efc4400/0xabf1cc0bc784195f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841966 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773080.532181:0:6475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d26efc4400/0xabf1cc0bc784195f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7841966 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773080.532276:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495984384:0@lo:501: 00000100:00100000:2.0:1790773080.532318:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773080.532358:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2512d8540 going to sleep for 11 seconds 00000100:00100000:3.0:1790773080.532702:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495984384 00000100:00100000:3.0:1790773080.532709:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495984384 00000100:00100000:3.0:1790773080.532792:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1790773080.532800:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:6475:x1877761495984384:12345-0@lo:501: 00000100:00100000:3.0:1790773080.532936:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:6475:x1877761495984384:12345-0@lo:501: Request processed in 137us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773080.532953:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1790773080.535001:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495984384:0@lo:501: 00000100:00100000:0.0:1790773080.535059:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f976300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495984512:0@lo:503: 00000100:00100000:0.0:1790773080.535131:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773080.535181:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c1446c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790773080.535511:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495984512 00000100:00100000:3.0:1790773080.535518:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495984512 00000100:00100000:3.0:1790773080.535566:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1790773080.535575:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:6475:x1877761495984512:12345-0@lo:503: 00000100:00100000:3.0:1790773080.535692:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:6475:x1877761495984512:12345-0@lo:503: Request processed in 118us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773080.535700:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1790773080.535843:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f976300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495984512:0@lo:503: 00000100:00100000:2.0:1790773080.536240:0:10312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:10312:1877761495984640:0@lo:502: 00000100:00100000:2.0:1790773080.536295:0:10312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773080.536325:0:10312:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2512d80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790773080.536836:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495984640 00000100:00100000:3.0:1790773080.536844:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495984640 00000100:00100000:3.0:1790773080.536886:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1790773080.536895:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:10312:x1877761495984640:12345-0@lo:502: 00000100:00100000:3.0:1790773080.537011:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:10312:x1877761495984640:12345-0@lo:502: Request processed in 117us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773080.537018:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1790773080.537147:0:10312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:10312:1877761495984640:0@lo:502: 00000100:00100000:2.0:1790773080.537191:0:10312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:10312:1877761495984768:0@lo:502: 00000100:00100000:2.0:1790773080.537247:0:10312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773080.537285:0:10312:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2512d80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790773080.537335:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495984768 00000100:00100000:0.0:1790773080.537357:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495984768 00000100:00100000:0.0:1790773080.537392:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1790773080.537398:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:10312:x1877761495984768:12345-0@lo:502: 00000100:00100000:0.0:1790773080.537475:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:10312:x1877761495984768:12345-0@lo:502: Request processed in 77us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773080.537482:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1790773080.537697:0:10312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:10312:1877761495984768:0@lo:502: 00000040:00080000:2.0:1790773080.537716:0:10312:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1790773080.537892:0:6475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1790773080.537914:0:6475:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790773080.537923:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26efc4400/0xabf1cc0bc784195f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841966 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773080.537935:0:6475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d26efc4400/0xabf1cc0bc784195f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841966 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790773080.537945:0:6475:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1790773080.537948:0:6475:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1790773080.537951:0:6475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1790773080.537977:0:6475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3000/0xabf1cc0bc784196d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773080.537986:0:6475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3000/0xabf1cc0bc784196d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773080.537995:0:6475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3000/0xabf1cc0bc784196d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773080.538007:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f976300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495984896:0@lo:101: 00000100:00100000:0.0:1790773080.538036:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773080.538061:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c144e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790773080.538113:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495984896 00000100:00100000:3.0:1790773080.538118:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495984896 00000100:00100000:3.0:1790773080.538152:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1790773080.538159:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+16:6475:x1877761495984896:12345-0@lo:101: 00010000:00010000:3.0:1790773080.538176:0:6473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773080.538187:0:6473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d279de2600/0xabf1cc0bc7841974 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc784196d expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773080.538238:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d279de2600/0xabf1cc0bc7841974 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc784196d expref: 17 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773080.538250:0:6473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d279de2600/0xabf1cc0bc7841974 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc784196d expref: 17 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773080.538258:0:6473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d279de2600, rc 0) 00000100:00100000:3.0:1790773080.538302:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:6475:x1877761495984896:12345-0@lo:101: Request processed in 143us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773080.538308:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1790773080.538503:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f976300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495984896:0@lo:101: 00010000:00010000:2.0:1790773080.538517:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3000/0xabf1cc0bc784196d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841974 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773080.538525:0:6475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3000/0xabf1cc0bc784196d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7841974 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773080.538571:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495985024:0@lo:501: 00000100:00100000:2.0:1790773080.538602:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773080.538629:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2512d80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790773080.538731:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495985024 00000100:00100000:3.0:1790773080.538735:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495985024 00000100:00100000:3.0:1790773080.538777:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1790773080.538784:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:6475:x1877761495985024:12345-0@lo:501: 00000100:00100000:3.0:1790773080.538896:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:6475:x1877761495985024:12345-0@lo:501: Request processed in 112us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773080.538903:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1790773080.539001:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495985024:0@lo:501: 00000100:00100000:2.0:1790773080.539026:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495985152:0@lo:503: 00000100:00100000:2.0:1790773080.539062:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773080.539084:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2512d80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790773080.539284:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495985152 00000100:00100000:0.0:1790773080.539295:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495985152 00000100:00100000:0.0:1790773080.539327:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1790773080.539333:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c696050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:6475:x1877761495985152:12345-0@lo:503: 00000100:00100000:0.0:1790773080.539639:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c696050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:6475:x1877761495985152:12345-0@lo:503: Request processed in 305us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773080.539646:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1790773080.539719:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495985152:0@lo:503: 00000100:00100000:3.0:1790773080.546757:0:10313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:10313:1877761495985280:0@lo:502: 00000100:00100000:3.0:1790773080.546871:0:10313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773080.546967:0:10313:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26bebf3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790773080.552331:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495985280 00000100:00100000:1.0:1790773080.552363:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495985280 00000100:00100000:1.0:1790773080.552435:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1790773080.552446:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c696850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:10313:x1877761495985280:12345-0@lo:502: 00000100:00100000:1.0:1790773080.552622:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c696850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:10313:x1877761495985280:12345-0@lo:502: Request processed in 179us (5751us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773080.552630:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1790773080.552900:0:10313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:10313:1877761495985280:0@lo:502: 00000020:01000000:3.0:1790773080.552937:0:10313:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790773080.552947:0:10313:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773080.552956:0:10313:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1790773080.552964:0:10313:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1790773080.552997:0:10313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:10313:1877761495985408:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790773080.553038:0:10313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773080.553080:0:10313:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26bebf3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790773080.553134:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495985408 00000100:00100000:0.0:1790773080.553139:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495985408 00000100:00100000:0.0:1790773080.553172:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1790773080.553180:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c694c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:10313:x1877761495985408:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790773080.553281:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c694c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:10313:x1877761495985408:12345-0@lo:502:llog_process_th.0 Request processed in 102us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773080.553287:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1790773080.553804:0:10313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:10313:1877761495985408:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790773080.553825:0:10313:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790773080.553831:0:10313:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773080.553833:0:10313:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1790773080.553838:0:10313:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:0.0:1790773080.554012:0:6475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1790773080.554035:0:6475:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1790773080.554045:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3000/0xabf1cc0bc784196d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841974 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773080.554056:0:6475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3000/0xabf1cc0bc784196d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841974 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790773080.554065:0:6475:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1790773080.554068:0:6475:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93d26ff80800 from 48 10000000:01000000:0.0:1790773080.554071:0:6475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790773080.554097:0:6475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3600/0xabf1cc0bc784197b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773080.554105:0:6475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3600/0xabf1cc0bc784197b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773080.554125:0:6475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3600/0xabf1cc0bc784197b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773080.554142:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f976680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495985536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790773080.554177:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773080.554244:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26bec66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790773080.554370:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495985536 00000100:00100000:3.0:1790773080.554377:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495985536 00000100:00100000:3.0:1790773080.554416:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1790773080.554425:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c695450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+17:6475:x1877761495985536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790773080.554437:0:6471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773080.554449:0:6471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d279de3e00/0xabf1cc0bc7841982 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc784197b expref: -99 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773080.554469:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d279de3e00/0xabf1cc0bc7841982 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc784197b expref: 18 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773080.554480:0:6471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d279de3e00/0xabf1cc0bc7841982 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc784197b expref: 18 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773080.554487:0:6471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d279de3e00, rc 0) 00000100:00100000:3.0:1790773080.554523:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c695450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:6475:x1877761495985536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773080.554529:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1790773080.554811:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f976680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495985536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790773080.554826:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3600/0xabf1cc0bc784197b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841982 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773080.554835:0:6475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3600/0xabf1cc0bc784197b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7841982 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773080.554893:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495985664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790773080.554939:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773080.554975:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ef8c000 going to sleep for 11 seconds 00000100:00100000:3.0:1790773080.555022:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495985664 00000100:00100000:3.0:1790773080.555031:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495985664 00000100:00100000:3.0:1790773080.555099:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1790773080.555107:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c697850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:6475:x1877761495985664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790773080.555244:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c697850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:6475:x1877761495985664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 138us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773080.555251:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1790773080.555319:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495985664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790773080.555345:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495985792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790773080.555394:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773080.561515:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ef8c000 going to sleep for 11 seconds 00000100:00100000:0.0:1790773080.562841:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495985792 00000100:00100000:0.0:1790773080.562856:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495985792 00000100:00100000:3.0:1790773080.562908:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1790773080.562982:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c696c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:6475:x1877761495985792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790773080.563805:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c696c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:6475:x1877761495985792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 884us (8407us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773080.563881:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495985792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790773080.573708:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1790773080.574719:0:10314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:10314:1877761495985920:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790773080.574821:0:10314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773080.574876:0:10314:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26bebfcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790773080.575163:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495985920 00000100:00100000:2.0:1790773080.575172:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495985920 00000100:00100000:2.0:1790773080.575239:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1790773080.575250:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c694850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:10314:x1877761495985920:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790773080.575624:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c694850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:10314:x1877761495985920:12345-0@lo:502:llog_process_th.0 Request processed in 376us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773080.575637:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1790773080.575959:0:10314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:10314:1877761495985920:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790773080.576013:0:10314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:10314:1877761495986048:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790773080.576052:0:10314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773080.576086:0:10314:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ef8c180 going to sleep for 11 seconds 00000100:00100000:2.0:1790773080.576140:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495986048 00000100:00100000:2.0:1790773080.576146:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495986048 00000100:00100000:2.0:1790773080.576181:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1790773080.576188:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c694050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:10314:x1877761495986048:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790773080.576476:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c694050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:10314:x1877761495986048:12345-0@lo:502:llog_process_th.0 Request processed in 287us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773080.576483:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1790773080.591445:0:10314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:10314:1877761495986048:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1790773080.591501:0:10314:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1790773080.591749:0:6475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1790773080.591787:0:6475:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790773080.591799:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3600/0xabf1cc0bc784197b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841982 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773080.591823:0:6475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3600/0xabf1cc0bc784197b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841982 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790773080.591834:0:6475:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1790773080.591837:0:6475:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1790773080.591840:0:6475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1790773080.591876:0:6475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26efc4000/0xabf1cc0bc7841989 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773080.591884:0:6475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d26efc4000/0xabf1cc0bc7841989 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773080.591894:0:6475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d26efc4000/0xabf1cc0bc7841989 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773080.591916:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495986176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790773080.591979:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773080.592014:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2512d8540 going to sleep for 11 seconds 00000100:00100000:0.0:1790773080.592082:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495986176 00000100:00100000:0.0:1790773080.592089:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495986176 00000100:00100000:0.0:1790773080.592152:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1790773080.592162:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c696450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+18:6475:x1877761495986176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790773080.592175:0:6472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773080.592188:0:6472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d26c4a3200/0xabf1cc0bc7841990 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7841989 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773080.592246:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d26c4a3200/0xabf1cc0bc7841990 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7841989 expref: 19 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773080.592257:0:6472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d26c4a3200/0xabf1cc0bc7841990 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7841989 expref: 19 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773080.592266:0:6472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26c4a3200, rc 0) 00000100:00100000:0.0:1790773080.592560:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c696450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+19:6475:x1877761495986176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 400us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773080.592568:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1790773080.592641:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495986176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790773080.592656:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d26efc4000/0xabf1cc0bc7841989 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841990 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773080.592666:0:6475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d26efc4000/0xabf1cc0bc7841989 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7841990 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773080.592721:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495986304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790773080.592746:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773080.592791:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2512d8540 going to sleep for 11 seconds 00000100:00100000:0.0:1790773080.593195:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495986304 00000100:00100000:0.0:1790773080.593201:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495986304 00000100:00100000:2.0:1790773080.593400:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1790773080.593410:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c695c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+19:6475:x1877761495986304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790773080.593540:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c695c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+19:6475:x1877761495986304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 131us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773080.593547:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1790773080.593710:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495986304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790773080.593749:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9e5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495986432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790773080.593802:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773080.593822:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ef8c180 going to sleep for 11 seconds 00000100:00100000:2.0:1790773080.593870:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495986432 00000100:00100000:2.0:1790773080.593875:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495986432 00000100:00100000:2.0:1790773080.593895:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1790773080.593900:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c695050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+19:6475:x1877761495986432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790773080.593986:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c695050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+19:6475:x1877761495986432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773080.593993:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1790773080.594062:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9e5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495986432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790773080.594544:0:10315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:10315:1877761495986560:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790773080.594579:0:10315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773080.594607:0:10315:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ef8c240 going to sleep for 11 seconds 00000100:00100000:0.0:1790773080.594652:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495986560 00000100:00100000:0.0:1790773080.594657:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495986560 00000100:00100000:0.0:1790773080.594679:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1790773080.594686:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c697c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+19:10315:x1877761495986560:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790773080.594783:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c697c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+19:10315:x1877761495986560:12345-0@lo:502:llog_process_th.0 Request processed in 98us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773080.594790:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1790773080.594864:0:10315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:10315:1877761495986560:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790773080.594886:0:10315:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790773080.594896:0:10315:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790773080.594898:0:10315:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1790773080.594909:0:10315:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1790773080.594928:0:10315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:10315:1877761495986688:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790773080.594955:0:10315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773080.594976:0:10315:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ef8c240 going to sleep for 11 seconds 00000100:00100000:2.0:1790773080.595022:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495986688 00000100:00100000:2.0:1790773080.595026:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495986688 00000100:00100000:2.0:1790773080.595041:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1790773080.595047:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c697050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+19:10315:x1877761495986688:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790773080.595123:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c697050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+19:10315:x1877761495986688:12345-0@lo:502:llog_process_th.0 Request processed in 75us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773080.595130:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1790773080.595294:0:10315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:10315:1877761495986688:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790773080.595313:0:10315:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790773080.595317:0:10315:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790773080.595319:0:10315:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1790773080.595322:0:10315:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:2.0:1790773080.596650:0:6475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1790773080.596684:0:6475:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1790773080.596695:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26efc4000/0xabf1cc0bc7841989 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841990 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773080.596708:0:6475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d26efc4000/0xabf1cc0bc7841989 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841990 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790773080.596735:0:6475:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1790773080.596738:0:6475:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93d26ed89000 from 48 10000000:01000000:2.0:1790773080.596741:0:6475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790773080.596781:0:6475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26efc5a00/0xabf1cc0bc7841997 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773080.596790:0:6475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d26efc5a00/0xabf1cc0bc7841997 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773080.596802:0:6475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d26efc5a00/0xabf1cc0bc7841997 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773080.596822:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143caf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495986816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790773080.596873:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773080.596911:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d143012900 going to sleep for 11 seconds 00000100:00100000:2.0:1790773080.596930:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495986816 00000100:00100000:2.0:1790773080.596936:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495986816 00000100:00100000:2.0:1790773080.596969:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1790773080.596977:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c697450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+19:6475:x1877761495986816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790773080.596988:0:6472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773080.596998:0:6472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d26efc5e00/0xabf1cc0bc784199e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7841997 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773080.597019:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d26efc5e00/0xabf1cc0bc784199e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7841997 expref: 20 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773080.597029:0:6472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d26efc5e00/0xabf1cc0bc784199e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7841997 expref: 20 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773080.597050:0:6472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26efc5e00, rc 0) 00000100:00100000:2.0:1790773080.597086:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c697450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+20:6475:x1877761495986816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773080.597092:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1790773080.597132:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143caf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495986816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790773080.597144:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d26efc5a00/0xabf1cc0bc7841997 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc784199e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773080.597153:0:6475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d26efc5a00/0xabf1cc0bc7841997 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc784199e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773080.597222:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143caf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495986944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790773080.597249:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773080.597261:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d143012900 going to sleep for 11 seconds 00000100:00100000:2.0:1790773080.597272:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495986944 00000100:00100000:2.0:1790773080.598713:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495986944 00000100:00100000:2.0:1790773080.598778:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1790773080.598787:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c695850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+20:6475:x1877761495986944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790773080.598950:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c695850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+20:6475:x1877761495986944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 164us (1700us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773080.598958:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1790773080.599139:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143caf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495986944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790773080.599182:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f977800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495987072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790773080.599259:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773080.599302:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d14312c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790773080.601492:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495987072 00000100:00100000:2.0:1790773080.601506:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495987072 00000100:00100000:2.0:1790773080.601577:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1790773080.601587:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c694450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+20:6475:x1877761495987072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790773080.601761:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c694450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+20:6475:x1877761495987072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 175us (2501us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773080.601785:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1790773080.602076:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f977800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495987072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790773080.602962:0:10316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:10316:1877761495987200:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790773080.603027:0:10316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773080.603067:0:10316:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ef8c480 going to sleep for 11 seconds 00000100:00100000:0.0:1790773080.603132:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495987200 00000100:00100000:0.0:1790773080.603140:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495987200 00000100:00100000:0.0:1790773080.603185:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1790773080.603195:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+20:10316:x1877761495987200:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790773080.603496:0:10316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:10316:1877761495987200:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790773080.603539:0:10316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:10316:1877761495987328:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790773080.603573:0:10316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773080.603593:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495987328 00000100:00100000:1.0:1790773080.603597:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495987328 00000100:00100000:1.0:1790773080.603615:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1790773080.603621:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:10316:x1877761495987328:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790773080.603688:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:10316:x1877761495987328:12345-0@lo:502:llog_process_th.0 Request processed in 67us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773080.603696:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1790773080.603735:0:10316:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ef8c480 going to sleep for 11 seconds 00000100:00100000:1.0:1790773080.603747:0:10316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:10316:1877761495987328:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1790773080.603781:0:10316:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000100:00100000:0.0:1790773080.603915:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+20:10316:x1877761495987200:12345-0@lo:502:llog_process_th.0 Request processed in 149us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773080.603924:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000020:01000000:3.0:1790773080.604009:0:6475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1790773080.604033:0:6475:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790773080.604043:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26efc5a00/0xabf1cc0bc7841997 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc784199e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773080.604053:0:6475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d26efc5a00/0xabf1cc0bc7841997 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc784199e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773080.604063:0:6475:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1790773080.604066:0:6475:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:3.0:1790773080.604069:0:6475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1790773080.604094:0:6475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d279de2a00/0xabf1cc0bc78419a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773080.604113:0:6475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d279de2a00/0xabf1cc0bc78419a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773080.604123:0:6475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d279de2a00/0xabf1cc0bc78419a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773080.604138:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495987456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790773080.604168:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773080.604192:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26bebf540 going to sleep for 11 seconds 00000100:00100000:1.0:1790773080.604613:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495987456 00000100:00100000:1.0:1790773080.604618:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495987456 00000100:00100000:1.0:1790773080.604645:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1790773080.604652:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+20:6475:x1877761495987456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790773080.604663:0:6473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773080.604674:0:6473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d27b12a000/0xabf1cc0bc78419ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc78419a5 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773080.604703:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d27b12a000/0xabf1cc0bc78419ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc78419a5 expref: 21 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773080.604713:0:6473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d27b12a000/0xabf1cc0bc78419ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78419a5 expref: 21 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773080.604722:0:6473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12a000, rc 0) 00000100:00100000:1.0:1790773080.604773:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:6475:x1877761495987456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773080.604780:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1790773080.605563:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495987456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790773080.605583:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d279de2a00/0xabf1cc0bc78419a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78419ac expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773080.605594:0:6475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d279de2a00/0xabf1cc0bc78419a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc78419ac expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773080.605661:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495987584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790773080.605699:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773080.605738:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26bebf540 going to sleep for 11 seconds 00000100:00100000:1.0:1790773080.606416:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495987584 00000100:00100000:1.0:1790773080.606425:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495987584 00000100:00100000:1.0:1790773080.606464:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1790773080.606472:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:6475:x1877761495987584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790773080.606606:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:6475:x1877761495987584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 134us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773080.606613:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1790773080.606808:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495987584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790773080.606842:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495987712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790773080.606886:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773080.606915:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26bebf540 going to sleep for 11 seconds 00000100:00100000:0.0:1790773080.606973:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495987712 00000100:00100000:0.0:1790773080.606978:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495987712 00000100:00100000:0.0:1790773080.607010:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1790773080.607017:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:6475:x1877761495987712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790773080.607096:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:6475:x1877761495987712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773080.607102:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1790773080.607226:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495987712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790773080.607783:0:10317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:10317:1877761495987840:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790773080.607830:0:10317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773080.607859:0:10317:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26bebf000 going to sleep for 11 seconds 00000100:00100000:0.0:1790773080.607934:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495987840 00000100:00100000:0.0:1790773080.607944:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495987840 00000100:00100000:0.0:1790773080.607979:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1790773080.607987:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:10317:x1877761495987840:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790773080.608078:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:10317:x1877761495987840:12345-0@lo:502:llog_process_th.0 Request processed in 91us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773080.608085:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1790773080.608155:0:10317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:10317:1877761495987840:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790773080.608178:0:10317:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790773080.608187:0:10317:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773080.608190:0:10317:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1790773080.608197:0:10317:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1790773080.608250:0:10317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:10317:1877761495987968:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790773080.608293:0:10317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773080.608305:0:10317:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26bebf000 going to sleep for 11 seconds 00000100:00100000:1.0:1790773080.608475:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495987968 00000100:00100000:1.0:1790773080.608480:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495987968 00000100:00100000:1.0:1790773080.608506:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1790773080.608512:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:10317:x1877761495987968:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790773080.608574:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:10317:x1877761495987968:12345-0@lo:502:llog_process_th.0 Request processed in 62us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773080.608581:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1790773080.609526:0:10317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:10317:1877761495987968:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790773080.609555:0:10317:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790773080.609563:0:10317:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773080.609565:0:10317:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1790773080.609571:0:10317:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:0.0:1790773080.609939:0:6475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:0.0:1790773080.609961:0:6475:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1790773080.609972:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d279de2a00/0xabf1cc0bc78419a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78419ac expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773080.609984:0:6475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d279de2a00/0xabf1cc0bc78419a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78419ac expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790773080.609994:0:6475:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1790773080.609997:0:6475:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93d25268e800 from 48 10000000:01000000:0.0:1790773080.610000:0:6475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790773080.610029:0:6475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc78419b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773080.610038:0:6475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc78419b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773080.610047:0:6475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc78419b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773080.610064:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f974e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495988096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790773080.610111:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773080.610145:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d14312cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1790773080.619823:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495988096 00000100:00100000:1.0:1790773080.619841:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495988096 00000100:00100000:1.0:1790773080.619896:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1790773080.619906:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:6475:x1877761495988096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790773080.619923:0:6471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773080.619941:0:6471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d27b12b000/0xabf1cc0bc78419ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc78419b3 expref: -99 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773080.619970:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d27b12b000/0xabf1cc0bc78419ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc78419b3 expref: 22 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773080.619981:0:6471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d27b12b000/0xabf1cc0bc78419ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78419b3 expref: 22 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773080.619990:0:6471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12b000, rc 0) 00000100:00100000:1.0:1790773080.620202:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+22:6475:x1877761495988096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 297us (10090us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773080.620653:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1790773080.623574:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f974e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495988096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790773080.623607:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc78419b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78419ba expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773080.623620:0:6475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc78419b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc78419ba expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773080.623711:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495988224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790773080.623782:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773080.623829:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26bebf000 going to sleep for 11 seconds 00000100:00100000:2.0:1790773080.623917:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495988224 00000100:00100000:2.0:1790773080.623925:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495988224 00000100:00100000:2.0:1790773080.623966:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1790773080.623975:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+22:6475:x1877761495988224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790773080.624125:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+22:6475:x1877761495988224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 151us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773080.624134:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1790773080.626610:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495988224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790773080.626688:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495988352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790773080.626759:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773080.626806:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26bebf000 going to sleep for 11 seconds 00000100:00100000:0.0:1790773080.626872:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495988352 00000100:00100000:0.0:1790773080.626879:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495988352 00000100:00100000:0.0:1790773080.626930:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1790773080.626939:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+22:6475:x1877761495988352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790773080.627043:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+22:6475:x1877761495988352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 105us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773080.627050:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1790773080.627605:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495988352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790773080.628043:0:10318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:10318:1877761495988480:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790773080.628087:0:10318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773080.628118:0:10318:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26bebf780 going to sleep for 11 seconds 00000100:00100000:0.0:1790773080.628161:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495988480 00000100:00100000:0.0:1790773080.628167:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495988480 00000100:00100000:0.0:1790773080.628230:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1790773080.628238:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+22:10318:x1877761495988480:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790773080.628331:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+22:10318:x1877761495988480:12345-0@lo:502:llog_process_th.0 Request processed in 93us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773080.628339:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1790773080.628526:0:10318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:10318:1877761495988480:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790773080.628564:0:10318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cae300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:10318:1877761495988608:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790773080.628597:0:10318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773080.628621:0:10318:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ee14f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790773080.628673:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495988608 00000100:00100000:3.0:1790773080.628677:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495988608 00000100:00100000:3.0:1790773080.628716:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1790773080.628723:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+22:10318:x1877761495988608:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790773080.628798:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+22:10318:x1877761495988608:12345-0@lo:502:llog_process_th.0 Request processed in 75us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773080.628804:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1790773080.628870:0:10318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cae300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:10318:1877761495988608:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1790773080.628889:0:10318:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1790773080.629067:0:6475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1790773080.629087:0:6475:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790773080.629098:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc78419b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78419ba expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773080.629109:0:6475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc78419b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78419ba expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773080.629118:0:6475:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1790773080.629121:0:6475:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:3.0:1790773080.629124:0:6475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1790773080.629148:0:6475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d279de3c00/0xabf1cc0bc78419c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773080.629162:0:6475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d279de3c00/0xabf1cc0bc78419c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773080.629171:0:6475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d279de3c00/0xabf1cc0bc78419c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773080.629183:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495988736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790773080.629240:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773080.629258:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26bebf0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790773080.629354:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495988736 00000100:00100000:2.0:1790773080.629359:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495988736 00000100:00100000:2.0:1790773080.629389:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1790773080.629396:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+22:6475:x1877761495988736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790773080.629404:0:6471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773080.629416:0:6471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d26efc4a00/0xabf1cc0bc78419c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc78419c1 expref: -99 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773080.629437:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d26efc4a00/0xabf1cc0bc78419c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc78419c1 expref: 23 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773080.629453:0:6471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d26efc4a00/0xabf1cc0bc78419c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78419c1 expref: 23 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773080.629461:0:6471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26efc4a00, rc 0) 00000100:00100000:2.0:1790773080.629489:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+23:6475:x1877761495988736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773080.629495:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1790773080.629668:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495988736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790773080.629679:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d279de3c00/0xabf1cc0bc78419c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78419c8 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773080.629688:0:6475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d279de3c00/0xabf1cc0bc78419c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc78419c8 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773080.629740:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495988864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790773080.629775:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773080.629794:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26bebf0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790773080.629879:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495988864 00000100:00100000:0.0:1790773080.629883:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495988864 00000100:00100000:0.0:1790773080.629917:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1790773080.629924:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+23:6475:x1877761495988864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790773080.630023:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+23:6475:x1877761495988864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773080.630030:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1790773080.630125:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495988864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790773080.630151:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495988992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790773080.630186:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773080.630241:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26bebf0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790773080.631454:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495988992 00000100:00100000:0.0:1790773080.631464:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495988992 00000100:00100000:0.0:1790773080.631507:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1790773080.631516:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+23:6475:x1877761495988992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790773080.631632:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+23:6475:x1877761495988992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 117us (1444us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773080.631646:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1790773080.632036:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495988992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790773080.633074:0:10319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cae300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:10319:1877761495989120:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790773080.633143:0:10319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773080.633183:0:10319:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ee14900 going to sleep for 11 seconds 00000100:00100000:3.0:1790773080.633666:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495989120 00000100:00100000:3.0:1790773080.633684:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495989120 00000100:00100000:3.0:1790773080.633793:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1790773080.633803:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+23:10319:x1877761495989120:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790773080.633930:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+23:10319:x1877761495989120:12345-0@lo:502:llog_process_th.0 Request processed in 128us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773080.633937:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1790773080.634479:0:10319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cae300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:10319:1877761495989120:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790773080.634518:0:10319:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790773080.634529:0:10319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773080.634532:0:10319:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1790773080.634538:0:10319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1790773080.634566:0:10319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cae300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:10319:1877761495989248:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790773080.634611:0:10319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773080.634632:0:10319:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ee14900 going to sleep for 11 seconds 00000100:00100000:0.0:1790773080.634707:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495989248 00000100:00100000:0.0:1790773080.634713:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495989248 00000100:00100000:0.0:1790773080.634749:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1790773080.634756:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d252ea1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+23:10319:x1877761495989248:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790773080.634841:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d252ea1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+23:10319:x1877761495989248:12345-0@lo:502:llog_process_th.0 Request processed in 85us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773080.634848:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1790773080.637486:0:10319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cae300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:10319:1877761495989248:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790773080.637540:0:10319:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790773080.637550:0:10319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773080.637553:0:10319:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1790773080.637557:0:10319:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1790773080.638476:0:6475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:3.0:1790773080.638501:0:6475:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1790773080.638513:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d279de3c00/0xabf1cc0bc78419c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78419c8 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773080.638525:0:6475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d279de3c00/0xabf1cc0bc78419c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78419c8 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773080.638536:0:6475:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1790773080.638538:0:6475:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93d262660000 from 1 10000000:01000000:3.0:1790773080.638541:0:6475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1790773080.638573:0:6475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d279de2e00/0xabf1cc0bc78419cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773080.638581:0:6475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d279de2e00/0xabf1cc0bc78419cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773080.638591:0:6475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d279de2e00/0xabf1cc0bc78419cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773080.638612:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495989376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790773080.638677:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773080.638712:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26bebf540 going to sleep for 11 seconds 00000100:00100000:0.0:1790773080.638961:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495989376 00000100:00100000:0.0:1790773080.638970:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495989376 00000100:00100000:0.0:1790773080.639014:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1790773080.639022:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d252ea0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+23:6475:x1877761495989376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790773080.639035:0:6473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773080.639046:0:6473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d26c4a2800/0xabf1cc0bc78419d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc78419cf expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773080.639068:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d26c4a2800/0xabf1cc0bc78419d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc78419cf expref: 24 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773080.639078:0:6473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d26c4a2800/0xabf1cc0bc78419d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78419cf expref: 24 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773080.639086:0:6473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26c4a2800, rc 0) 00000100:00100000:0.0:1790773080.639131:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d252ea0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:6475:x1877761495989376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773080.639137:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1790773080.639249:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495989376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790773080.639265:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d279de2e00/0xabf1cc0bc78419cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78419d6 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773080.639287:0:6475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d279de2e00/0xabf1cc0bc78419cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc78419d6 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773080.639444:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9e5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495989504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790773080.639471:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773080.639492:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ef8c240 going to sleep for 11 seconds 00000100:00100000:2.0:1790773080.641756:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495989504 00000100:00100000:2.0:1790773080.641790:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495989504 00000100:00100000:2.0:1790773080.641854:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1790773080.641877:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d252ea3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:6475:x1877761495989504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790773080.642008:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d252ea3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:6475:x1877761495989504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 133us (2535us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790773080.642016:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1790773080.642883:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9e5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495989504:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1790773080.642923:0:6475:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1790773080.642934:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d279de2e00/0xabf1cc0bc78419cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78419d6 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773080.642946:0:6475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d279de2e00/0xabf1cc0bc78419cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78419d6 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773080.909699:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773081.137088:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773081.137126:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773081.137150:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773081.137167:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773081.137192:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773081.137237:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484396416 00000100:00100000:1.0:1790773081.137247:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484396416 00000100:00100000:1.0:1790773081.137306:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484396544 00000100:00100000:1.0:1790773081.137309:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484396544 00000100:00100000:1.0:1790773081.137333:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 65 00000100:00100000:1.0:1790773081.137342:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+6:2397:x1877761484396416:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773081.137420:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+6:2397:x1877761484396416:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 78us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773081.137429:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 65 00000100:00100000:1.0:1790773081.137459:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 66 00000100:00100000:1.0:1790773081.137466:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+5:2397:x1877761484396544:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773081.137494:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+5:2397:x1877761484396544:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 29us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773081.137501:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 66 00000100:00100000:1.0:1790773081.137520:0:8392:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484396672 00000100:00100000:1.0:1790773081.137523:0:8392:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484396672 00000100:00100000:1.0:1790773081.137546:0:8392:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484396800 00000100:00100000:1.0:1790773081.137548:0:8392:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484396800 00000100:00100000:1.0:1790773081.137564:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:1.0:1790773081.137570:0:8392:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:110130ab-04fa-4d7c-984e-562032df4432+5:2397:x1877761484396672:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773081.137595:0:8392:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:110130ab-04fa-4d7c-984e-562032df4432+5:2397:x1877761484396672:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 25us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773081.137601:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:1.0:1790773081.137611:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 22 00000100:00100000:1.0:1790773081.137616:0:8392:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:110130ab-04fa-4d7c-984e-562032df4432+5:2397:x1877761484396800:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773081.137637:0:8392:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:110130ab-04fa-4d7c-984e-562032df4432+5:2397:x1877761484396800:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 21us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773081.137642:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 22 00000100:00080000:3.0:1790773081.137799:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790773081.137805:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790773081.137807:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790773081.137809:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790773081.138054:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484396288 00000100:00100000:2.0:1790773081.138059:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484396288 00000100:00100000:2.0:1790773081.138100:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 249 00000100:00100000:2.0:1790773081.138108:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d279eaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+10:2397:x1877761484396288:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1790773081.138141:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d279eaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+10:2397:x1877761484396288:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 35us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773081.138148:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 249 00000020:00000080:0.0:1790773081.398570:0:10356:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff0894a290 20000000:00000080:0.0:1790773081.398590:0:10356:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93d27f9e0000 uarg=0000000000000000 20000000:01000000:0.0:1790773081.398698:0:10356:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1790773081.398703:0:10356:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1790773081.398709:0:10356:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1790773081.399430:0:10357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1790773081.399721:0:10356:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1790773081.404687:0:10356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1790773081.404742:0:10356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1790773081.404770:0:10356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1790773081.404787:0:10356:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1790773081.404812:0:10356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93d26c4a3a00/0xabf1cc0bc78419dd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773081.404831:0:10356:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d241526000/0xabf1cc0bc7841679 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7841672 expref: 23 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773081.404839:0:10356:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d26c4a2c00/0xabf1cc0bc7841687 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7841680 expref: 23 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773081.404846:0:10356:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d241526400/0xabf1cc0bc78416db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78416d4 expref: 23 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773081.404853:0:10356:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d27b12b800/0xabf1cc0bc7841801 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78417fa expref: 23 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773081.404863:0:10356:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d27b12a600/0xabf1cc0bc7841919 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6ba89 expref: 9 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773081.404871:0:10356:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93d26c4a3a00/0xabf1cc0bc78419dd lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773081.404909:0:10356:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d27b12a600/0xabf1cc0bc7841919 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6ba89 expref: 9 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773081.404947:0:10356:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d27b12a600/0xabf1cc0bc7841919 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6ba89 expref: 9 pid: 6471 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773081.404962:0:10356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f974e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10356:1877761495989632:192.168.202.19@tcp:104: 00010000:00010000:0.0:1790773081.405172:0:10356:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d27b12b800/0xabf1cc0bc7841801 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc78417fa expref: 23 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773081.405181:0:10356:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d27b12b800/0xabf1cc0bc7841801 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc78417fa expref: 23 pid: 6471 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773081.405190:0:10356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f977800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10356:1877761495989760:0@lo:104: 00000100:00100000:0.0:1790773081.405412:0:10356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790773081.405457:0:10356:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d241526400/0xabf1cc0bc78416db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc78416d4 expref: 23 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773081.405466:0:10356:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d241526400/0xabf1cc0bc78416db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc78416d4 expref: 23 pid: 6473 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773081.405475:0:10356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f976680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10356:1877761495989888:0@lo:104: 00010000:00010000:0.0:1790773081.405496:0:10356:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d26c4a2c00/0xabf1cc0bc7841687 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc7841680 expref: 23 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773081.405503:0:10356:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d26c4a2c00/0xabf1cc0bc7841687 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc7841680 expref: 23 pid: 6473 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773081.405510:0:10356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f976300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10356:1877761495990016:0@lo:104: 00010000:00010000:0.0:1790773081.405526:0:10356:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d241526000/0xabf1cc0bc7841679 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc7841672 expref: 23 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773081.405540:0:10356:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d241526000/0xabf1cc0bc7841679 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc7841672 expref: 23 pid: 6471 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773081.405548:0:10356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f969c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10356:1877761495990144:0@lo:104: 00000100:00100000:0.0:1790773081.405562:0:10356:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d141fd2780 going to sleep for 11 seconds 00000100:00100000:0.0:1790773081.406875:0:6462:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1790773081.406907:0:6462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773081.407066:0:6462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773081.407092:0:6462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773081.407101:0:6462:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495989760 00000100:00100000:0.0:1790773081.407109:0:6462:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495989760 00000100:00100000:0.0:1790773081.407149:0:6462:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495989888 00000100:00100000:0.0:1790773081.407153:0:6462:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495989888 00000100:00100000:0.0:1790773081.407163:0:6462:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495990016 00000100:00100000:0.0:1790773081.407165:0:6462:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495990016 00000100:00100000:0.0:1790773081.407174:0:6462:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495990144 00000100:00100000:0.0:1790773081.407176:0:6462:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495990144 00000100:00100000:0.0:1790773081.407187:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790773081.407195:0:6462:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9ea450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+6:10356:x1877761495989760:12345-0@lo:104: 00010000:00010000:0.0:1790773081.407231:0:6462:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d24166ea00/0xabf1cc0bc78417fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7841801 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773081.407291:0:6462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790773081.407297:0:6462:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9ea450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+6:10356:x1877761495989760:12345-0@lo:104: Request processed in 103us (1885us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773081.407303:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790773081.407338:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790773081.407345:0:6462:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f969f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+5:10356:x1877761495989888:12345-0@lo:104: 00010000:00010000:0.0:1790773081.407364:0:6462:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d24166f400/0xabf1cc0bc78416d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc78416db expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773081.407397:0:6462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790773081.407402:0:6462:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f969f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+5:10356:x1877761495989888:12345-0@lo:104: Request processed in 59us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773081.407408:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790773081.407421:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790773081.407426:0:6462:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f968700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+4:10356:x1877761495990016:12345-0@lo:104: 00010000:00010000:0.0:1790773081.407433:0:6462:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d24166e600/0xabf1cc0bc7841680 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7841687 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773081.407462:0:6462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1790773081.407467:0:6462:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f968700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+4:10356:x1877761495990016:12345-0@lo:104: Request processed in 42us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773081.407473:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790773081.407483:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790773081.407489:0:6462:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f968e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+3:10356:x1877761495990144:12345-0@lo:104: 00010000:00010000:0.0:1790773081.407496:0:6462:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d27b12b600/0xabf1cc0bc7841672 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7841679 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773081.407537:0:6462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1790773081.407542:0:6462:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f968e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+3:10356:x1877761495990144:12345-0@lo:104: Request processed in 54us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773081.407548:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:0.0:1790773081.407565:0:6467:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1790773081.407571:0:6467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d24166ea00/0xabf1cc0bc78417fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7841801 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773081.407584:0:6467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d24166ea00 already unused, calling callback (ffffffffc14cac20) 00000100:00100000:2.0:1790773081.408642:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773081.408739:0:8410:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484396928 00000100:00100000:3.0:1790773081.408746:0:8410:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484396928 00010000:00010000:3.0:1790773081.408783:0:8410:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d27b12a600/0xabf1cc0bc7841919 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6ba89 expref: 10 pid: 6471 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773081.408820:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 35 00000100:00100000:3.0:1790773081.408828:0:8410:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3f7e9812-a56a-4fd4-8715-b93ef4652f29+10:2398:x1877761484396928:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790773081.408839:0:8410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773081.408844:0:8410:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d27b12a600/0xabf1cc0bc7841919 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6ba89 expref: 10 pid: 6471 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773081.408857:0:8410:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d27b12a600/0xabf1cc0bc7841919 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6ba89 expref: 10 pid: 6471 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773081.408875:0:8410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790773081.408909:0:8410:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3f7e9812-a56a-4fd4-8715-b93ef4652f29+10:2398:x1877761484396928:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 82us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773081.408926:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 35 00010000:00010000:2.0:1790773081.409573:0:8409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790773081.409582:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d24166f400/0xabf1cc0bc78416d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc78416db expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773081.409590:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d24166f400 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:2.0:1790773081.409594:0:8409:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d24166f400/0xabf1cc0bc78416d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc78416db expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773081.409612:0:8409:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d24166f400/0xabf1cc0bc78416d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc78416db expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790773081.409619:0:8409:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d24166f400/0xabf1cc0bc78416d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc78416db expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790773081.409626:0:8409:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790773081.409663:0:8409:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d24166f400/0xabf1cc0bc78416d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78416db expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773081.409680:0:8409:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790773081.409700:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d24166f400/0xabf1cc0bc78416d4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78416db expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773081.409707:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d24166f400/0xabf1cc0bc78416d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78416db expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773081.409720:0:8409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790773081.409724:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d24166e600/0xabf1cc0bc7841680 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7841687 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773081.409729:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d24166e600 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:2.0:1790773081.409732:0:8409:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d24166e600/0xabf1cc0bc7841680 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc7841687 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773081.409739:0:8409:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d24166e600/0xabf1cc0bc7841680 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc7841687 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790773081.409745:0:8409:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d24166e600/0xabf1cc0bc7841680 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc7841687 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790773081.409750:0:8409:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790773081.409773:0:8409:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d24166e600/0xabf1cc0bc7841680 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841687 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773081.409780:0:8409:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790773081.409785:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d24166e600/0xabf1cc0bc7841680 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841687 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773081.409933:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce0675b4-b0c5-48e7-b182-565e22fed04c:3604:1877761495990272:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790773081.409979:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773081.410032:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790773081.410038:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143caf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce0675b4-b0c5-48e7-b182-565e22fed04c:3604:1877761495990400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790773081.410060:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773081.410085:0:6465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495990272 00000100:00100000:3.0:1790773081.410097:0:6465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495990272 00010000:00010000:3.0:1790773081.410117:0:6465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d241526400/0xabf1cc0bc78416db lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc78416d4 expref: 24 pid: 6473 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773081.410139:0:6465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495990400 00000100:00100000:3.0:1790773081.410142:0:6465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495990400 00010000:00010000:3.0:1790773081.410152:0:6465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d26c4a2c00/0xabf1cc0bc7841687 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7841680 expref: 25 pid: 6473 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773081.410170:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790773081.410176:0:6465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+25:3604:x1877761495990272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790773081.410186:0:6465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773081.410190:0:6465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d241526400/0xabf1cc0bc78416db lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc78416d4 expref: 25 pid: 6473 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773081.410199:0:6465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d241526400/0xabf1cc0bc78416db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc78416d4 expref: 25 pid: 6473 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773081.410230:0:6465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790773081.410261:0:6465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+25:3604:x1877761495990272:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773081.410267:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790773081.410281:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790773081.410287:0:6465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3604:x1877761495990400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790773081.410295:0:6465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773081.410299:0:6465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d26c4a2c00/0xabf1cc0bc7841687 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7841680 expref: 24 pid: 6473 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773081.410307:0:6465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d26c4a2c00/0xabf1cc0bc7841687 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc7841680 expref: 24 pid: 6473 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773081.410327:0:6465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790773081.410348:0:6465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3604:x1877761495990400:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773081.410354:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790773081.410387:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143caf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce0675b4-b0c5-48e7-b182-565e22fed04c:3604:1877761495990400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790773081.410395:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce0675b4-b0c5-48e7-b182-565e22fed04c:3604:1877761495990272:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790773081.410561:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d24166e600/0xabf1cc0bc7841680 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841687 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773081.410581:0:8409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790773081.410584:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d27b12b600/0xabf1cc0bc7841672 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7841679 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773081.410590:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12b600 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:2.0:1790773081.410593:0:8409:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d27b12b600/0xabf1cc0bc7841672 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc7841679 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773081.410666:0:8409:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d27b12b600/0xabf1cc0bc7841672 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc7841679 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790773081.410674:0:8409:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d27b12b600/0xabf1cc0bc7841672 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc7841679 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790773081.410679:0:8409:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790773081.410707:0:8409:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d27b12b600/0xabf1cc0bc7841672 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841679 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773081.410713:0:8409:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790773081.410724:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d27b12b600/0xabf1cc0bc7841672 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841679 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773081.410730:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d27b12b600/0xabf1cc0bc7841672 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841679 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773081.410739:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773081.410741:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773081.410742:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773081.410785:0:10356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d27b12a600/0xabf1cc0bc7841919 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6ba89 expref: 9 pid: 6471 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790773081.410977:0:6467:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d24166ea00/0xabf1cc0bc78417fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc7841801 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773081.411038:0:6467:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d24166ea00/0xabf1cc0bc78417fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc7841801 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790773081.411044:0:6467:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d24166ea00/0xabf1cc0bc78417fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc7841801 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790773081.411049:0:6467:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790773081.411066:0:6467:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d24166ea00/0xabf1cc0bc78417fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841801 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773081.411072:0:6467:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790773081.411079:0:6467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d24166ea00/0xabf1cc0bc78417fa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841801 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773081.411085:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d24166ea00/0xabf1cc0bc78417fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841801 expref: -99 pid: 9473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773081.411098:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773081.411100:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773081.411102:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773081.411144:0:10356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f974e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10356:1877761495989632:192.168.202.19@tcp:104: 00000100:00100000:2.0:1790773081.411160:0:10356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f977800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10356:1877761495989760:0@lo:104: 00010000:00010000:2.0:1790773081.411169:0:10356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d241526400/0xabf1cc0bc78416db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc78416d4 expref: 23 pid: 6473 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773081.411177:0:10356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f976680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10356:1877761495989888:0@lo:104: 00010000:00010000:2.0:1790773081.411186:0:10356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d26c4a2c00/0xabf1cc0bc7841687 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc7841680 expref: 22 pid: 6473 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773081.411194:0:10356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f976300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10356:1877761495990016:0@lo:104: 00000100:00100000:2.0:1790773081.411227:0:10356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f969c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10356:1877761495990144:0@lo:104: 00010000:00010000:2.0:1790773081.411250:0:10356:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93d26c4a3a00/0xabf1cc0bc78419dd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773081.411323:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773081.411372:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce0675b4-b0c5-48e7-b182-565e22fed04c:3606:1877761495990528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790773081.411410:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773081.411438:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790773081.411444:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f96aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce0675b4-b0c5-48e7-b182-565e22fed04c:3606:1877761495990656:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790773081.411477:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773081.411585:0:6465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495990528 00000100:00100000:0.0:1790773081.411591:0:6465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495990528 00000100:00100000:2.0:1790773081.411676:0:6464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495990656 00000100:00100000:2.0:1790773081.411680:0:6464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495990656 00010000:00010000:2.0:1790773081.411699:0:6464:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d27b12b800/0xabf1cc0bc7841801 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc78417fa expref: 23 pid: 6471 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773081.411728:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790773081.411735:0:6464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+23:3606:x1877761495990656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790773081.411744:0:6464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790773081.411748:0:6464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d27b12b800/0xabf1cc0bc7841801 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc78417fa expref: 23 pid: 6471 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773081.411768:0:6464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d27b12b800/0xabf1cc0bc7841801 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc78417fa expref: 23 pid: 6471 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773081.411787:0:6464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d27b12b800/0xabf1cc0bc7841801 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc78417fa expref: 23 pid: 6471 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773081.411867:0:6465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d241526000/0xabf1cc0bc7841679 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7841672 expref: 23 pid: 6471 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773081.411898:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790773081.411905:0:6465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512c9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+23:3606:x1877761495990528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790773081.411913:0:6465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773081.412303:0:6465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d241526000/0xabf1cc0bc7841679 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7841672 expref: 23 pid: 6471 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773081.412312:0:6465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d241526000/0xabf1cc0bc7841679 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc7841672 expref: 23 pid: 6471 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773081.412322:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d241526000/0xabf1cc0bc7841679 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc7841672 expref: 23 pid: 6471 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773081.412336:0:6465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93d26c4a3a00/0xabf1cc0bc78419dd lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773081.412345:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d26c4a3a00/0xabf1cc0bc78419dd lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773081.412358:0:6465:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d26c4a3a00/0xabf1cc0bc78419dd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773081.412366:0:6465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d26c4a3a00/0xabf1cc0bc78419dd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773081.412373:0:6465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93d26c4a3a00/0xabf1cc0bc78419dd lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773081.412379:0:6465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93d26c4a3a00/0xabf1cc0bc78419dd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773081.412396:0:6465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a3a00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:0.0:1790773081.412399:0:6465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93d26c4a3a00/0xabf1cc0bc78419dd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773081.412407:0:6465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93d26c4a3a00/0xabf1cc0bc78419dd lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773081.412429:0:6465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93d26c4a3a00/0xabf1cc0bc78419dd lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773081.412439:0:6465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790773081.412529:0:6464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790773081.412574:0:6464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:3606:x1877761495990656:12345-0@lo:103:ldlm_bl.0 Request processed in 839us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773081.412580:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:3.0:1790773081.412775:0:10356:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93d26c4a3a00/0xabf1cc0bc78419dd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773081.412785:0:10356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93d26c4a3a00/0xabf1cc0bc78419dd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773081.412860:0:10356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d26c4a3a00/0xabf1cc0bc78419dd lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773081.413074:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f96aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce0675b4-b0c5-48e7-b182-565e22fed04c:3606:1877761495990656:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790773081.413150:0:6465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512c9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+20:3606:x1877761495990528:12345-0@lo:103:ldlm_bl.0 Request processed in 1245us (1738us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773081.413157:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790773081.413403:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce0675b4-b0c5-48e7-b182-565e22fed04c:3606:1877761495990528:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790773081.591477:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773081.591582:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484397056 00000100:00100000:0.0:1790773081.591592:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484397056 00000100:00100000:0.0:1790773081.591658:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 250 00000100:00100000:0.0:1790773081.591668:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d279eaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+9:6170:x1877761484397056:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790773081.591686:0:6473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773081.591705:0:6473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d26c4a2600/0xabf1cc0bc78419e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bacf expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773081.591734:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d26c4a2600/0xabf1cc0bc78419e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bacf expref: 10 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773081.591746:0:6473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d26c4a2600/0xabf1cc0bc78419e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bacf expref: 10 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773081.591776:0:6473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26c4a2600, rc 0) 00000100:00100000:0.0:1790773081.591859:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d279eaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+10:6170:x1877761484397056:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 Request processed in 191us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773081.591866:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 250 00000100:00100000:2.0:1790773081.612752:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773081.613088:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484397184 00000100:00100000:0.0:1790773081.613098:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484397184 00000100:00100000:0.0:1790773081.613152:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 251 00000100:00100000:0.0:1790773081.613162:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d251208850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+10:6170:x1877761484397184:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790773081.613331:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d251208850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+10:6170:x1877761484397184:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 Request processed in 170us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773081.613338:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 251 00000100:00100000:3.0:1790773081.619538:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773081.622374:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484397312 00000100:00100000:3.0:1790773081.622390:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484397312 00000100:00100000:3.0:1790773081.622451:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 252 00000100:00100000:3.0:1790773081.622462:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25120b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+10:6170:x1877761484397312:12345-192.168.202.19@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790773081.622619:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25120b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+10:6170:x1877761484397312:12345-192.168.202.19@tcp:503:ll_cfg_requeue.0 Request processed in 158us (3089us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773081.622632:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 252 00000100:00100000:3.0:1790773081.663922:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773081.663955:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484397440 00000100:00100000:3.0:1790773081.663963:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484397440 00000100:00100000:3.0:1790773081.664008:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 253 00000100:00100000:3.0:1790773081.664018:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25120ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+10:6685:x1877761484397440:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790773081.664251:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25120ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+10:6685:x1877761484397440:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 232us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773081.664260:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 253 00000100:00100000:2.0:1790773081.684666:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773081.684732:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484397568 00000100:00100000:0.0:1790773081.684743:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484397568 00000100:00100000:0.0:1790773081.684816:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 254 00000100:00100000:0.0:1790773081.684834:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d251209450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+10:6685:x1877761484397568:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790773081.684987:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d251209450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+10:6685:x1877761484397568:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 154us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773081.684995:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 254 00010000:00010000:2.0:1790773081.933477:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1790773082.192133:0:6475:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790773082.192141:0:6475:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d141fee800 from 4 10000000:01000000:3.0:1790773082.192148:0:6475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790773082.192198:0:6475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d279de3400/0xabf1cc0bc78419eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773082.192230:0:6475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d279de3400/0xabf1cc0bc78419eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773082.192243:0:6475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d279de3400/0xabf1cc0bc78419eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773082.192286:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495990784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790773082.192362:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773082.192402:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26bebfcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790773082.192605:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495990784 00000100:00100000:0.0:1790773082.192614:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495990784 00000100:00100000:0.0:1790773082.192682:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1790773082.192691:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d251208c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+20:6475:x1877761495990784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790773082.192706:0:6472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773082.192720:0:6472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d26c4a2c00/0xabf1cc0bc78419f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc78419eb expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773082.192772:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d26c4a2c00/0xabf1cc0bc78419f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc78419eb expref: 21 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773082.192784:0:6472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d26c4a2c00/0xabf1cc0bc78419f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78419eb expref: 21 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773082.192794:0:6472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26c4a2c00, rc 0) 00000100:00100000:0.0:1790773082.192844:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d251208c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:6475:x1877761495990784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773082.192851:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1790773082.192900:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495990784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790773082.192916:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d279de3400/0xabf1cc0bc78419eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78419f2 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773082.192924:0:6475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d279de3400/0xabf1cc0bc78419eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc78419f2 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773082.193000:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f96a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495990912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790773082.193027:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773082.193047:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d141fd2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790773082.193061:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495990912 00000100:00100000:0.0:1790773082.193064:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495990912 00000100:00100000:0.0:1790773082.193087:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1790773082.193094:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26be9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:6475:x1877761495990912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790773082.193194:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26be9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:6475:x1877761495990912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773082.193232:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1790773082.193374:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f96a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495990912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790773082.193403:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f96a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495991040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790773082.193509:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773082.193526:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d141fd2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790773082.193538:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495991040 00000100:00100000:0.0:1790773082.193541:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495991040 00000100:00100000:0.0:1790773082.193564:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1790773082.193569:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26be9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:6475:x1877761495991040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790773082.194522:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26be9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:6475:x1877761495991040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 949us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773082.194531:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1790773082.194584:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f96a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495991040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790773082.196157:0:10377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f96a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:10377:1877761495991168:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790773082.196242:0:10377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773082.196283:0:10377:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d141fd2f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790773082.196408:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495991168 00000100:00100000:1.0:1790773082.196416:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495991168 00000100:00100000:1.0:1790773082.196466:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1790773082.196473:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26be9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:10377:x1877761495991168:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790773082.196576:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26be9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:10377:x1877761495991168:12345-0@lo:502:llog_process_th.0 Request processed in 103us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773082.196593:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1790773082.196777:0:10377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f96a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:10377:1877761495991168:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790773082.196798:0:10377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790773082.196807:0:10377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773082.196809:0:10377:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1790773082.196815:0:10377:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93d141fee800 00000020:00000080:0.0:1790773082.196817:0:10377:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1790773082.196893:0:10377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f96a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:10377:1877761495991296:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790773082.196928:0:10377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773082.196956:0:10377:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d141fd2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790773082.198876:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495991296 00000100:00100000:2.0:1790773082.198889:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495991296 00000100:00100000:2.0:1790773082.198945:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1790773082.198956:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26be9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:10377:x1877761495991296:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790773082.199107:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26be9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:10377:x1877761495991296:12345-0@lo:502:llog_process_th.0 Request processed in 153us (2178us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773082.199116:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1790773082.204794:0:10377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f96a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:10377:1877761495991296:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790773082.204834:0:10377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790773082.204841:0:10377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773082.204848:0:10377:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1790773082.204854:0:10377:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1790773082.214632:0:6475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1790773082.214679:0:6475:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790773082.214695:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d279de3400/0xabf1cc0bc78419eb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78419f2 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773082.214713:0:6475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d279de3400/0xabf1cc0bc78419eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78419f2 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790773082.214727:0:6475:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790773082.214731:0:6475:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d26ff80800 from 4 10000000:01000000:0.0:1790773082.214734:0:6475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790773082.214795:0:6475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3a00/0xabf1cc0bc78419f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773082.214803:0:6475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3a00/0xabf1cc0bc78419f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773082.214815:0:6475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3a00/0xabf1cc0bc78419f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773082.214842:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f96b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495991424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790773082.214914:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773082.214965:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d141fd2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790773082.215221:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495991424 00000100:00100000:3.0:1790773082.215230:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495991424 00000100:00100000:3.0:1790773082.215282:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1790773082.215290:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26be9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:6475:x1877761495991424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790773082.215303:0:6473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773082.215316:0:6473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d279de3000/0xabf1cc0bc7841a00 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc78419f9 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773082.215340:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d279de3000/0xabf1cc0bc7841a00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc78419f9 expref: 22 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773082.215351:0:6473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d279de3000/0xabf1cc0bc7841a00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78419f9 expref: 22 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773082.215361:0:6473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d279de3000, rc 0) 00000100:00100000:3.0:1790773082.215401:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26be9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+22:6475:x1877761495991424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773082.215408:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1790773082.215449:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f96b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495991424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790773082.215462:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3a00/0xabf1cc0bc78419f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841a00 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773082.215472:0:6475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3a00/0xabf1cc0bc78419f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7841a00 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773082.215521:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495991552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790773082.215543:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773082.215572:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26bebf540 going to sleep for 11 seconds 00000100:00100000:3.0:1790773082.215583:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495991552 00000100:00100000:3.0:1790773082.215587:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495991552 00000100:00100000:3.0:1790773082.215605:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1790773082.215611:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26be9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+22:6475:x1877761495991552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790773082.215706:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26be9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+22:6475:x1877761495991552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 94us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773082.215713:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1790773082.215740:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495991552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790773082.215779:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495991680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790773082.215812:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773082.215824:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26bebf540 going to sleep for 11 seconds 00000100:00100000:3.0:1790773082.215833:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495991680 00000100:00100000:3.0:1790773082.215836:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495991680 00000100:00100000:3.0:1790773082.215852:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1790773082.215857:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+22:6475:x1877761495991680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790773082.215917:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+22:6475:x1877761495991680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 58us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773082.215923:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1790773082.215955:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495991680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790773082.216110:0:10380:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:10380:1877761495991808:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790773082.216141:0:10380:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773082.216156:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495991808 00000100:00100000:3.0:1790773082.216159:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495991808 00000100:00100000:3.0:1790773082.216175:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1790773082.216180:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+22:10380:x1877761495991808:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790773082.216260:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+22:10380:x1877761495991808:12345-0@lo:502:llog_process_th.0 Request processed in 80us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773082.216267:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1790773082.216290:0:10380:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26bebf540 going to sleep for 11 seconds 00000100:00100000:3.0:1790773082.216300:0:10380:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:10380:1877761495991808:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790773082.216319:0:10380:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790773082.216328:0:10380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773082.216330:0:10380:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1790773082.216339:0:10380:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93d26ff80800 00000020:00000080:3.0:1790773082.216341:0:10380:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790773082.216720:0:10380:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:10380:1877761495991936:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790773082.216763:0:10380:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773082.216782:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495991936 00000100:00100000:3.0:1790773082.216785:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495991936 00000100:00100000:3.0:1790773082.216803:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1790773082.216809:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+22:10380:x1877761495991936:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790773082.216859:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+22:10380:x1877761495991936:12345-0@lo:502:llog_process_th.0 Request processed in 50us (96us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773082.216866:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1790773082.216890:0:10380:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26bebf540 going to sleep for 11 seconds 00000100:00100000:3.0:1790773082.216900:0:10380:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:10380:1877761495991936:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790773082.216915:0:10380:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790773082.216918:0:10380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773082.216920:0:10380:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1790773082.216924:0:10380:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1790773082.216965:0:6475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1790773082.216983:0:6475:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790773082.216990:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3a00/0xabf1cc0bc78419f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841a00 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773082.217002:0:6475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3a00/0xabf1cc0bc78419f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841a00 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773082.217012:0:6475:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790773082.217014:0:6475:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d26ed89000 from 4 10000000:01000000:3.0:1790773082.217016:0:6475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790773082.217032:0:6475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d279de3200/0xabf1cc0bc7841a07 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773082.217040:0:6475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d279de3200/0xabf1cc0bc7841a07 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773082.217049:0:6475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d279de3200/0xabf1cc0bc7841a07 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773082.217060:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495992064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790773082.217081:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773082.217092:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26bebf540 going to sleep for 11 seconds 00000100:00100000:3.0:1790773082.217101:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495992064 00000100:00100000:3.0:1790773082.217103:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495992064 00000100:00100000:3.0:1790773082.217119:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1790773082.217124:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+22:6475:x1877761495992064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790773082.217132:0:6471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773082.217140:0:6471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d279de3600/0xabf1cc0bc7841a0e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7841a07 expref: -99 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773082.217168:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d279de3600/0xabf1cc0bc7841a0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7841a07 expref: 23 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773082.217177:0:6471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d279de3600/0xabf1cc0bc7841a0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7841a07 expref: 23 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773082.217185:0:6471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d279de3600, rc 0) 00000100:00100000:3.0:1790773082.217228:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+23:6475:x1877761495992064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773082.217234:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1790773082.217260:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495992064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790773082.217272:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d279de3200/0xabf1cc0bc7841a07 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841a0e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773082.217281:0:6475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d279de3200/0xabf1cc0bc7841a07 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7841a0e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773082.217315:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495992192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790773082.217335:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773082.217346:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26bebf540 going to sleep for 11 seconds 00000100:00100000:3.0:1790773082.217354:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495992192 00000100:00100000:3.0:1790773082.217357:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495992192 00000100:00100000:3.0:1790773082.217372:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1790773082.217377:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+23:6475:x1877761495992192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790773082.217436:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+23:6475:x1877761495992192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 58us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773082.217450:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1790773082.217475:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495992192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790773082.217494:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495992320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790773082.217520:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773082.217531:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26bebf540 going to sleep for 11 seconds 00000100:00100000:3.0:1790773082.217540:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495992320 00000100:00100000:3.0:1790773082.217543:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495992320 00000100:00100000:3.0:1790773082.217558:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1790773082.217563:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+23:6475:x1877761495992320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790773082.217612:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+23:6475:x1877761495992320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 49us (91us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773082.217619:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1790773082.217648:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495992320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790773082.217858:0:10381:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:10381:1877761495992448:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790773082.217886:0:10381:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773082.217901:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495992448 00000100:00100000:3.0:1790773082.217904:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495992448 00000100:00100000:3.0:1790773082.217920:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1790773082.217925:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+23:10381:x1877761495992448:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790773082.217975:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+23:10381:x1877761495992448:12345-0@lo:502:llog_process_th.0 Request processed in 49us (87us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773082.217981:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1790773082.218004:0:10381:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2523f5000 going to sleep for 11 seconds 00000100:00100000:3.0:1790773082.218013:0:10381:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:10381:1877761495992448:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790773082.218032:0:10381:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790773082.218038:0:10381:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773082.218040:0:10381:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1790773082.218046:0:10381:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93d26ed89000 00000020:00000080:3.0:1790773082.218049:0:10381:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790773082.218321:0:10381:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:10381:1877761495992576:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790773082.218349:0:10381:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773082.218366:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495992576 00000100:00100000:3.0:1790773082.218369:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495992576 00000100:00100000:3.0:1790773082.218383:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1790773082.218389:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+23:10381:x1877761495992576:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790773082.218436:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+23:10381:x1877761495992576:12345-0@lo:502:llog_process_th.0 Request processed in 47us (86us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773082.218443:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1790773082.218466:0:10381:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d25146bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790773082.218476:0:10381:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:10381:1877761495992576:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790773082.218490:0:10381:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790773082.218493:0:10381:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773082.218495:0:10381:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1790773082.218499:0:10381:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1790773082.218530:0:6475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1790773082.218544:0:6475:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790773082.218550:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d279de3200/0xabf1cc0bc7841a07 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841a0e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773082.218560:0:6475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d279de3200/0xabf1cc0bc7841a07 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841a0e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773082.218579:0:6475:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790773082.218581:0:6475:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d25268e800 from 4 10000000:01000000:3.0:1790773082.218583:0:6475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790773082.218598:0:6475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d279de2c00/0xabf1cc0bc7841a15 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773082.218606:0:6475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d279de2c00/0xabf1cc0bc7841a15 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773082.218614:0:6475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d279de2c00/0xabf1cc0bc7841a15 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773082.218625:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495992704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790773082.218646:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773082.218658:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d25146bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790773082.218667:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495992704 00000100:00100000:3.0:1790773082.218670:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495992704 00000100:00100000:3.0:1790773082.218686:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1790773082.218691:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+23:6475:x1877761495992704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790773082.218698:0:6471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773082.218706:0:6471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d279de2000/0xabf1cc0bc7841a1c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7841a15 expref: -99 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773082.218720:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d279de2000/0xabf1cc0bc7841a1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7841a15 expref: 24 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773082.218729:0:6471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d279de2000/0xabf1cc0bc7841a1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7841a15 expref: 24 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773082.218746:0:6471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d279de2000, rc 0) 00000100:00100000:3.0:1790773082.220555:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:6475:x1877761495992704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1858us (1902us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773082.220567:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1790773082.220650:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495992704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790773082.220671:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d279de2c00/0xabf1cc0bc7841a15 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841a1c expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773082.220682:0:6475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d279de2c00/0xabf1cc0bc7841a15 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7841a1c expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773082.220761:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495992832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790773082.220793:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773082.220830:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d25146bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790773082.221026:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495992832 00000100:00100000:0.0:1790773082.221033:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495992832 00000100:00100000:0.0:1790773082.221072:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1790773082.221080:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:6475:x1877761495992832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790773082.221196:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:6475:x1877761495992832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773082.221237:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1790773082.224448:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495992832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790773082.224536:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495992960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790773082.224614:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773082.224655:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d25146bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790773082.224674:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495992960 00000100:00100000:3.0:1790773082.224680:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495992960 00000100:00100000:3.0:1790773082.224727:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1790773082.224736:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:6475:x1877761495992960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790773082.224854:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:6475:x1877761495992960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 118us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773082.224871:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1790773082.224917:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761495992960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790773082.226617:0:10382:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:10382:1877761495993088:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790773082.227576:0:10382:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773082.227629:0:10382:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26bebf240 going to sleep for 11 seconds 00000100:00100000:2.0:1790773082.227876:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495993088 00000100:00100000:2.0:1790773082.227884:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495993088 00000100:00100000:2.0:1790773082.227940:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1790773082.227950:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:10382:x1877761495993088:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790773082.228069:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:10382:x1877761495993088:12345-0@lo:502:llog_process_th.0 Request processed in 120us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773082.228082:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1790773082.229535:0:10382:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:10382:1877761495993088:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790773082.229573:0:10382:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790773082.229584:0:10382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773082.229586:0:10382:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1790773082.229595:0:10382:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93d25268e800 00000020:00000080:3.0:1790773082.229598:0:10382:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790773082.229695:0:10382:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:10382:1877761495993216:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790773082.229762:0:10382:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773082.229794:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495993216 00000100:00100000:3.0:1790773082.229800:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495993216 00000100:00100000:3.0:1790773082.229832:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1790773082.229839:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:10382:x1877761495993216:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790773082.229926:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:10382:x1877761495993216:12345-0@lo:502:llog_process_th.0 Request processed in 87us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773082.229934:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1790773082.229974:0:10382:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d25146bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790773082.229985:0:10382:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:10382:1877761495993216:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790773082.230000:0:10382:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790773082.230003:0:10382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773082.230005:0:10382:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1790773082.230013:0:10382:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1790773082.230075:0:6475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1790773082.230092:0:6475:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790773082.230102:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d279de2c00/0xabf1cc0bc7841a15 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841a1c expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773082.230114:0:6475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d279de2c00/0xabf1cc0bc7841a15 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841a1c expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773082.960110:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773083.470425:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f968a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761495993344:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790773083.470497:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773083.470695:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790773083.470704:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761495993472:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790773083.470755:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773083.470801:0:8397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495993344 00000100:00100000:1.0:1790773083.470810:0:8397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495993344 00000100:00100000:1.0:1790773083.470858:0:8397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495993472 00000100:00100000:1.0:1790773083.470861:0:8397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495993472 00000100:00100000:1.0:1790773083.470878:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790773083.470885:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f96b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761495993344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790773083.470927:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790773083.470980:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f96b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761495993344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773083.470988:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790773083.471005:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790773083.471011:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761495993472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790773083.471022:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790773083.471045:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761495993472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 35us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773083.471051:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1790773083.471067:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790773083.471092:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f9e7b80 x1877761495993472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773099 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773083.471110:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761495993472:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1790773083.471122:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f968a80 x1877761495993344/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773099 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773083.471145:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f968a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761495993344:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1790773083.981761:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773085.006022:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773085.517431:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761495993600:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790773085.517515:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773085.517870:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce0675b4-b0c5-48e7-b182-565e22fed04c:3607:1877761495993728:0@lo:400:kworker.0 00000100:00100000:3.0:1790773085.517904:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773085.517928:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f987100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3607:1877761495994240:0@lo:400:kworker.0 00000100:00100000:3.0:1790773085.517953:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773085.517971:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f986680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3607:1877761495994752:0@lo:400:kworker.0 00000100:00100000:3.0:1790773085.517992:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773085.518011:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1790773085.518017:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f984e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877761495994112:0@lo:400:kworker.0 00000100:00100000:3.0:1790773085.518037:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773085.518054:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f984000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761495994624:0@lo:400:kworker.0 00000100:00100000:2.0:1790773085.518925:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495993728 00000100:00100000:2.0:1790773085.518935:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495993728 00000100:00100000:2.0:1790773085.518988:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1790773085.518997:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3607:x1877761495993728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773085.519056:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3607:x1877761495993728:12345-0@lo:400:kworker.0 Request processed in 60us (1151us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773085.519063:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1790773085.519099:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3604:1877761495993856:0@lo:400:kworker.0 00000100:00100000:2.0:1790773085.519124:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773085.519144:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f985500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3604:1877761495994368:0@lo:400:kworker.0 00000100:00100000:2.0:1790773085.519161:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773085.519169:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f987480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3604:1877761495994880:0@lo:400:kworker.0 00000100:00100000:2.0:1790773085.519184:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773085.519197:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1790773085.519219:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761495993984:0@lo:400:kworker.0 00000100:00100000:2.0:1790773085.519243:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773085.519260:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761495994496:0@lo:400:kworker.0 00000100:00100000:2.0:1790773085.519286:0:7666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495993600 00000100:00100000:2.0:1790773085.519289:0:7666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495993600 00000100:00100000:2.0:1790773085.519311:0:7666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495993984 00000100:00100000:2.0:1790773085.519314:0:7666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495993984 00000100:00100000:0.0:1790773085.519901:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790773085.519911:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f969880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761495995392:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790773085.519943:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773085.520100:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f96b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761495995520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790773085.520127:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773085.520156:0:8397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495995520 00000100:00100000:0.0:1790773085.520160:0:8397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495995520 00000100:00100000:0.0:1790773085.520198:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790773085.520222:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f96a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761495995520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790773085.520247:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790773085.520284:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f96a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761495995520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773085.520291:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1790773085.520324:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790773085.520618:0:7666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495995392 00000100:00100000:2.0:1790773085.520622:0:7666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495995392 00000100:00100000:2.0:1790773085.520635:0:7666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790773085.520641:0:7666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761495993600:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790773085.520995:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773085.521030:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f987b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761495995136:0@lo:400:kworker.0 00000100:00100000:3.0:1790773085.521059:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773085.521092:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce0675b4-b0c5-48e7-b182-565e22fed04c:3607:1877761495993728:0@lo:400:kworker.0 00000100:00100000:3.0:1790773085.521117:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761495995264:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790773085.521140:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773085.521173:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495994240 00000100:00100000:3.0:1790773085.521184:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495994240 00000100:00100000:3.0:1790773085.521226:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495994752 00000100:00100000:3.0:1790773085.521229:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495994752 00000100:00100000:3.0:1790773085.521244:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495994112 00000100:00100000:3.0:1790773085.521247:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495994112 00000100:00100000:3.0:1790773085.521257:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495993856 00000100:00100000:3.0:1790773085.521260:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495993856 00000100:00100000:3.0:1790773085.521270:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495994368 00000100:00100000:3.0:1790773085.521272:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495994368 00000100:00100000:3.0:1790773085.521283:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495994880 00000100:00100000:3.0:1790773085.521286:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495994880 00000100:00100000:3.0:1790773085.521300:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790773085.521319:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f984380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1877761495994240:12345-0@lo:400:kworker.0 00000004:00000024:2.0:1790773085.521421:0:7666:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1790773085.521461:0:7666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761495993600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 819us (3946us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773085.521480:0:7666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790773085.521499:0:7666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790773085.521505:0:7666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3604:x1877761495993984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773085.521539:0:7666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3604:x1877761495993984:12345-0@lo:400:kworker.0 Request processed in 34us (2294us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773085.521545:0:7666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790773085.521557:0:7666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790773085.521563:0:7666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f968a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761495995392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790773085.521581:0:7666:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790773085.521609:0:7666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f968a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761495995392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 46us (1665us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773085.521615:0:7666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1790773085.521750:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790773085.521753:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790773085.521765:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495995264 00000100:00100000:0.0:1790773085.521770:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495995264 00000100:00100000:0.0:1790773085.521797:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790773085.521803:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761495995264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790773085.521817:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790773085.521853:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761495995264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773085.521867:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1790773085.521900:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f96b480 x1877761495995520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773101 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773085.521918:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f96b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761495995520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790773085.521931:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f969880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761495995392:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1790773085.521951:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790773085.521961:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773085.521986:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f986300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761495995008:0@lo:400:kworker.0 00000100:00100000:0.0:1790773085.522010:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773085.522034:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761495993984:0@lo:400:kworker.0 00000100:00100000:1.0:1790773085.522528:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790773085.522538:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1877761495994752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773085.522579:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1877761495994752:12345-0@lo:400:kworker.0 Request processed in 44us (4587us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773085.522585:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790773085.522600:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790773085.522605:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f984a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877761495994112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773085.522630:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f984a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877761495994112:12345-0@lo:400:kworker.0 Request processed in 25us (4592us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773085.522636:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790773085.522645:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790773085.522651:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3604:x1877761495993856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773085.522905:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f984380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1877761495994240:12345-0@lo:400:kworker.0 Request processed in 1597us (4950us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773085.522912:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790773085.522926:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790773085.522933:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3604:x1877761495994368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773085.522969:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3604:x1877761495994368:12345-0@lo:400:kworker.0 Request processed in 37us (3807us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773085.522974:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790773085.522986:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790773085.522992:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143caf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3604:x1877761495994880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773085.523021:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143caf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3604:x1877761495994880:12345-0@lo:400:kworker.0 Request processed in 30us (3836us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773085.523027:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790773085.523044:0:8394:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495994624 00000100:00100000:3.0:1790773085.523049:0:8394:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495994624 00000100:00100000:3.0:1790773085.523080:0:8394:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495995136 00000100:00100000:3.0:1790773085.523091:0:8394:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495995136 00000100:00100000:3.0:1790773085.523105:0:8394:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495994496 00000100:00100000:3.0:1790773085.523108:0:8394:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495994496 00000100:00100000:3.0:1790773085.523119:0:8394:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495995008 00000100:00100000:3.0:1790773085.523122:0:8394:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495995008 00000100:00100000:3.0:1790773085.523133:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790773085.523138:0:8394:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761495994624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773085.523170:0:8394:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761495994624:12345-0@lo:400:kworker.0 Request processed in 32us (2176us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773085.523176:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790773085.523187:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790773085.523192:0:8394:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761495995136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773085.523236:0:8394:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761495995136:12345-0@lo:400:kworker.0 Request processed in 44us (2176us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773085.523241:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790773085.523250:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790773085.523255:0:8394:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f969880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761495994496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773085.523279:0:8394:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f969880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761495994496:12345-0@lo:400:kworker.0 Request processed in 24us (1317us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773085.523284:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790773085.523294:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790773085.523300:0:8394:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f96b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761495995008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773085.523522:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761495993600:0@lo:41:osp-pre-0-1.0 00010000:00080000:2.0:1790773085.523581:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f9e7b80 x1877761495995264/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773101 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773085.523595:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761495995264:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790773085.523608:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f984e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877761495994112:0@lo:400:kworker.0 00010000:00080000:2.0:1790773085.523618:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f984000 x1877761495994624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773101 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773085.523635:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f984000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761495994624:0@lo:400:kworker.0 00010000:00080000:2.0:1790773085.523648:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f987b80 x1877761495995136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773101 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773085.523783:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3604:x1877761495993856:12345-0@lo:400:kworker.0 Request processed in 1132us (4658us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773085.523789:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790773085.523956:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f987b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761495995136:0@lo:400:kworker.0 00000100:00100000:2.0:1790773085.523973:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f987100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3607:1877761495994240:0@lo:400:kworker.0 00000100:00100000:2.0:1790773085.523982:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f986680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3607:1877761495994752:0@lo:400:kworker.0 00010000:00080000:2.0:1790773085.524030:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f987800 x1877761495994496/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773101 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773085.524038:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761495994496:0@lo:400:kworker.0 00000100:00100000:2.0:1790773085.524048:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3604:1877761495993856:0@lo:400:kworker.0 00010000:00080000:2.0:1790773085.524058:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f985500 x1877761495994368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773101 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773085.524065:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f985500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3604:1877761495994368:0@lo:400:kworker.0 00010000:00080000:2.0:1790773085.524076:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f987480 x1877761495994880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773101 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773085.524083:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f987480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3604:1877761495994880:0@lo:400:kworker.0 00000100:00080000:2.0:1790773085.524114:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790773085.524814:0:8394:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f96b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761495995008:12345-0@lo:400:kworker.0 Request processed in 1511us (2801us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773085.524823:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1790773085.525485:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f986300 x1877761495995008/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773101 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773085.525497:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f986300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761495995008:0@lo:400:kworker.0 00010000:00010000:0.0:1790773086.039352:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773086.253080:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773086.253120:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773086.253196:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484397696 00000100:00100000:2.0:1790773086.253227:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484397696 00000100:00100000:2.0:1790773086.253275:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 276 00000100:00100000:2.0:1790773086.253285:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+10:2400:x1877761484397696:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1790773086.253363:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+10:2400:x1877761484397696:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 79us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773086.253370:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 276 00000100:00100000:3.0:1790773086.253751:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773086.253772:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773086.254580:0:8906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484398208 00000100:00100000:2.0:1790773086.254586:0:8906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484398208 00000100:00100000:2.0:1790773086.254627:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 27 00000100:00100000:2.0:1790773086.254635:0:8906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:110130ab-04fa-4d7c-984e-562032df4432+5:2400:x1877761484398208:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1790773086.254794:0:8906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:110130ab-04fa-4d7c-984e-562032df4432+5:2400:x1877761484398208:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 159us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773086.254802:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 27 00000100:00080000:2.0:1790773086.254820:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790773086.260275:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773086.260316:0:8907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484398080 00000100:00100000:0.0:1790773086.260338:0:8907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484398080 00000100:00100000:0.0:1790773086.260396:0:8907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 28 00000100:00100000:0.0:1790773086.260417:0:8907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f96aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:110130ab-04fa-4d7c-984e-562032df4432+5:2400:x1877761484398080:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1790773086.260488:0:8907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f96aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:110130ab-04fa-4d7c-984e-562032df4432+5:2400:x1877761484398080:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 82us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773086.260495:0:8907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 28 00000100:00080000:0.0:1790773086.260520:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790773086.260756:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484397952 00000100:00100000:1.0:1790773086.260762:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484397952 00000100:00100000:1.0:1790773086.260811:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484397824 00000100:00100000:1.0:1790773086.260815:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484397824 00000100:00100000:1.0:1790773086.260835:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 73 00000100:00100000:1.0:1790773086.260842:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+5:2400:x1877761484397952:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773086.260880:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+5:2400:x1877761484397952:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 38us (7759us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773086.260904:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 73 00000100:00100000:1.0:1790773086.260918:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 74 00000100:00100000:1.0:1790773086.260925:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+6:2400:x1877761484397824:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773086.260949:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+6:2400:x1877761484397824:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 25us (7176us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773086.260955:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 74 00000100:00080000:0.0:1790773086.261746:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790773086.261751:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1790773087.054846:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790773087.838251:0:10656:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg219-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1790773088.087293:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773088.593505:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761495995648:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790773088.593595:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773088.593897:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790773088.593907:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761495995776:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790773088.593939:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773088.594025:0:8397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495995648 00000100:00100000:3.0:1790773088.594033:0:8397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495995648 00000100:00080000:1.0:1790773088.594228:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790773088.594270:0:8397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495995776 00000100:00100000:3.0:1790773088.594274:0:8397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495995776 00000100:00100000:3.0:1790773088.594307:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790773088.594316:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761495995648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790773088.594346:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790773088.594398:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761495995648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773088.594406:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790773088.594421:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790773088.594427:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761495995776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790773088.594436:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790773088.594460:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761495995776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 33us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773088.594465:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1790773088.594498:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143e01500 x1877761495995776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773104 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773088.594517:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761495995776:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1790773088.594529:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f9e5c00 x1877761495995648/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773104 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790773088.594608:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790773088.594644:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761495995648:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1790773089.112550:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773090.127602:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773090.637510:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790773090.637542:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f969c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761495995904:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790773090.637608:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773090.637683:0:7666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495995904 00000100:00100000:0.0:1790773090.637690:0:7666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495995904 00000100:00100000:0.0:1790773090.637729:0:7666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790773090.637736:0:7666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761495995904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790773090.637767:0:7666:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1790773090.637809:0:7666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761495995904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773090.637816:0:7666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790773090.637856:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f969c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761495995904:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790773090.638399:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790773090.638410:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f969c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761495996160:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790773090.638454:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773090.638479:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761495996032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790773090.638503:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773090.638526:0:8397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495996032 00000100:00100000:0.0:1790773090.638530:0:8397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495996032 00000100:00100000:0.0:1790773090.638563:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790773090.638570:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761495996032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790773090.638592:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790773090.638621:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761495996032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773090.638628:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1790773090.638657:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143cac380 x1877761495996032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773106 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773090.638697:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761495996032:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790773090.638899:0:6484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495996160 00000100:00100000:1.0:1790773090.638903:0:6484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495996160 00000100:00100000:1.0:1790773090.638927:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790773090.638933:0:6484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761495996160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790773090.638953:0:6484:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1790773090.638984:0:6484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761495996160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 52us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773090.638990:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1790773090.639005:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790773090.639052:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790773090.639062:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761495996288:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790773090.639088:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773090.643334:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3606:1877761495996672:0@lo:400:kworker.0 00000100:00100000:2.0:1790773090.643417:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773090.643448:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761495997184:0@lo:400:kworker.0 00000100:00100000:2.0:1790773090.643472:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773090.643500:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1790773090.643518:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f986300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3606:1877761495996800:0@lo:400:kworker.0 00000100:00100000:2.0:1790773090.643543:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773090.643559:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f986680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3606:1877761495997312:0@lo:400:kworker.0 00000100:00100000:2.0:1790773090.643580:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773090.643608:0:8394:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495997184 00000100:00100000:2.0:1790773090.643615:0:8394:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495997184 00000100:00100000:2.0:1790773090.643665:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790773090.643713:0:8394:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f984000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761495997184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773090.643769:0:8394:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f984000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761495997184:12345-0@lo:400:kworker.0 Request processed in 58us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773090.643777:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1790773090.643824:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f987800 x1877761495997184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773090.643839:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761495997184:0@lo:400:kworker.0 00000100:00100000:1.0:1790773090.644009:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495996672 00000100:00100000:1.0:1790773090.644014:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495996672 00000100:00100000:1.0:1790773090.644050:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495996800 00000100:00100000:1.0:1790773090.644053:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495996800 00000100:00100000:1.0:1790773090.644066:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495997312 00000100:00100000:1.0:1790773090.644076:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495997312 00000100:00100000:1.0:1790773090.644092:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790773090.644099:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f987b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1877761495996672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773090.644143:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f987b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1877761495996672:12345-0@lo:400:kworker.0 Request processed in 44us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773090.644150:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790773090.644163:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790773090.644169:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f984e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1877761495996800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773090.644196:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f984e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1877761495996800:12345-0@lo:400:kworker.0 Request processed in 27us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773090.644223:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790773090.644236:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790773090.644242:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f974700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3606:x1877761495997312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773090.644269:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f974700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3606:x1877761495997312:12345-0@lo:400:kworker.0 Request processed in 27us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773090.644275:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790773090.644299:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce0675b4-b0c5-48e7-b182-565e22fed04c:3604:1877761495996416:0@lo:400:kworker.0 00000100:00100000:1.0:1790773090.644331:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773090.644370:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f987480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3604:1877761495996928:0@lo:400:kworker.0 00000100:00100000:1.0:1790773090.644392:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773090.644407:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f987100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3604:1877761495997440:0@lo:400:kworker.0 00000100:00100000:1.0:1790773090.644438:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773090.644459:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1790773090.644466:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3604:1877761495996544:0@lo:400:kworker.0 00000100:00100000:1.0:1790773090.644486:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773090.644507:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f985500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761495997056:0@lo:400:kworker.0 00000100:00100000:1.0:1790773090.644528:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773090.644554:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495996416 00000100:00100000:1.0:1790773090.644558:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495996416 00000100:00100000:1.0:1790773090.644587:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1790773090.644593:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3604:x1877761495996416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773090.644626:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3604:x1877761495996416:12345-0@lo:400:kworker.0 Request processed in 32us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773090.644633:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1790773090.644657:0:8392:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495997056 00000100:00100000:1.0:1790773090.644661:0:8392:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495997056 00000100:00100000:1.0:1790773090.644699:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790773090.644705:0:8392:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761495997056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773090.644733:0:8392:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761495997056:12345-0@lo:400:kworker.0 Request processed in 29us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773090.644739:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790773090.644757:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495996928 00000100:00100000:1.0:1790773090.644760:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495996928 00000100:00100000:1.0:1790773090.644774:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495997440 00000100:00100000:1.0:1790773090.644776:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495997440 00000100:00100000:1.0:1790773090.644786:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495996544 00000100:00100000:1.0:1790773090.644788:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495996544 00000100:00100000:1.0:1790773090.644801:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1790773090.644806:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3604:x1877761495996928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773090.644834:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3604:x1877761495996928:12345-0@lo:400:kworker.0 Request processed in 28us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773090.644841:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1790773090.644851:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1790773090.644863:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3604:x1877761495997440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773090.644889:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3604:x1877761495997440:12345-0@lo:400:kworker.0 Request processed in 27us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773090.644895:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1790773090.644905:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1790773090.644910:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3604:x1877761495996544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773090.644933:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3604:x1877761495996544:12345-0@lo:400:kworker.0 Request processed in 23us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773090.644939:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:1.0:1790773090.644956:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790773090.644960:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790773090.644964:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790773090.644974:0:8397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495996288 00000100:00100000:1.0:1790773090.644977:0:8397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495996288 00000100:00100000:1.0:1790773090.645003:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790773090.645010:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143caf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761495996288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790773090.645024:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790773090.645053:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143caf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761495996288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (5963us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773090.645059:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1790773090.645072:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790773090.645092:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3604:1877761495996544:0@lo:400:kworker.0 00010000:00080000:1.0:1790773090.645103:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f985500 x1877761495997056/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773090.645113:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f985500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761495997056:0@lo:400:kworker.0 00000100:00100000:1.0:1790773090.645120:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce0675b4-b0c5-48e7-b182-565e22fed04c:3604:1877761495996416:0@lo:400:kworker.0 00010000:00080000:1.0:1790773090.645139:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f987480 x1877761495996928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773090.645146:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f987480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3604:1877761495996928:0@lo:400:kworker.0 00010000:00080000:1.0:1790773090.645155:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f987100 x1877761495997440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773090.645162:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f987100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3604:1877761495997440:0@lo:400:kworker.0 00000100:00100000:1.0:1790773090.645199:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f986300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3606:1877761495996800:0@lo:400:kworker.0 00000100:00100000:1.0:1790773090.645231:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f986680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3606:1877761495997312:0@lo:400:kworker.0 00000100:00100000:1.0:1790773090.645243:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3606:1877761495996672:0@lo:400:kworker.0 00010000:00080000:1.0:1790773090.645255:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f9e5c00 x1877761495996288/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773106 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773090.645268:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761495996288:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790773090.645455:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f969c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761495996160:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1790773091.150567:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773091.382039:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773091.382085:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773091.382114:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773091.382140:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773091.382167:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773091.382225:0:8393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484398848 00000100:00100000:1.0:1790773091.382236:0:8393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484398848 00000100:00100000:1.0:1790773091.382292:0:8393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484398720 00000100:00100000:1.0:1790773091.382295:0:8393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484398720 00000100:00100000:1.0:1790773091.382318:0:8393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 31 00000100:00100000:1.0:1790773091.382329:0:8393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:110130ab-04fa-4d7c-984e-562032df4432+5:2398:x1877761484398848:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1790773091.382590:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484398336 00000100:00100000:2.0:1790773091.382596:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484398336 00000100:00100000:2.0:1790773091.382630:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 278 00000100:00100000:2.0:1790773091.382637:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c696050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+10:2398:x1877761484398336:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1790773091.382726:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c696050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+10:2398:x1877761484398336:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 89us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773091.382734:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 278 00000100:00100000:2.0:1790773091.382779:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 32 00000100:00100000:2.0:1790773091.382788:0:8394:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:110130ab-04fa-4d7c-984e-562032df4432+5:2398:x1877761484398720:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1790773091.382815:0:8394:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:110130ab-04fa-4d7c-984e-562032df4432+5:2398:x1877761484398720:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 28us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773091.382831:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 32 00000100:00100000:1.0:1790773091.383054:0:8393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:110130ab-04fa-4d7c-984e-562032df4432+5:2398:x1877761484398848:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 727us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773091.383062:0:8393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 31 00000100:00100000:1.0:1790773091.383083:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484398592 00000100:00100000:1.0:1790773091.383088:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484398592 00000100:00100000:1.0:1790773091.383116:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484398464 00000100:00100000:1.0:1790773091.383119:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484398464 00000100:00100000:1.0:1790773091.383139:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 81 00000100:00100000:1.0:1790773091.383145:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+5:2398:x1877761484398592:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773091.383174:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+5:2398:x1877761484398592:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 29us (1089us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773091.383191:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 81 00000100:00100000:1.0:1790773091.383224:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 82 00000100:00100000:1.0:1790773091.383231:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+6:2398:x1877761484398464:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773091.383259:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+6:2398:x1877761484398464:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 28us (1118us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773091.383265:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 82 00000100:00080000:1.0:1790773091.383282:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790773091.383286:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790773091.383289:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790773091.383291:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1790773092.173507:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773093.205932:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773093.709762:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761495997568:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790773093.709871:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773093.710500:0:8397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495997568 00000100:00100000:1.0:1790773093.710510:0:8397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495997568 00000100:00100000:1.0:1790773093.710566:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790773093.710579:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761495997568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790773093.710624:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790773093.710696:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761495997568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773093.710703:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1790773093.710728:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790773093.710767:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143e01500 x1877761495997568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773109 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773093.710789:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761495997568:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790773093.710854:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790773093.710865:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761495997696:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790773093.710899:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773093.711516:0:8397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495997696 00000100:00100000:1.0:1790773093.711524:0:8397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495997696 00000100:00100000:1.0:1790773093.711585:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790773093.711594:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761495997696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790773093.711612:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790773093.711683:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761495997696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773093.711690:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1790773093.711727:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143ce2a00 x1877761495997696/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773109 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773093.711742:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761495997696:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1790773093.711846:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:1.0:1790773093.733873:0:10900:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg219-server.virtnet: executing yml_node 00010000:00010000:2.0:1790773094.226302:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773095.245552:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773095.757947:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761495997952:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790773095.758021:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773095.758097:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790773095.758104:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761495998080:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790773095.758127:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773095.758195:0:6484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495997952 00000100:00100000:1.0:1790773095.758221:0:6484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495997952 00000100:00100000:1.0:1790773095.758668:0:6484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495998080 00000100:00100000:1.0:1790773095.758674:0:6484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495998080 00000100:00100000:1.0:1790773095.758693:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790773095.758702:0:6484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761495997952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790773095.758738:0:6484:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1790773095.758789:0:6484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761495997952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773095.758795:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790773095.758814:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1790773095.758820:0:6484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761495998080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790773095.758838:0:6484:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1790773095.758866:0:6484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761495998080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 46us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773095.758872:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1790773095.758924:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761495998080:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790773095.758939:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761495997952:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790773095.759152:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761495998208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790773095.759202:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773095.759551:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3604:1877761495998464:0@lo:400:kworker.0 00000100:00100000:0.0:1790773095.759585:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773095.759647:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790773095.759653:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3604:1877761495998592:0@lo:400:kworker.0 00000100:00100000:0.0:1790773095.759675:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773095.759703:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495998464 00000100:00100000:0.0:1790773095.759708:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495998464 00000100:00100000:0.0:1790773095.759737:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495998592 00000100:00100000:0.0:1790773095.759739:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495998592 00000100:00100000:0.0:1790773095.759755:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1790773095.759761:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3604:x1877761495998464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773095.759800:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3604:x1877761495998464:12345-0@lo:400:kworker.0 Request processed in 39us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773095.759806:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1790773095.759819:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1790773095.759825:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3604:x1877761495998592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773095.759850:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3604:x1877761495998592:12345-0@lo:400:kworker.0 Request processed in 25us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773095.759855:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1790773095.759880:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3604:1877761495998592:0@lo:400:kworker.0 00000100:00100000:0.0:1790773095.759909:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3604:1877761495998464:0@lo:400:kworker.0 00000100:00100000:0.0:1790773095.759951:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761495998976:0@lo:400:kworker.0 00000100:00100000:0.0:1790773095.759975:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773095.760003:0:8907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495998976 00000100:00100000:0.0:1790773095.760007:0:8907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495998976 00000100:00100000:3.0:1790773095.760031:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761495997824:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790773095.760043:0:8907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790773095.760048:0:8907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761495998976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773095.760079:0:8907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761495998976:12345-0@lo:400:kworker.0 Request processed in 31us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773095.760085:0:8907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1790773095.760100:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790773095.760121:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143cc5180 x1877761495998976/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773095.760131:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761495998976:0@lo:400:kworker.0 00000100:00100000:0.0:1790773095.760155:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790773095.760160:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761495999104:0@lo:400:kworker.0 00000100:00100000:0.0:1790773095.760185:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773095.760240:0:8906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495999104 00000100:00100000:0.0:1790773095.760244:0:8906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495999104 00000100:00100000:0.0:1790773095.760284:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790773095.760290:0:8906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d280b78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761495999104:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1790773095.760342:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790773095.760735:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3606:1877761495998720:0@lo:400:kworker.0 00000100:00100000:2.0:1790773095.760765:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773095.760792:0:8397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495998208 00000100:00100000:3.0:1790773095.760797:0:8397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495998208 00000100:00100000:2.0:1790773095.760801:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773095.760821:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce0675b4-b0c5-48e7-b182-565e22fed04c:3607:1877761495998336:0@lo:400:kworker.0 00000100:00100000:3.0:1790773095.760824:0:8397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495997824 00000100:00100000:3.0:1790773095.760827:0:8397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495997824 00000100:00100000:3.0:1790773095.760840:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790773095.760846:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f976300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761495998208:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790773095.760850:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1790773095.760868:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790773095.760874:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3607:1877761495998848:0@lo:400:kworker.0 00000100:00100000:2.0:1790773095.760893:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773095.760904:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f976300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761495998208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (1703us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773095.760911:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790773095.760923:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1790773095.760925:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143ce1f80 x1877761495998208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773111 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773095.760929:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f977800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761495997824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790773095.760939:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790773095.760941:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761495998208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790773095.760973:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f977800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761495997824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (171us total) trans 0 rc 0/0 00000100:00080000:2.0:1790773095.760973:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790773095.760979:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1790773095.760991:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143ce2a00 x1877761495997824/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773111 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773095.760994:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495998720 00000100:00100000:3.0:1790773095.760997:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495998720 00000100:00100000:2.0:1790773095.761004:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761495997824:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790773095.761022:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495998848 00000100:00080000:2.0:1790773095.761023:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790773095.761025:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495998848 00000100:00100000:2.0:1790773095.761037:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790773095.761044:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1877761495998720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773095.762014:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1790773095.762043:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1877761495998848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773095.762115:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1877761495998848:12345-0@lo:400:kworker.0 Request processed in 76us (1220us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773095.762122:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:3.0:1790773095.762158:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1790773095.762188:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143cc7100 x1877761495998848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773095.762199:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3607:1877761495998848:0@lo:400:kworker.0 00000100:00100000:3.0:1790773095.762286:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790773095.762296:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3607:1877761495999232:0@lo:400:kworker.0 00000100:00100000:3.0:1790773095.762326:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773095.762352:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495999232 00000100:00100000:3.0:1790773095.762356:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495999232 00000100:00100000:3.0:1790773095.762396:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1790773095.762402:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1877761495999232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773095.762436:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1877761495999232:12345-0@lo:400:kworker.0 Request processed in 33us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773095.762442:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:3.0:1790773095.762470:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790773095.762490:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3607:1877761495999232:0@lo:400:kworker.0 00000100:00100000:3.0:1790773095.762522:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3607:1877761495999360:0@lo:400:kworker.0 00000100:00100000:3.0:1790773095.762545:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773095.762568:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495999360 00000100:00100000:3.0:1790773095.762572:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495999360 00000100:00100000:3.0:1790773095.762592:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1790773095.762598:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1877761495999360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773095.762662:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1877761495999360:12345-0@lo:400:kworker.0 Request processed in 63us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773095.762668:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1790773095.762672:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495998336 00000100:00100000:1.0:1790773095.762677:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495998336 00000100:00080000:3.0:1790773095.762681:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1790773095.762696:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143e00000 x1877761495999360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773095.762706:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3607:1877761495999360:0@lo:400:kworker.0 00000100:00100000:1.0:1790773095.762706:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1790773095.762713:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c696850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3607:x1877761495998336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773095.762754:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c696850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3607:x1877761495998336:12345-0@lo:400:kworker.0 Request processed in 41us (1901us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773095.762761:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1790773095.762776:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce0675b4-b0c5-48e7-b182-565e22fed04c:3607:1877761495998336:0@lo:400:kworker.0 00000100:00100000:2.0:1790773095.762899:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1877761495998720:12345-0@lo:400:kworker.0 Request processed in 1856us (2132us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773095.762912:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1790773095.763293:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3606:1877761495998720:0@lo:400:kworker.0 00000100:00100000:0.0:1790773095.763738:0:8906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d280b78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761495999104:12345-0@lo:400:kworker.0 Request processed in 3446us (3549us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773095.763749:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1790773095.764029:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143cc5180 x1877761495999104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773095.764041:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761495999104:0@lo:400:kworker.0 00010000:00010000:1.0:1790773096.269682:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773096.495973:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773096.496020:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773096.496063:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773096.496182:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484399232 00000100:00100000:0.0:1790773096.496241:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484399232 00000100:00100000:0.0:1790773096.496320:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484399104 00000100:00100000:0.0:1790773096.496324:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484399104 00000100:00100000:0.0:1790773096.496348:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 89 00000100:00100000:0.0:1790773096.496358:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+5:2399:x1877761484399232:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1790773096.496432:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+5:2399:x1877761484399232:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 75us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773096.496441:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 89 00000100:00100000:0.0:1790773096.496459:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 90 00000100:00100000:0.0:1790773096.496465:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+6:2399:x1877761484399104:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1790773096.496492:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+6:2399:x1877761484399104:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 27us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773096.496498:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 90 00000100:00080000:1.0:1790773096.496679:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790773096.496683:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790773096.496792:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484398976 00000100:00100000:2.0:1790773096.496798:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484398976 00000100:00100000:2.0:1790773096.496840:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 280 00000100:00100000:2.0:1790773096.496846:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c694c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+10:2399:x1877761484398976:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1790773096.496874:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c694c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+10:2399:x1877761484398976:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 28us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773096.496879:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 280 00000100:00100000:2.0:1790773096.498842:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773096.498881:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773096.498960:0:8907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484399360 00000100:00100000:0.0:1790773096.498969:0:8907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484399360 00000100:00100000:0.0:1790773096.499032:0:8907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484399488 00000100:00100000:0.0:1790773096.499036:0:8907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484399488 00000100:00100000:0.0:1790773096.499059:0:8907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 18 00000100:00100000:0.0:1790773096.499068:0:8907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f974a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:110130ab-04fa-4d7c-984e-562032df4432+5:2396:x1877761484399360:12345-192.168.202.19@tcp:9:kworker.0 00000020:00000080:0.0:1790773096.499108:0:8907:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc784192e 00000100:00080000:0.0:1790773096.499117:0:8907:0:(import.c:65:import_set_state_nolock()) ffff93d141cea000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790773096.499170:0:8907:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1790773096.499438:0:8907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f974a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:110130ab-04fa-4d7c-984e-562032df4432+2:2396:x1877761484399360:12345-192.168.202.19@tcp:9:kworker.0 Request processed in 369us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773096.499447:0:8907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 18 00000100:00100000:0.0:1790773096.499463:0:8907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 19 00000100:00100000:0.0:1790773096.499470:0:8907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f977100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:110130ab-04fa-4d7c-984e-562032df4432+5:2396:x1877761484399488:12345-192.168.202.19@tcp:9:kworker.0 00000020:00000080:0.0:1790773096.499499:0:8907:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7841935 00000100:00080000:0.0:1790773096.499506:0:8907:0:(import.c:65:import_set_state_nolock()) ffff93d143270800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790773096.499528:0:8907:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1790773096.499595:0:8907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f977100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:110130ab-04fa-4d7c-984e-562032df4432+2:2396:x1877761484399488:12345-192.168.202.19@tcp:9:kworker.0 Request processed in 126us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773096.499602:0:8907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 19 00010000:00010000:0.0:1790773096.499629:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773096.499635:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790773096.499743:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790773096.499748:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790773097.295137:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790773097.509425:0:11084:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.59.4 00010000:00010000:0.0:1790773098.319567:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773098.829540:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761495999488:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790773098.829647:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773098.829846:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495999488 00000100:00100000:2.0:1790773098.829855:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495999488 00000100:00100000:2.0:1790773098.829931:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790773098.829942:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761495999488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790773098.829974:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1790773098.830079:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790773098.834820:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761495999616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790773098.834911:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773098.835100:0:8397:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1790773098.835109:0:8397:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:1.0:1790773098.835685:0:8397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495999616 00000100:00100000:1.0:1790773098.835695:0:8397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495999616 00000100:00080000:1.0:1790773098.835753:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790773098.835878:0:11145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790773098.835890:0:11145:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761495999616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790773098.835933:0:11145:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790773098.836007:0:11145:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761495999616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773098.836015:0:11145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1790773098.836152:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143e00000 x1877761495999616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773114 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773098.836173:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761495999616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790773098.837031:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761495999488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 7087us (7379us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773098.837041:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1790773098.837567:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143ce3480 x1877761495999488/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773114 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773098.837600:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761495999488:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1790773099.345984:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790773100.003616:0:11182:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.59.4 00010000:00010000:1.0:1790773100.365496:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773100.880103:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496000000:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790773100.880193:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773100.880284:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790773100.880434:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496000128:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790773100.880463:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773100.880506:0:7666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496000000 00000100:00100000:1.0:1790773100.880513:0:7666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496000000 00000100:00100000:1.0:1790773100.880554:0:7666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496000128 00000100:00100000:1.0:1790773100.880557:0:7666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496000128 00000100:00100000:1.0:1790773100.880586:0:7666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790773100.880595:0:7666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496000000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790773100.880649:0:7666:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1790773100.880697:0:7666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496000000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773100.880705:0:7666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790773100.880737:0:7666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790773100.880745:0:7666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496000128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790773100.880763:0:7666:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1790773100.880792:0:7666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496000128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 48us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773100.880977:0:7666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790773100.881030:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496000128:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790773100.881049:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496000000:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790773100.881403:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761495999872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790773100.881442:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773100.881466:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790773100.881473:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f984000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761495999744:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790773100.881498:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773100.881585:0:8397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495999872 00000100:00100000:1.0:1790773100.881590:0:8397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495999872 00000100:00100000:1.0:1790773100.881640:0:8397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761495999744 00000100:00100000:1.0:1790773100.881643:0:8397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761495999744 00000100:00100000:1.0:1790773100.881660:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790773100.881666:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761495999872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790773100.881688:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1790773100.881923:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1790773100.881950:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143cc5880 x1877761495999872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773116 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773100.881968:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761495999872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790773100.882006:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761495999872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773100.882014:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790773100.882029:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790773100.882036:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761495999744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790773100.882046:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790773100.882131:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761495999744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773100.882137:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790773100.883334:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f987100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3604:1877761496000512:0@lo:400:kworker.0 00000100:00100000:1.0:1790773100.883387:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773100.883421:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143c7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496001024:0@lo:400:kworker.0 00000100:00100000:1.0:1790773100.883445:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773100.883471:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1790773100.883477:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f987480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3604:1877761496000640:0@lo:400:kworker.0 00000100:00100000:1.0:1790773100.883501:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773100.883516:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143c7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3604:1877761496001152:0@lo:400:kworker.0 00000100:00100000:1.0:1790773100.883535:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773100.883580:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f986680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce0675b4-b0c5-48e7-b182-565e22fed04c:3606:1877761496000256:0@lo:400:kworker.0 00000100:00100000:1.0:1790773100.883618:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773100.883647:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f985500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3606:1877761496000768:0@lo:400:kworker.0 00000100:00100000:1.0:1790773100.883669:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773100.883685:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143c7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3606:1877761496001280:0@lo:400:kworker.0 00000100:00100000:1.0:1790773100.883705:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773100.883716:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790773100.883734:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f986300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3606:1877761496000384:0@lo:400:kworker.0 00000100:00100000:1.0:1790773100.883755:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773100.883765:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496000896:0@lo:400:kworker.0 00000100:00100000:1.0:1790773100.883784:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773100.884110:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496000256 00000100:00100000:1.0:1790773100.884118:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496000256 00000100:00100000:1.0:1790773100.884184:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1790773100.884193:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c695450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3606:x1877761496000256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773100.884420:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c695450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3606:x1877761496000256:12345-0@lo:400:kworker.0 Request processed in 227us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773100.884428:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1790773100.884479:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f986680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce0675b4-b0c5-48e7-b182-565e22fed04c:3606:1877761496000256:0@lo:400:kworker.0 00000100:00100000:2.0:1790773100.884561:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496000512 00000100:00100000:2.0:1790773100.884566:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496000512 00000100:00100000:2.0:1790773100.884601:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496000640 00000100:00100000:2.0:1790773100.884604:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496000640 00000100:00100000:2.0:1790773100.884646:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496001152 00000100:00100000:2.0:1790773100.884650:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496001152 00000100:00100000:2.0:1790773100.884661:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496000768 00000100:00100000:2.0:1790773100.884663:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496000768 00000100:00100000:2.0:1790773100.884674:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496001280 00000100:00100000:2.0:1790773100.884676:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496001280 00000100:00100000:2.0:1790773100.884685:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496000384 00000100:00100000:2.0:1790773100.884687:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496000384 00000100:00100000:2.0:1790773100.884699:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1790773100.884705:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3604:x1877761496000512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773100.884764:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3604:x1877761496000512:12345-0@lo:400:kworker.0 Request processed in 59us (1377us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773100.884772:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1790773100.884787:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1790773100.884793:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3604:x1877761496000640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773100.884989:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3604:x1877761496000640:12345-0@lo:400:kworker.0 Request processed in 195us (1486us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773100.884996:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1790773100.885009:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1790773100.885015:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3604:x1877761496001152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773100.885039:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3604:x1877761496001152:12345-0@lo:400:kworker.0 Request processed in 25us (1503us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773100.885043:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1790773100.885053:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1790773100.885058:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1877761496000768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773100.885087:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1877761496000768:12345-0@lo:400:kworker.0 Request processed in 29us (1418us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773100.885103:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1790773100.885115:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1790773100.885122:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3606:x1877761496001280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773100.885152:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3606:x1877761496001280:12345-0@lo:400:kworker.0 Request processed in 33us (1447us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773100.885158:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1790773100.885181:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1790773100.885186:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1877761496000384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773100.885244:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1877761496000384:12345-0@lo:400:kworker.0 Request processed in 56us (1486us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773100.885249:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1790773100.885460:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f987480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3604:1877761496000640:0@lo:400:kworker.0 00000100:00100000:2.0:1790773100.885476:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143c7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3604:1877761496001152:0@lo:400:kworker.0 00000100:00100000:2.0:1790773100.885486:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f987100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3604:1877761496000512:0@lo:400:kworker.0 00000100:00100000:2.0:1790773100.885518:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f986300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3606:1877761496000384:0@lo:400:kworker.0 00010000:00080000:2.0:1790773100.885532:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f985500 x1877761496000768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773100.885543:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f985500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3606:1877761496000768:0@lo:400:kworker.0 00010000:00080000:2.0:1790773100.885554:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143c7d500 x1877761496001280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773100.885562:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143c7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3606:1877761496001280:0@lo:400:kworker.0 00000100:00080000:1.0:1790773100.887023:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790773100.887032:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790773100.887474:0:8907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496001024 00000100:00100000:1.0:1790773100.887486:0:8907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496001024 00000100:00100000:1.0:1790773100.887537:0:8907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496000896 00000100:00100000:1.0:1790773100.887540:0:8907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496000896 00000100:00100000:1.0:1790773100.887566:0:8907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790773100.887588:0:8907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496001024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773100.887679:0:8907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496001024:12345-0@lo:400:kworker.0 Request processed in 105us (4232us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773100.887687:0:8907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790773100.887704:0:8907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790773100.887712:0:8907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496000896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773100.887760:0:8907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496000896:12345-0@lo:400:kworker.0 Request processed in 50us (3975us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773100.887766:0:8907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1790773100.889144:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790773100.889336:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143c7dc00 x1877761496001024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773100.889352:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143c7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496001024:0@lo:400:kworker.0 00010000:00080000:0.0:1790773100.890533:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f984000 x1877761495999744/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773116 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773100.890567:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f984000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761495999744:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1790773100.890953:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f987800 x1877761496000896/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773100.890972:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496000896:0@lo:400:kworker.0 00010000:00010000:0.0:1790773101.390238:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773101.615874:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773101.615923:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773101.615965:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773101.617693:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484399616 00000100:00100000:0.0:1790773101.617710:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484399616 00000100:00100000:0.0:1790773101.617799:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 282 00000100:00100000:0.0:1790773101.617810:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c697850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+10:2400:x1877761484399616:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1790773101.617888:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c697850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+10:2400:x1877761484399616:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 80us (2024us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773101.617897:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 282 00000100:00100000:1.0:1790773101.626747:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484399872 00000100:00100000:1.0:1790773101.626776:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484399872 00000100:00100000:1.0:1790773101.626879:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484399744 00000100:00100000:1.0:1790773101.626882:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484399744 00000100:00100000:1.0:1790773101.626921:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 97 00000100:00100000:1.0:1790773101.626933:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143c7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+5:2400:x1877761484399872:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773101.627049:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143c7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+5:2400:x1877761484399872:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 118us (11125us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773101.627056:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 97 00000100:00100000:1.0:1790773101.627075:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 98 00000100:00100000:1.0:1790773101.627082:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143c7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+6:2400:x1877761484399744:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773101.627109:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143c7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+6:2400:x1877761484399744:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 27us (11143us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773101.627115:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 98 00000100:00080000:2.0:1790773101.627545:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790773101.627551:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1790773102.413510:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790773102.417135:0:9475:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 110130ab-04fa-4d7c-984e-562032df4432 00000020:00000080:1.0:1790773102.417147:0:9475:0:(genops.c:885:class_export_put()) final put ffff93d143273800/110130ab-04fa-4d7c-984e-562032df4432 00000020:00000080:1.0:1790773102.417181:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d143273800/110130ab-04fa-4d7c-984e-562032df4432 for lustre-OST0001 00000020:00000080:1.0:1790773102.417263:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d143270800 for lustre-OST0001 00000001:00100000:1.0:1790773102.420070:0:8388:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 110130ab-04fa-4d7c-984e-562032df4432 00000020:00000080:1.0:1790773102.420080:0:8388:0:(genops.c:885:class_export_put()) final put ffff93d141ceb800/110130ab-04fa-4d7c-984e-562032df4432 00000020:00000080:3.0:1790773102.420313:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93d141ceb800/110130ab-04fa-4d7c-984e-562032df4432 for lustre-OST0000 00000020:00000080:3.0:1790773102.420427:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d141cea000 for lustre-OST0000 00000001:02000400:2.0:1790773102.574535:0:11279:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.59.4 00010000:00010000:1.0:1790773103.437477:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773103.953846:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143c7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496001408:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790773103.953941:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773103.954074:0:8397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496001408 00000100:00100000:2.0:1790773103.954084:0:8397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496001408 00000100:00100000:2.0:1790773103.954154:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790773103.954164:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496001408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790773103.954195:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790773103.954273:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496001408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773103.954282:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790773103.956044:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496001536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790773103.956127:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773103.956438:0:11145:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496001536 00000100:00100000:3.0:1790773103.956447:0:11145:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496001536 00000100:00100000:3.0:1790773103.956502:0:11145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790773103.956511:0:11145:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496001536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790773103.956533:0:11145:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790773103.956590:0:11145:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496001536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773103.956598:0:11145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1790773103.957733:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790773103.957922:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143c7f100 x1877761496001408/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773119 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773103.957947:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143c7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496001408:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1790773103.958657:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143e01880 x1877761496001536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773119 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773103.958675:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496001536:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1790773104.466643:0:11327:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Wed Sep 30 08:58:22 EDT 2026 00010000:00010000:0.0:1790773104.468597:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773105.485477:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773105.997386:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496001664:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790773105.997475:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773105.997570:0:7666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496001664 00000100:00100000:1.0:1790773105.997579:0:7666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496001664 00000100:00100000:1.0:1790773105.997624:0:7666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790773105.997633:0:7666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496001664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790773105.997676:0:7666:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1790773105.997724:0:7666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496001664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773105.997731:0:7666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790773105.997783:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496001664:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790773105.998131:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496001792:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790773105.998168:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773105.998190:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790773105.998197:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496001920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790773105.998241:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773105.998271:0:6484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496001792 00000100:00100000:0.0:1790773105.998275:0:6484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496001792 00000100:00100000:0.0:1790773105.998300:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1790773105.998316:0:6484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496001792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790773105.998337:0:6484:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1790773105.998376:0:6484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496001792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773105.998383:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1790773105.998407:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496001920 00000100:00100000:0.0:1790773105.998411:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496001920 00000100:00100000:0.0:1790773105.998444:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790773105.998452:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496001920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790773105.998472:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790773105.998500:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496001920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773105.998506:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1790773105.998867:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1790773105.998899:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143cc4e00 x1877761496001920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773121 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773105.998915:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496001920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790773105.998928:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496001792:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790773105.999064:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790773105.999075:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496002048:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790773105.999108:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773105.999199:0:8397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496002048 00000100:00100000:1.0:1790773105.999228:0:8397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496002048 00000100:00100000:1.0:1790773105.999270:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790773105.999277:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496002048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790773105.999288:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790773105.999320:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496002048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773105.999327:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1790773105.999414:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f9e5500 x1877761496002048/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773121 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773105.999427:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496002048:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1790773105.999481:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790773106.002869:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877761496002432:0@lo:400:kworker.0 00000100:00100000:3.0:1790773106.002939:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773106.002972:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496002944:0@lo:400:kworker.0 00000100:00100000:3.0:1790773106.002998:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773106.003027:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1790773106.003033:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3607:1877761496002304:0@lo:400:kworker.0 00000100:00100000:3.0:1790773106.003054:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773106.003070:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496002816:0@lo:400:kworker.0 00000100:00100000:3.0:1790773106.003088:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773106.003116:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496002432 00000100:00100000:3.0:1790773106.003125:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496002432 00000100:00100000:3.0:1790773106.003165:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496002304 00000100:00100000:3.0:1790773106.003180:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496002304 00000100:00100000:3.0:1790773106.003224:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1790773106.003233:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877761496002432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773106.003286:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877761496002432:12345-0@lo:400:kworker.0 Request processed in 53us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773106.003293:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1790773106.003310:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1790773106.003316:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1877761496002304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773106.003344:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1877761496002304:12345-0@lo:400:kworker.0 Request processed in 28us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773106.003350:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1790773106.003367:0:8394:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496002944 00000100:00100000:3.0:1790773106.003370:0:8394:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496002944 00000100:00100000:3.0:1790773106.003400:0:8394:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496002816 00000100:00100000:3.0:1790773106.003403:0:8394:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496002816 00000100:00100000:3.0:1790773106.003421:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790773106.003427:0:8394:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496002944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773106.003457:0:8394:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496002944:12345-0@lo:400:kworker.0 Request processed in 30us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773106.003463:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790773106.003474:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790773106.003479:0:8394:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496002816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773106.003502:0:8394:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496002816:12345-0@lo:400:kworker.0 Request processed in 23us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773106.003507:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790773106.003552:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3604:1877761496002560:0@lo:400:kworker.0 00000100:00100000:3.0:1790773106.004715:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773106.004756:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3604:1877761496003072:0@lo:400:kworker.0 00000100:00100000:3.0:1790773106.004777:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773106.006085:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3607:1877761496002304:0@lo:400:kworker.0 00010000:00080000:2.0:1790773106.006105:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143e00000 x1877761496002816/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773122 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773106.006117:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496002816:0@lo:400:kworker.0 00000100:00100000:2.0:1790773106.006129:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877761496002432:0@lo:400:kworker.0 00010000:00080000:2.0:1790773106.006140:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143e00e00 x1877761496002944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773122 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773106.006150:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496002944:0@lo:400:kworker.0 00000100:00100000:2.0:1790773106.006187:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce0675b4-b0c5-48e7-b182-565e22fed04c:3605:1877761496002176:0@lo:400:kworker.0 00000100:00100000:2.0:1790773106.006280:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773106.006314:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3605:1877761496002688:0@lo:400:kworker.0 00000100:00100000:2.0:1790773106.006349:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496002176 00000100:00100000:2.0:1790773106.006354:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496002176 00000100:00100000:2.0:1790773106.006402:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1790773106.006411:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c696c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3605:x1877761496002176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773106.006462:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c696c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3605:x1877761496002176:12345-0@lo:400:kworker.0 Request processed in 51us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773106.006468:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00080000:2.0:1790773106.006543:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790773106.008279:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773106.012963:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3605:1877761496003200:0@lo:400:kworker.0 00000100:00100000:2.0:1790773106.013044:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773106.016810:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496002560 00000100:00100000:0.0:1790773106.016829:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496002560 00000100:00100000:0.0:1790773106.016951:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496003072 00000100:00100000:0.0:1790773106.016956:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496003072 00000100:00100000:0.0:1790773106.016976:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496002688 00000100:00100000:0.0:1790773106.016979:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496002688 00000100:00100000:0.0:1790773106.016995:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1790773106.017005:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14378e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3604:x1877761496002560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773106.017144:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14378e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3604:x1877761496002560:12345-0@lo:400:kworker.0 Request processed in 140us (12429us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773106.017153:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1790773106.017170:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1790773106.017177:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14378ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3604:x1877761496003072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773106.017225:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14378ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3604:x1877761496003072:12345-0@lo:400:kworker.0 Request processed in 49us (12446us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773106.017231:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1790773106.017242:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1790773106.017248:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143c7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3605:x1877761496002688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773106.017276:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143c7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3605:x1877761496002688:12345-0@lo:400:kworker.0 Request processed in 29us (9004us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773106.017282:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1790773106.022515:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3604:1877761496002560:0@lo:400:kworker.0 00000100:00100000:3.0:1790773106.022551:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3604:1877761496003072:0@lo:400:kworker.0 00000100:00080000:3.0:1790773106.026330:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790773106.026341:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790773106.029850:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce0675b4-b0c5-48e7-b182-565e22fed04c:3605:1877761496002176:0@lo:400:kworker.0 00010000:00080000:2.0:1790773106.029875:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143e01880 x1877761496002688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773122 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773106.029887:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3605:1877761496002688:0@lo:400:kworker.0 00000100:00100000:0.0:1790773106.033061:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496003200 00000100:00100000:0.0:1790773106.033079:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496003200 00000100:00080000:3.0:1790773106.033343:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790773106.034684:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1790773106.034701:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143c7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3605:x1877761496003200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773106.034820:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143c7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3605:x1877761496003200:12345-0@lo:400:kworker.0 Request processed in 124us (21775us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773106.034828:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00080000:1.0:1790773106.034916:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143e03b80 x1877761496003200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773122 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773106.034930:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3605:1877761496003200:0@lo:400:kworker.0 00010000:00010000:1.0:1790773106.509484:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773106.743395:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773106.743432:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773106.743456:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773106.743487:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484400000 00000100:00100000:2.0:1790773106.743496:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484400000 00000100:00100000:2.0:1790773106.743556:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 284 00000100:00100000:2.0:1790773106.743567:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c694850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+10:2399:x1877761484400000:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1790773106.743636:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c694850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+10:2399:x1877761484400000:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 71us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773106.743650:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 284 00000100:00100000:2.0:1790773106.743681:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484400256 00000100:00100000:2.0:1790773106.743684:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484400256 00000100:00100000:2.0:1790773106.743717:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484400128 00000100:00100000:2.0:1790773106.743720:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484400128 00000100:00100000:2.0:1790773106.743741:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 105 00000100:00100000:2.0:1790773106.743747:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+5:2399:x1877761484400256:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1790773106.743777:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+5:2399:x1877761484400256:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 30us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773106.743784:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 105 00000100:00100000:2.0:1790773106.743794:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 106 00000100:00100000:2.0:1790773106.743800:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143c7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+6:2399:x1877761484400128:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1790773106.743822:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143c7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+6:2399:x1877761484400128:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 22us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773106.743828:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 106 00000100:00080000:2.0:1790773106.743942:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790773106.743946:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1790773107.534389:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773108.557585:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773109.069503:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143c7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496003328:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790773109.069587:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773109.070478:0:11145:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496003328 00000100:00100000:2.0:1790773109.070488:0:11145:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496003328 00000100:00100000:2.0:1790773109.070555:0:11145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790773109.070565:0:11145:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14378ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496003328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790773109.070594:0:11145:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790773109.070645:0:11145:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14378ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496003328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (1059us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773109.070653:0:11145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1790773109.070705:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143c7c700 x1877761496003328/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773125 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773109.070724:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143c7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496003328:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790773109.071543:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496003456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790773109.071592:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773109.071650:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496003456 00000100:00100000:1.0:1790773109.071657:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496003456 00000100:00100000:1.0:1790773109.071691:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790773109.071699:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f987800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496003456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790773109.071715:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790773109.071749:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f987800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496003456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773109.071757:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1790773109.071784:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f9e5500 x1877761496003456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773125 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773109.071799:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496003456:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790773109.071929:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790773109.582346:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773110.605658:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773111.118518:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143c7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496003712:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790773111.118609:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773111.118673:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790773111.118680:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496003584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790773111.118708:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773111.118736:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790773111.118745:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496003840:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790773111.118773:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773111.118804:0:6483:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496003712 00000100:00100000:1.0:1790773111.118813:0:6483:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496003712 00000100:00100000:1.0:1790773111.118853:0:6483:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496003840 00000100:00100000:1.0:1790773111.118856:0:6483:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496003840 00000100:00100000:1.0:1790773111.118871:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790773111.118880:0:6483:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496003712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790773111.118914:0:6483:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1790773111.118960:0:6483:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496003712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773111.118978:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790773111.118995:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790773111.119001:0:6483:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f986300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496003840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790773111.119016:0:6483:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1790773111.119048:0:6483:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f986300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496003840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 47us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773111.119053:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790773111.119107:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143c7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496003712:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790773111.119135:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496003840:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790773111.123779:0:8397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496003584 00000100:00100000:2.0:1790773111.123797:0:8397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496003584 00000100:00100000:2.0:1790773111.123873:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790773111.123885:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f985500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496003584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790773111.123918:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790773111.124004:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f985500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496003584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (5294us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773111.124012:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1790773111.124035:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1790773111.124071:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143cc4a80 x1877761496003584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773127 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773111.124102:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496003584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790773111.124888:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143c7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce0675b4-b0c5-48e7-b182-565e22fed04c:3607:1877761496003968:0@lo:400:kworker.0 00000100:00100000:2.0:1790773111.124938:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773111.124970:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143c7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3607:1877761496004480:0@lo:400:kworker.0 00000100:00100000:2.0:1790773111.124994:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773111.125012:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143c7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3607:1877761496004992:0@lo:400:kworker.0 00000100:00100000:2.0:1790773111.125035:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773111.125054:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1790773111.125060:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143c7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3607:1877761496004352:0@lo:400:kworker.0 00000100:00100000:2.0:1790773111.125094:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773111.125127:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143c7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3607:1877761496004864:0@lo:400:kworker.0 00000100:00100000:2.0:1790773111.125149:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773111.125173:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143c7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3604:1877761496004096:0@lo:400:kworker.0 00000100:00100000:2.0:1790773111.125197:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773111.125237:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143c7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496004608:0@lo:400:kworker.0 00000100:00100000:2.0:1790773111.125261:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773111.125281:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496005120:0@lo:400:kworker.0 00000100:00100000:2.0:1790773111.125302:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773111.125322:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1790773111.125327:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143c7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3604:1877761496004224:0@lo:400:kworker.0 00000100:00100000:2.0:1790773111.125347:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773111.125357:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143c7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496004736:0@lo:400:kworker.0 00000100:00100000:2.0:1790773111.125391:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773111.125424:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496003968 00000100:00100000:2.0:1790773111.125430:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496003968 00000100:00100000:2.0:1790773111.125470:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1790773111.125491:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c694050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3607:x1877761496003968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773111.125535:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c694050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3607:x1877761496003968:12345-0@lo:400:kworker.0 Request processed in 46us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773111.125542:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1790773111.125574:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496004480 00000100:00100000:2.0:1790773111.125578:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496004480 00000100:00100000:2.0:1790773111.125606:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496004992 00000100:00100000:2.0:1790773111.125609:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496004992 00000100:00100000:2.0:1790773111.125621:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496004352 00000100:00100000:2.0:1790773111.125624:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496004352 00000100:00100000:2.0:1790773111.125635:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496004864 00000100:00100000:2.0:1790773111.125644:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496004864 00000100:00100000:2.0:1790773111.125660:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496004096 00000100:00100000:2.0:1790773111.125662:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496004096 00000100:00100000:2.0:1790773111.125670:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496004224 00000100:00100000:2.0:1790773111.125672:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496004224 00000100:00100000:2.0:1790773111.125684:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1790773111.125689:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1877761496004480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773111.125720:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1877761496004480:12345-0@lo:400:kworker.0 Request processed in 31us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773111.125726:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1790773111.125739:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1790773111.125745:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1877761496004992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773111.125769:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1877761496004992:12345-0@lo:400:kworker.0 Request processed in 26us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773111.125774:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1790773111.125784:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1790773111.125789:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1877761496004352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773111.125811:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1877761496004352:12345-0@lo:400:kworker.0 Request processed in 22us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773111.125815:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1790773111.125825:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1790773111.125830:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1877761496004864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773111.125856:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1877761496004864:12345-0@lo:400:kworker.0 Request processed in 27us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773111.125862:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1790773111.125874:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1790773111.125879:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3604:x1877761496004096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773111.125921:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3604:x1877761496004096:12345-0@lo:400:kworker.0 Request processed in 41us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773111.125928:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1790773111.125940:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1790773111.125946:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3604:x1877761496004224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773111.125973:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3604:x1877761496004224:12345-0@lo:400:kworker.0 Request processed in 28us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773111.125978:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1790773111.126004:0:8393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496004608 00000100:00100000:2.0:1790773111.126008:0:8393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496004608 00000100:00100000:2.0:1790773111.126037:0:8393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496005120 00000100:00100000:2.0:1790773111.126040:0:8393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496005120 00000100:00100000:2.0:1790773111.126055:0:8393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496004736 00000100:00100000:2.0:1790773111.126058:0:8393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496004736 00000100:00100000:2.0:1790773111.126068:0:8393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790773111.126074:0:8393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496004608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773111.126103:0:8393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496004608:12345-0@lo:400:kworker.0 Request processed in 28us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773111.126108:0:8393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790773111.126119:0:8393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790773111.126124:0:8393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496005120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773111.126152:0:8393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496005120:12345-0@lo:400:kworker.0 Request processed in 28us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773111.126157:0:8393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790773111.126168:0:8393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790773111.126173:0:8393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496004736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773111.126231:0:8393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496004736:12345-0@lo:400:kworker.0 Request processed in 58us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773111.126238:0:8393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1790773111.126263:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790773111.126267:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790773111.126270:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790773111.126272:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790773111.126307:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143c7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3604:1877761496004224:0@lo:400:kworker.0 00010000:00080000:2.0:1790773111.126319:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143c7c700 x1877761496004736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773111.126329:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143c7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496004736:0@lo:400:kworker.0 00000100:00100000:2.0:1790773111.126338:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143c7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3604:1877761496004096:0@lo:400:kworker.0 00010000:00080000:2.0:1790773111.126346:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143c7e300 x1877761496004608/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773111.126354:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143c7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496004608:0@lo:400:kworker.0 00010000:00080000:2.0:1790773111.126363:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143e03b80 x1877761496005120/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773111.126371:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496005120:0@lo:400:kworker.0 00000100:00100000:2.0:1790773111.126401:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143c7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3607:1877761496004352:0@lo:400:kworker.0 00000100:00100000:2.0:1790773111.126409:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143c7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3607:1877761496004864:0@lo:400:kworker.0 00000100:00100000:2.0:1790773111.126417:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143c7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce0675b4-b0c5-48e7-b182-565e22fed04c:3607:1877761496003968:0@lo:400:kworker.0 00010000:00080000:2.0:1790773111.126427:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143c7f800 x1877761496004480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773111.126442:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143c7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3607:1877761496004480:0@lo:400:kworker.0 00010000:00080000:2.0:1790773111.126455:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143c7dc00 x1877761496004992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773111.126462:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143c7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3607:1877761496004992:0@lo:400:kworker.0 00000100:00100000:2.0:1790773111.126733:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496005248:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790773111.126767:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773111.134234:0:11145:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496005248 00000100:00100000:0.0:1790773111.134254:0:11145:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496005248 00000100:00100000:0.0:1790773111.134328:0:11145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790773111.134338:0:11145:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496005248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790773111.134384:0:11145:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790773111.134503:0:11145:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496005248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 166us (7735us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773111.134512:0:11145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1790773111.137431:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143cc5180 x1877761496005248/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773127 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773111.137458:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496005248:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1790773111.629944:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773111.854330:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773111.854377:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773111.854428:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773111.854435:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484400384 00000100:00100000:2.0:1790773111.854448:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484400384 00000100:00100000:1.0:1790773111.854679:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484400640 00000100:00100000:1.0:1790773111.854684:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484400640 00000100:00100000:1.0:1790773111.854730:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484400512 00000100:00100000:1.0:1790773111.854733:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484400512 00000100:00100000:1.0:1790773111.854758:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 113 00000100:00100000:1.0:1790773111.854768:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14378f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+5:2397:x1877761484400640:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773111.854848:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14378f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+5:2397:x1877761484400640:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 81us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773111.854856:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 113 00000100:00100000:1.0:1790773111.854874:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 114 00000100:00100000:1.0:1790773111.854881:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14378f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+6:2397:x1877761484400512:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773111.854905:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14378f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+6:2397:x1877761484400512:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 25us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773111.854910:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 114 00000100:00100000:2.0:1790773111.855127:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 286 00000100:00100000:2.0:1790773111.855136:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c696450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+10:2397:x1877761484400384:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1790773111.855176:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c696450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+10:2397:x1877761484400384:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 42us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773111.855183:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 286 00000100:00080000:1.0:1790773111.857369:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790773111.857379:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1790773112.656310:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773113.677679:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773114.191737:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1790773114.191763:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496005376:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790773114.191839:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773114.191913:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f987100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496005504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790773114.191935:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773114.191973:0:11145:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496005376 00000100:00100000:2.0:1790773114.191980:0:11145:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496005376 00000100:00100000:2.0:1790773114.192028:0:11145:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496005504 00000100:00100000:2.0:1790773114.192031:0:11145:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496005504 00000100:00100000:2.0:1790773114.192048:0:11145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790773114.192070:0:11145:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496005376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790773114.192099:0:11145:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790773114.192144:0:11145:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496005376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773114.192151:0:11145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790773114.192168:0:11145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790773114.192174:0:11145:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496005504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790773114.192184:0:11145:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790773114.192228:0:11145:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496005504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773114.192235:0:11145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1790773114.192273:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143e4d180 x1877761496005376/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773130 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790773114.192275:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790773114.192294:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496005376:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1790773114.192305:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f987100 x1877761496005504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773130 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773114.192316:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f987100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496005504:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790773114.706709:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773115.726622:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773116.237415:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790773116.237446:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496005632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790773116.237525:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773116.237588:0:11145:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496005632 00000100:00100000:2.0:1790773116.237595:0:11145:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496005632 00000100:00100000:2.0:1790773116.237642:0:11145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790773116.237650:0:11145:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496005632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790773116.237677:0:11145:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790773116.237727:0:11145:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496005632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773116.237734:0:11145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1790773116.237753:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1790773116.237779:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143e4d180 x1877761496005632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773132 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773116.237797:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496005632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790773116.238039:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496006144:0@lo:400:kworker.0 00000100:00100000:0.0:1790773116.238071:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773116.238092:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496006656:0@lo:400:kworker.0 00000100:00100000:0.0:1790773116.238117:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773116.238145:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496007168:0@lo:400:kworker.0 00000100:00100000:0.0:1790773116.238167:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773116.238233:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1790773116.238240:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496006016:0@lo:400:kworker.0 00000100:00100000:0.0:1790773116.238263:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773116.238286:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3607:1877761496006528:0@lo:400:kworker.0 00000100:00100000:0.0:1790773116.238310:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773116.238327:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3607:1877761496007040:0@lo:400:kworker.0 00000100:00100000:0.0:1790773116.238350:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773116.238376:0:6483:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496006144 00000100:00100000:0.0:1790773116.238380:0:6483:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496006144 00000100:00100000:0.0:1790773116.238407:0:6483:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496006016 00000100:00100000:0.0:1790773116.238410:0:6483:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496006016 00000100:00100000:0.0:1790773116.238434:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1790773116.238442:0:6483:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26bee9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496006144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773116.238493:0:6483:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26bee9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496006144:12345-0@lo:400:kworker.0 Request processed in 52us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773116.238507:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1790773116.238522:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1790773116.238527:0:6483:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496006016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773116.238556:0:6483:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496006016:12345-0@lo:400:kworker.0 Request processed in 28us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773116.238561:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1790773116.238595:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496006528 00000100:00100000:0.0:1790773116.238599:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496006528 00000100:00100000:0.0:1790773116.238626:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496007040 00000100:00100000:0.0:1790773116.238629:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496007040 00000100:00100000:0.0:1790773116.238647:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1790773116.238653:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1877761496006528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773116.238681:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1877761496006528:12345-0@lo:400:kworker.0 Request processed in 28us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773116.238687:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1790773116.238698:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1790773116.238703:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1877761496007040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773116.238726:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1877761496007040:12345-0@lo:400:kworker.0 Request processed in 23us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773116.238731:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1790773116.238769:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496006016:0@lo:400:kworker.0 00010000:00080000:0.0:1790773116.238782:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143cc4a80 x1877761496006528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773116.238791:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3607:1877761496006528:0@lo:400:kworker.0 00010000:00080000:0.0:1790773116.238801:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d25074f800 x1877761496007040/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773116.238817:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3607:1877761496007040:0@lo:400:kworker.0 00000100:00100000:0.0:1790773116.238826:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496006144:0@lo:400:kworker.0 00000100:00100000:3.0:1790773116.238970:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3605:1877761496005888:0@lo:400:kworker.0 00000100:00100000:3.0:1790773116.238998:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773116.239016:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3605:1877761496006400:0@lo:400:kworker.0 00000100:00100000:3.0:1790773116.239035:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773116.239049:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3605:1877761496006912:0@lo:400:kworker.0 00000100:00100000:3.0:1790773116.239066:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773116.239082:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1790773116.239095:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce0675b4-b0c5-48e7-b182-565e22fed04c:3605:1877761496005760:0@lo:400:kworker.0 00000100:00100000:3.0:1790773116.239122:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773116.239143:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3605:1877761496006272:0@lo:400:kworker.0 00000100:00100000:3.0:1790773116.239163:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773116.239176:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496006784:0@lo:400:kworker.0 00000100:00100000:3.0:1790773116.239195:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773116.239484:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790773116.239522:0:8393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496006656 00000100:00100000:2.0:1790773116.239528:0:8393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496006656 00000100:00100000:2.0:1790773116.239560:0:8393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496007168 00000100:00100000:2.0:1790773116.239563:0:8393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496007168 00000100:00100000:2.0:1790773116.239582:0:8393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496006784 00000100:00100000:2.0:1790773116.239584:0:8393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496006784 00000100:00100000:2.0:1790773116.239596:0:8393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790773116.239604:0:8393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496006656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773116.239647:0:8393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496006656:12345-0@lo:400:kworker.0 Request processed in 44us (1530us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773116.239653:0:8393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790773116.239665:0:8393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790773116.239671:0:8393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496007168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773116.239699:0:8393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496007168:12345-0@lo:400:kworker.0 Request processed in 28us (1532us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773116.239704:0:8393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790773116.239716:0:8393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790773116.239721:0:8393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14378c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496006784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773116.239766:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496005888 00000100:00100000:0.0:1790773116.239771:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496005888 00000100:00100000:0.0:1790773116.239788:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496006400 00000100:00100000:0.0:1790773116.239790:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496006400 00000100:00100000:0.0:1790773116.239801:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496006912 00000100:00100000:0.0:1790773116.239803:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496006912 00000100:00100000:0.0:1790773116.239813:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496006272 00000100:00100000:0.0:1790773116.239815:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496006272 00000100:00100000:0.0:1790773116.239826:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1790773116.239831:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14378ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3605:x1877761496005888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773116.249282:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1790773116.249300:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14378fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3605:x1877761496006400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773116.251773:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496007296:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790773116.251853:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773116.251964:0:8393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14378c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496006784:12345-0@lo:400:kworker.0 Request processed in 12240us (12766us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773116.251989:0:8393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790773116.252038:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496005760 00000100:00100000:2.0:1790773116.252046:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496005760 00000100:00100000:2.0:1790773116.252085:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1790773116.252094:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c695c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3605:x1877761496005760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773116.252151:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c695c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3605:x1877761496005760:12345-0@lo:400:kworker.0 Request processed in 58us (13028us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773116.252158:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1790773116.252241:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790773116.252249:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496007424:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790773116.252275:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790773116.252302:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790773116.252307:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790773116.252310:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790773116.252313:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790773116.252325:0:6483:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496007424 00000100:00100000:2.0:1790773116.252329:0:6483:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496007424 00000100:00100000:2.0:1790773116.252352:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1790773116.252359:0:6483:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496007424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790773116.252386:0:6483:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1790773116.252422:0:6483:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496007424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773116.252440:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1790773116.252497:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496007424:0@lo:41:osp-pre-0-1.0 00010000:00080000:2.0:1790773116.252538:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143cc4e00 x1877761496006656/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773116.252563:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496006656:0@lo:400:kworker.0 00010000:00080000:2.0:1790773116.252576:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d25074e300 x1877761496007168/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773116.252584:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496007168:0@lo:400:kworker.0 00000100:00100000:0.0:1790773116.255798:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14378ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3605:x1877761496005888:12345-0@lo:400:kworker.0 Request processed in 15956us (16788us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773116.255814:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1790773116.256107:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1790773116.256940:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496007552:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790773116.257005:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773116.257056:0:7666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496007552 00000100:00100000:2.0:1790773116.257064:0:7666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496007552 00000100:00100000:2.0:1790773116.257100:0:7666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1790773116.257107:0:7666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496007552:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790773116.257154:0:7666:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790773116.257196:0:7666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496007552:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773116.257227:0:7666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1790773116.257270:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496007552:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790773116.260308:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14378e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3605:x1877761496006912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773116.260936:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14378e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3605:x1877761496006912:12345-0@lo:400:kworker.0 Request processed in 4819us (21865us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773116.260947:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1790773116.260985:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1790773116.260995:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14378d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3605:x1877761496006272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773116.261028:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14378d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3605:x1877761496006272:12345-0@lo:400:kworker.0 Request processed in 36us (21864us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773116.261035:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00010000:00080000:3.0:1790773116.261333:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d25074fb80 x1877761496006784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773116.261349:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496006784:0@lo:400:kworker.0 00000100:00100000:3.0:1790773116.261373:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496007296 00000100:00100000:3.0:1790773116.261380:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496007296 00000100:00100000:3.0:1790773116.261435:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790773116.261443:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14378f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496007296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790773116.261470:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790773116.261508:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14378f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496007296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (9655us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773116.261514:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790773116.261558:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3605:1877761496005888:0@lo:400:kworker.0 00000100:00100000:1.0:1790773116.263022:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14378fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3605:x1877761496006400:12345-0@lo:400:kworker.0 Request processed in 13723us (23979us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773116.263033:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1790773116.267325:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3605:1877761496006400:0@lo:400:kworker.0 00000100:00100000:1.0:1790773116.276324:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3605:1877761496006912:0@lo:400:kworker.0 00010000:00080000:1.0:1790773116.276372:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d25074f800 x1877761496007296/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773132 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773116.276394:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496007296:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790773116.276405:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce0675b4-b0c5-48e7-b182-565e22fed04c:3605:1877761496005760:0@lo:400:kworker.0 00000100:00100000:1.0:1790773116.276417:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3605:1877761496006272:0@lo:400:kworker.0 00010000:00010000:2.0:1790773116.749514:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773116.977699:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773116.977961:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484400896 00000100:00100000:0.0:1790773116.977972:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484400896 00000100:00100000:0.0:1790773116.978039:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 121 00000100:00100000:0.0:1790773116.978049:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+6:2397:x1877761484400896:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1790773116.978065:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773116.978132:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773116.978157:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484401024 00000100:00100000:2.0:1790773116.978161:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484401024 00000100:00100000:2.0:1790773116.978226:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 122 00000100:00100000:2.0:1790773116.978234:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+5:2397:x1877761484401024:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1790773116.978281:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+5:2397:x1877761484401024:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 48us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773116.978296:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 122 00000100:00100000:0.0:1790773116.978678:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+6:2397:x1877761484400896:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 323us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773116.978688:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 121 00000100:00080000:0.0:1790773116.978710:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790773116.978715:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790773116.980789:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484400768 00000100:00100000:1.0:1790773116.980803:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484400768 00000100:00100000:1.0:1790773116.980910:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 288 00000100:00100000:1.0:1790773116.980920:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c695050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+10:2397:x1877761484400768:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773116.981011:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c695050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+10:2397:x1877761484400768:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 92us (2945us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773116.981018:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 288 00010000:00010000:1.0:1790773117.774909:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773118.800569:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773119.309416:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790773119.309458:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496007680:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790773119.309541:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773119.309621:0:8397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496007680 00000100:00100000:2.0:1790773119.309629:0:8397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496007680 00000100:00100000:2.0:1790773119.309691:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790773119.309702:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496007680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790773119.309734:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790773119.309783:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496007680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773119.309792:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1790773119.309814:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790773119.309847:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143e4ca80 x1877761496007680/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773135 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773119.309880:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496007680:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790773119.313474:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790773119.313499:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f987480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496007808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790773119.313593:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773119.313657:0:11145:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496007808 00000100:00100000:1.0:1790773119.313665:0:11145:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496007808 00000100:00100000:1.0:1790773119.313717:0:11145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790773119.313726:0:11145:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f986680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496007808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790773119.313749:0:11145:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790773119.313793:0:11145:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f986680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496007808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773119.313801:0:11145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1790773119.313841:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f987480 x1877761496007808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773135 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790773119.314978:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790773119.315353:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f987480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496007808:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790773119.822524:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790773120.019001:0:11957:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 08:58:38 (1790773118) === 00000100:00100000:2.0:1790773120.585843:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773120.585951:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484401152 00000100:00100000:3.0:1790773120.585974:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484401152 00000100:00100000:3.0:1790773120.586027:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 289 00000100:00100000:3.0:1790773120.586036:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c697c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+10:8696:x1877761484401152:12345-192.168.202.19@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790773120.586057:0:6471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773120.586078:0:6471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d1434ac000/0xabf1cc0bc7841a23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bad6 expref: -99 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773120.586117:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d1434ac000/0xabf1cc0bc7841a23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bad6 expref: 11 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773120.586129:0:6471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d1434ac000/0xabf1cc0bc7841a23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bad6 expref: 11 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773120.586140:0:6471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d1434ac000, rc 0) 00000100:00100000:3.0:1790773120.586244:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c697c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+11:8696:x1877761484401152:12345-192.168.202.19@tcp:101:mount.lustre.0 Request processed in 209us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773120.586252:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 289 00000100:00100000:0.0:1790773120.591015:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773120.591297:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484401280 00000100:00100000:1.0:1790773120.591310:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484401280 00000100:00100000:1.0:1790773120.591391:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 290 00000100:00100000:1.0:1790773120.591403:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c697050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+11:8696:x1877761484401280:12345-192.168.202.19@tcp:501:mount.lustre.0 00000100:00100000:1.0:1790773120.591590:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c697050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+11:8696:x1877761484401280:12345-192.168.202.19@tcp:501:mount.lustre.0 Request processed in 188us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773120.591598:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 290 00000100:00100000:1.0:1790773120.596400:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773120.596477:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484401408 00000100:00100000:2.0:1790773120.596488:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484401408 00000100:00100000:2.0:1790773120.596543:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 291 00000100:00100000:2.0:1790773120.596553:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c697450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+11:8696:x1877761484401408:12345-192.168.202.19@tcp:503:mount.lustre.0 00000100:00100000:2.0:1790773120.596710:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c697450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+11:8696:x1877761484401408:12345-192.168.202.19@tcp:503:mount.lustre.0 Request processed in 158us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773120.596729:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 291 00000100:00100000:2.0:1790773120.619780:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773120.619881:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484401536 00000100:00100000:3.0:1790773120.619892:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484401536 00000100:00100000:3.0:1790773120.619950:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 292 00000100:00100000:3.0:1790773120.619959:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c695850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+11:8700:x1877761484401536:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790773120.620149:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c695850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+11:8700:x1877761484401536:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 189us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773120.620158:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 292 00000100:00100000:0.0:1790773120.655782:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773120.655889:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484401664 00000100:00100000:1.0:1790773120.655901:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484401664 00000100:00100000:1.0:1790773120.655957:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 293 00000100:00100000:1.0:1790773120.655967:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c694450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+11:8700:x1877761484401664:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790773120.656143:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c694450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+11:8700:x1877761484401664:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 176us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773120.656157:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 293 00000100:00100000:1.0:1790773120.661570:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773120.662735:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484401792 00000100:00100000:2.0:1790773120.662751:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484401792 00000100:00100000:2.0:1790773120.662824:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 294 00000100:00100000:2.0:1790773120.662834:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+11:8700:x1877761484401792:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790773120.663021:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+11:8700:x1877761484401792:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 188us (1463us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773120.663030:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 294 00000100:00100000:2.0:1790773120.676152:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773120.678352:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484401920 00000100:00100000:3.0:1790773120.678372:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484401920 00000100:00100000:3.0:1790773120.678482:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 295 00000100:00100000:3.0:1790773120.678498:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+11:8696:x1877761484401920:12345-192.168.202.19@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790773120.678550:0:6471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773120.678579:0:6471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d1434ad600/0xabf1cc0bc7841a2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bb07 expref: -99 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773120.678617:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d1434ad600/0xabf1cc0bc7841a2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb07 expref: 12 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773120.678630:0:6471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d1434ad600/0xabf1cc0bc7841a2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb07 expref: 12 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773120.678639:0:6471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d1434ad600, rc 0) 00000100:00100000:3.0:1790773120.678904:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+12:8696:x1877761484401920:12345-192.168.202.19@tcp:101:mount.lustre.0 Request processed in 410us (2761us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773120.678912:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 295 00000100:00100000:0.0:1790773120.681962:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773120.682126:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484402048 00000100:00100000:1.0:1790773120.682138:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484402048 00000100:00100000:1.0:1790773120.682232:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 296 00000100:00100000:1.0:1790773120.682244:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+12:8696:x1877761484402048:12345-192.168.202.19@tcp:256:mount.lustre.0 20000000:01000000:1.0:1790773120.682273:0:6472:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1790773120.682299:0:6472:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1790773120.682303:0:6472:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1790773120.682307:0:6472:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1790773120.682309:0:6472:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1790773120.682311:0:6472:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1790773120.684510:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+12:8696:x1877761484402048:12345-192.168.202.19@tcp:256:mount.lustre.0 Request processed in 2257us (2546us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773120.684524:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 296 00000100:00100000:3.0:1790773120.690840:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773120.690949:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484402176 00000100:00100000:2.0:1790773120.690961:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484402176 00000100:00100000:2.0:1790773120.691022:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 297 00000100:00100000:2.0:1790773120.691032:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+12:8696:x1877761484402176:12345-192.168.202.19@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790773120.691050:0:6471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773120.691068:0:6471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d26efc5c00/0xabf1cc0bc7841a31 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bb0e expref: -99 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773120.691278:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d26efc5c00/0xabf1cc0bc7841a31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb0e expref: 13 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773120.691292:0:6471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d26efc5c00/0xabf1cc0bc7841a31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb0e expref: 13 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773120.691324:0:6471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26efc5c00, rc 0) 00000100:00100000:2.0:1790773120.691408:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:8696:x1877761484402176:12345-192.168.202.19@tcp:101:mount.lustre.0 Request processed in 377us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773120.691547:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 297 00000100:00100000:0.0:1790773120.696778:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773120.696946:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484402304 00000100:00100000:2.0:1790773120.696958:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484402304 00000100:00100000:2.0:1790773120.697015:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 298 00000100:00100000:2.0:1790773120.697024:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:8696:x1877761484402304:12345-192.168.202.19@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790773120.697437:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:8696:x1877761484402304:12345-192.168.202.19@tcp:501:mount.lustre.0 Request processed in 412us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773120.697836:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 298 00000100:00100000:1.0:1790773120.700475:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773120.700566:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484402432 00000100:00100000:2.0:1790773120.700580:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484402432 00000100:00100000:2.0:1790773120.700641:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 299 00000100:00100000:2.0:1790773120.700651:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:8696:x1877761484402432:12345-192.168.202.19@tcp:503:mount.lustre.0 00000100:00100000:2.0:1790773120.700815:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:8696:x1877761484402432:12345-192.168.202.19@tcp:503:mount.lustre.0 Request processed in 165us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773120.700823:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 299 00000100:00100000:3.0:1790773120.709520:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773120.710251:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484402560 00000100:00100000:2.0:1790773120.710265:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484402560 00000100:00100000:2.0:1790773120.710328:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 300 00000100:00100000:2.0:1790773120.710338:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:8704:x1877761484402560:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790773120.710532:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:8704:x1877761484402560:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 194us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773120.710551:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 300 00000100:00100000:1.0:1790773120.720379:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773120.720538:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484402688 00000100:00100000:0.0:1790773120.720550:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484402688 00000100:00100000:0.0:1790773120.720609:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 301 00000100:00100000:0.0:1790773120.720620:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:8704:x1877761484402688:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790773120.720791:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:8704:x1877761484402688:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 171us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773120.720800:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 301 00000100:00100000:1.0:1790773120.729848:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773120.729895:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773120.730008:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484402944 00000100:00100000:2.0:1790773120.730019:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484402944 00000100:00100000:2.0:1790773120.730193:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484403072 00000100:00100000:2.0:1790773120.730197:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484403072 00000100:00080000:0.0:1790773120.730289:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790773120.730294:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790773120.736602:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 123 00000100:00100000:1.0:1790773120.736635:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+6:2397:x1877761484402944:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773120.736801:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+6:2397:x1877761484402944:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 184us (6963us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773120.736809:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 123 00000100:00100000:1.0:1790773120.736836:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 124 00000100:00100000:1.0:1790773120.736844:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f987100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+5:2397:x1877761484403072:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773120.736872:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f987100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+5:2397:x1877761484403072:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 30us (6977us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773120.736895:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 124 00000100:00100000:0.0:1790773120.745368:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773120.745447:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773120.745530:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484402816 00000100:00100000:3.0:1790773120.745541:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484402816 00000100:00100000:3.0:1790773120.745576:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484403328 00000100:00100000:3.0:1790773120.745579:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484403328 00000100:00100000:3.0:1790773120.745604:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:3.0:1790773120.745612:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2396:x1877761484402816:12345-192.168.202.19@tcp:38:mount.lustre.0 00000100:00100000:1.0:1790773120.745622:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:1.0:1790773120.745628:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2396:x1877761484403328:12345-192.168.202.19@tcp:38:mount.lustre.0 00010000:00080000:3.0:1790773120.745642:0:6479:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f@192.168.202.19@tcp t0 exp 0000000000000000 cur 263 last 0 00010000:00080000:1.0:1790773120.745643:0:8697:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f@192.168.202.19@tcp t0 exp 0000000000000000 cur 263 last 0 00000020:00000080:3.0:1790773120.745678:0:6479:0:(genops.c:1384:class_connect()) connect: client 18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f, cookie 0xabf1cc0bc7841a3f 00000020:00000080:1.0:1790773120.745678:0:8697:0:(genops.c:1384:class_connect()) connect: client 18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f, cookie 0xabf1cc0bc7841a38 00000004:00100000:3.0:1790773120.745702:0:6479:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000004:00100000:1.0:1790773120.745702:0:8697:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1790773120.745819:0:6479:0:(import.c:65:import_set_state_nolock()) ffff93d281bd5800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1790773120.745893:0:8697:0:(import.c:65:import_set_state_nolock()) ffff93d1434cf000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790773120.749832:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+6:2396:x1877761484403328:12345-192.168.202.19@tcp:38:mount.lustre.0 Request processed in 4187us (4370us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773120.749861:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:3.0:1790773120.762566:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+6:2396:x1877761484402816:12345-192.168.202.19@tcp:38:mount.lustre.0 Request processed in 16940us (17193us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773120.762598:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:1.0:1790773120.771319:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773120.772078:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484403456 00000100:00100000:2.0:1790773120.772090:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484403456 00000100:00100000:2.0:1790773120.772173:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 18 00000100:00080000:0.0:1790773120.772173:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790773120.772183:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+6:0:x1877761484403456:12345-192.168.202.19@tcp:41:mount.lustre.0 00000004:00000024:2.0:1790773120.772254:0:8697:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790773120.772361:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+6:0:x1877761484403456:12345-192.168.202.19@tcp:41:mount.lustre.0 Request processed in 179us (1053us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773120.772369:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 18 00000100:00100000:0.0:1790773120.773958:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773120.773993:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773120.774088:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484403584 00000100:00100000:3.0:1790773120.774098:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484403584 00000100:00100000:3.0:1790773120.774159:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484403200 00000100:00100000:3.0:1790773120.774163:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484403200 00000100:00100000:3.0:1790773120.774190:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 19 00000100:00100000:3.0:1790773120.774199:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+7:8696:x1877761484403584:12345-192.168.202.19@tcp:41:mount.lustre.0 00000004:00000024:3.0:1790773120.774285:0:6479:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1790773120.774369:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+7:8696:x1877761484403584:12345-192.168.202.19@tcp:41:mount.lustre.0 Request processed in 171us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773120.774376:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 19 00000100:00100000:3.0:1790773120.774408:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00100000:3.0:1790773120.774425:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+6:0:x1877761484403200:12345-192.168.202.19@tcp:41:mount.lustre.0 00000004:00000024:3.0:1790773120.774438:0:6479:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1790773120.774471:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+6:0:x1877761484403200:12345-192.168.202.19@tcp:41:mount.lustre.0 Request processed in 55us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773120.774476:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00080000:0.0:1790773120.775043:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790773120.793250:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773120.793396:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484403712 00000100:00100000:3.0:1790773120.793407:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484403712 00000100:00100000:3.0:1790773120.793489:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:3.0:1790773120.793502:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+6:8696:x1877761484403712:12345-192.168.202.19@tcp:40:mount.lustre.0 00000100:00100000:3.0:1790773120.793608:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+6:8696:x1877761484403712:12345-192.168.202.19@tcp:40:mount.lustre.0 Request processed in 109us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773120.793616:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:1.0:1790773120.798540:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773120.798589:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773120.798621:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773120.798717:0:8393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484403840 00000100:00100000:2.0:1790773120.798727:0:8393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484403840 00000100:00100000:2.0:1790773120.798769:0:8393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484403968 00000100:00100000:2.0:1790773120.798772:0:8393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484403968 00000100:00100000:2.0:1790773120.798792:0:8393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00100000:2.0:1790773120.798800:0:8393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2396:x1877761484403840:12345-192.168.202.19@tcp:8:mount.lustre.0 00010000:00080000:2.0:1790773120.798836:0:8393:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f@192.168.202.19@tcp t0 exp 0000000000000000 cur 263 last 0 00000020:00000080:2.0:1790773120.798866:0:8393:0:(genops.c:1384:class_connect()) connect: client 18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f, cookie 0xabf1cc0bc7841a46 00002000:00100000:2.0:1790773120.798879:0:8393:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f/ffff93d143c84800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790773120.798891:0:8393:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790773120.798980:0:8393:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1790773120.799010:0:8393:0:(import.c:65:import_set_state_nolock()) ffff93d143c81000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790773120.799166:0:8393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+6:2396:x1877761484403840:12345-192.168.202.19@tcp:8:mount.lustre.0 Request processed in 364us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773120.799189:0:8393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00100000:2.0:1790773120.799241:0:8393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:2.0:1790773120.799246:0:8393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2396:x1877761484403968:12345-192.168.202.19@tcp:8:mount.lustre.0 00010000:00080000:2.0:1790773120.799266:0:8393:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f@192.168.202.19@tcp t0 exp 0000000000000000 cur 263 last 0 00000020:00000080:2.0:1790773120.799283:0:8393:0:(genops.c:1384:class_connect()) connect: client 18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f, cookie 0xabf1cc0bc7841a4d 00002000:00100000:2.0:1790773120.799288:0:8393:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f/ffff93d143c85800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790773120.799301:0:8393:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790773120.799336:0:8393:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790773120.799350:0:8393:0:(import.c:65:import_set_state_nolock()) ffff93d143c87800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790773120.799373:0:8393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+6:2396:x1877761484403968:12345-192.168.202.19@tcp:8:mount.lustre.0 Request processed in 125us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773120.799379:0:8393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:3.0:1790773120.799984:0:6490:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484404096 00000100:00100000:3.0:1790773120.800000:0:6490:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484404096 00000100:00100000:3.0:1790773120.800044:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00100000:3.0:1790773120.800053:0:6490:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143caf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+6:8696:x1877761484404096:12345-192.168.202.19@tcp:900:mount.lustre.0 00000100:00100000:3.0:1790773120.800112:0:6490:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143caf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+6:8696:x1877761484404096:12345-192.168.202.19@tcp:900:mount.lustre.0 Request processed in 61us (1585us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773120.800119:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00100000:1.0:1790773120.803629:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773120.803720:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484404224 00000100:00100000:3.0:1790773120.803731:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484404224 00000100:00100000:3.0:1790773120.803789:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 1 00000100:00100000:3.0:1790773120.803799:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+6:8696:x1877761484404224:12345-192.168.202.19@tcp:33:mount.lustre.0 00000004:00200000:3.0:1790773120.803889:0:6481:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1790773120.803967:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+6:8696:x1877761484404224:12345-192.168.202.19@tcp:33:mount.lustre.0 Request processed in 171us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773120.803972:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 1 00010000:00010000:1.0:1790773120.845886:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773121.357838:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14378d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3607:1877761496008192:0@lo:400:kworker.0 00000100:00100000:3.0:1790773121.357917:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773121.357977:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14378df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3607:1877761496008704:0@lo:400:kworker.0 00000100:00100000:3.0:1790773121.358001:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773121.358022:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3607:1877761496009216:0@lo:400:kworker.0 00000100:00100000:3.0:1790773121.358064:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773121.358095:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1790773121.358101:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14378c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce0675b4-b0c5-48e7-b182-565e22fed04c:3607:1877761496008064:0@lo:400:kworker.0 00000100:00100000:3.0:1790773121.358130:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773121.358150:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14378ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877761496008576:0@lo:400:kworker.0 00000100:00100000:3.0:1790773121.358171:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773121.358197:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496009088:0@lo:400:kworker.0 00000100:00100000:3.0:1790773121.358449:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773121.358469:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496009600:0@lo:400:kworker.0 00000100:00100000:3.0:1790773121.358492:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773121.358522:0:8392:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496009088 00000100:00100000:3.0:1790773121.358530:0:8392:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496009088 00000100:00100000:3.0:1790773121.358582:0:8392:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496009600 00000100:00100000:3.0:1790773121.358584:0:8392:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496009600 00000100:00100000:3.0:1790773121.358608:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790773121.358618:0:8392:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496009088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773121.358674:0:8392:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496009088:12345-0@lo:400:kworker.0 Request processed in 57us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773121.358681:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790773121.358697:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790773121.358703:0:8392:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496009600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773121.358730:0:8392:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496009600:12345-0@lo:400:kworker.0 Request processed in 28us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773121.358736:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1790773121.358755:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790773121.358759:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790773121.358787:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f9cad80 x1877761496009088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773121.358802:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496009088:0@lo:400:kworker.0 00010000:00080000:3.0:1790773121.358812:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f9c8380 x1877761496009600/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773121.358820:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496009600:0@lo:400:kworker.0 00000100:00100000:3.0:1790773121.358854:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496008192 00000100:00100000:3.0:1790773121.358858:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496008192 00000100:00100000:3.0:1790773121.358879:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496008704 00000100:00100000:3.0:1790773121.358882:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496008704 00000100:00100000:3.0:1790773121.358899:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496009216 00000100:00100000:3.0:1790773121.358902:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496009216 00000100:00100000:3.0:1790773121.358912:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496008576 00000100:00100000:3.0:1790773121.358915:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496008576 00000100:00100000:3.0:1790773121.358927:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1790773121.358932:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1877761496008192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773121.358969:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1877761496008192:12345-0@lo:400:kworker.0 Request processed in 36us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773121.358975:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1790773121.358986:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1790773121.358992:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1877761496008704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773121.359019:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1877761496008704:12345-0@lo:400:kworker.0 Request processed in 28us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773121.359025:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1790773121.359036:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1790773121.359178:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496007936:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790773121.359241:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773121.359261:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14378d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496008448:0@lo:400:kworker.0 00000100:00100000:1.0:1790773121.359285:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773121.359299:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496008960:0@lo:400:kworker.0 00000100:00100000:1.0:1790773121.359330:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773121.359349:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496009472:0@lo:400:kworker.0 00000100:00100000:1.0:1790773121.359368:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773121.359406:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1790773121.359413:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14378dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496008320:0@lo:400:kworker.0 00000100:00100000:1.0:1790773121.359436:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773121.359451:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14378c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3605:1877761496008832:0@lo:400:kworker.0 00000100:00100000:1.0:1790773121.359472:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773121.359483:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3605:1877761496009344:0@lo:400:kworker.0 00000100:00100000:1.0:1790773121.359504:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773121.359526:0:8907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496008960 00000100:00100000:1.0:1790773121.359531:0:8907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496008960 00000100:00100000:1.0:1790773121.359561:0:8907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496009472 00000100:00100000:1.0:1790773121.359563:0:8907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496009472 00000100:00100000:1.0:1790773121.359580:0:8907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790773121.359586:0:8907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496008960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773121.359632:0:8907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496008960:12345-0@lo:400:kworker.0 Request processed in 46us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773121.359639:0:8907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790773121.359654:0:8907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790773121.359661:0:8907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496009472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773121.359686:0:8907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496009472:12345-0@lo:400:kworker.0 Request processed in 27us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773121.359692:0:8907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790773121.359712:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496008832 00000100:00100000:1.0:1790773121.359716:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496008832 00000100:00100000:2.0:1790773121.359843:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496007936 00000100:00100000:2.0:1790773121.359847:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496007936 00000100:00100000:2.0:1790773121.359874:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790773121.359881:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496007936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790773121.359895:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790773121.359927:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496007936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773121.359933:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790773121.359952:0:6484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496008448 00000100:00100000:2.0:1790773121.359955:0:6484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496008448 00000100:00100000:2.0:1790773121.359975:0:6484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496008320 00000100:00100000:2.0:1790773121.359978:0:6484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496008320 00000100:00100000:2.0:1790773121.359990:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1790773121.360004:0:6484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496008448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773121.360036:0:6484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496008448:12345-0@lo:400:kworker.0 Request processed in 33us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773121.360055:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1790773121.360068:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1790773121.360074:0:6484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496008320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773121.360102:0:6484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496008320:12345-0@lo:400:kworker.0 Request processed in 29us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773121.360108:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1790773121.360177:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496009856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790773121.360202:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773121.360243:0:8397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496009856 00000100:00100000:2.0:1790773121.360246:0:8397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496009856 00000100:00100000:2.0:1790773121.360264:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790773121.360270:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496009856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790773121.360280:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790773121.360307:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496009856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 37us (104us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773121.360313:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1790773121.360346:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143e4f480 x1877761496009856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773137 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773121.360362:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496009856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790773121.360647:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1877761496009216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773121.360890:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496009344 00000100:00100000:1.0:1790773121.360895:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496009344 00000100:00100000:1.0:1790773121.360916:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1790773121.360922:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877761496008576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773121.360970:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877761496008576:12345-0@lo:400:kworker.0 Request processed in 48us (2797us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773121.360976:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1790773121.361003:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1790773121.361009:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3605:x1877761496008832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773121.361124:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1877761496009216:12345-0@lo:400:kworker.0 Request processed in 481us (3058us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773121.361131:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1790773121.361145:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1790773121.361151:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3605:x1877761496009344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773121.361182:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3605:x1877761496009344:12345-0@lo:400:kworker.0 Request processed in 31us (1677us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773121.361197:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:3.0:1790773121.361427:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790773121.361432:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790773121.361434:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790773121.361437:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790773121.361458:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496009728:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790773121.361495:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773121.361544:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3605:x1877761496008832:12345-0@lo:400:kworker.0 Request processed in 30us (1565us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773121.361552:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1790773121.361592:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14378dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496008320:0@lo:400:kworker.0 00010000:00080000:1.0:1790773121.361607:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d14378c700 x1877761496008832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773121.361618:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14378c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3605:1877761496008832:0@lo:400:kworker.0 00010000:00080000:1.0:1790773121.361628:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f9ca680 x1877761496009344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773121.361636:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3605:1877761496009344:0@lo:400:kworker.0 00010000:00080000:1.0:1790773121.361648:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143cc5500 x1877761496007936/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773137 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773121.361662:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496007936:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790773121.361671:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14378d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496008448:0@lo:400:kworker.0 00010000:00080000:1.0:1790773121.361682:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f9cb800 x1877761496008960/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773121.361690:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496008960:0@lo:400:kworker.0 00010000:00080000:1.0:1790773121.361709:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f9c9500 x1877761496009472/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773121.361717:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496009472:0@lo:400:kworker.0 00000100:00100000:0.0:1790773121.361879:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790773121.361888:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496009984:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790773121.361986:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14378ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877761496008576:0@lo:400:kworker.0 00000100:00100000:3.0:1790773121.361999:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14378d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3607:1877761496008192:0@lo:400:kworker.0 00000100:00100000:3.0:1790773121.362009:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14378df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3607:1877761496008704:0@lo:400:kworker.0 00000100:00100000:3.0:1790773121.362019:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3607:1877761496009216:0@lo:400:kworker.0 00000100:00100000:3.0:1790773121.362065:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496008064 00000100:00100000:3.0:1790773121.362072:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496008064 00000100:00100000:3.0:1790773121.362102:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1790773121.362109:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3607:x1877761496008064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773121.362148:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3607:x1877761496008064:12345-0@lo:400:kworker.0 Request processed in 39us (4017us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773121.362155:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1790773121.362186:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14378c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce0675b4-b0c5-48e7-b182-565e22fed04c:3607:1877761496008064:0@lo:400:kworker.0 00000100:00100000:3.0:1790773121.362273:0:6484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496009728 00000100:00100000:3.0:1790773121.362278:0:6484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496009728 00000100:00100000:3.0:1790773121.362303:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1790773121.362310:0:6484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496009728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790773121.362336:0:6484:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1790773121.362391:0:6484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496009728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773121.362398:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1790773121.362426:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496009728:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790773121.369666:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773121.369801:0:6483:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496009984 00000100:00100000:2.0:1790773121.369812:0:6483:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496009984 00000100:00100000:2.0:1790773121.369870:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790773121.369880:0:6483:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496009984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790773121.369935:0:6483:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790773121.370014:0:6483:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496009984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 136us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773121.370022:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1790773121.370243:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496009984:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1790773121.871498:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773122.901179:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773123.921616:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773124.434594:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790773124.434625:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496010112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790773124.434704:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773124.434772:0:11145:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496010112 00000100:00100000:2.0:1790773124.434780:0:11145:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496010112 00000100:00100000:2.0:1790773124.434829:0:11145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790773124.434839:0:11145:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496010112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790773124.434871:0:11145:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790773124.434914:0:11145:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496010112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773124.434921:0:11145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:2.0:1790773124.434961:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143e4f480 x1877761496010112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773140 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773124.434980:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496010112:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1790773124.437298:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790773124.437820:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790773124.437840:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496010240:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790773124.437904:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773124.438904:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496010240 00000100:00100000:2.0:1790773124.438914:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496010240 00000100:00100000:2.0:1790773124.438994:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790773124.439006:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496010240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790773124.439029:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790773124.439087:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496010240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (1181us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773124.439108:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:2.0:1790773124.439151:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f9cbb80 x1877761496010240/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773140 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773124.439171:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496010240:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1790773124.439455:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790773124.943070:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773125.969566:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790773125.984742:0:7410:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f 00000001:00100000:1.0:1790773125.984798:0:9475:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f 00000001:00100000:2.0:1790773125.990716:0:6457:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f 00000001:00100000:2.0:1790773125.992889:0:8388:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f 00000100:00100000:0.0:1790773126.189467:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773126.189519:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773126.189550:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773126.189586:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773126.189618:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484404480 00000100:00100000:0.0:1790773126.189630:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484404480 00000100:00100000:0.0:1790773126.189693:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484404736 00000100:00100000:0.0:1790773126.189696:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484404736 00000100:00100000:0.0:1790773126.189711:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484404608 00000100:00100000:0.0:1790773126.189714:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484404608 00000100:00100000:0.0:1790773126.189729:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 131 00000100:00100000:0.0:1790773126.189739:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+6:2398:x1877761484404480:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1790773126.189815:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+6:2398:x1877761484404480:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 78us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773126.189823:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 131 00000100:00100000:0.0:1790773126.189843:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 132 00000100:00100000:0.0:1790773126.189849:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2398:x1877761484404736:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1790773126.189874:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2398:x1877761484404736:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 25us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773126.189898:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 132 00000100:00100000:0.0:1790773126.189911:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 133 00000100:00100000:2.0:1790773126.189912:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484404352 00000100:00100000:2.0:1790773126.189916:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484404352 00000100:00100000:0.0:1790773126.189917:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+5:2397:x1877761484404608:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1790773126.189944:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+5:2397:x1877761484404608:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 27us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773126.189946:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 303 00000100:00100000:0.0:1790773126.189950:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 133 00000100:00100000:2.0:1790773126.189953:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:2397:x1877761484404352:12345-192.168.202.19@tcp:400:kworker.0 00000100:00080000:0.0:1790773126.189970:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790773126.189974:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790773126.189979:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:2397:x1877761484404352:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 27us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773126.189984:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 303 00000100:00100000:0.0:1790773126.207082:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773126.207130:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773126.207243:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773126.207272:0:8394:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484404992 00000100:00100000:0.0:1790773126.207282:0:8394:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484404992 00000100:00100000:0.0:1790773126.207346:0:8394:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484405120 00000100:00100000:0.0:1790773126.207350:0:8394:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484405120 00000100:00100000:0.0:1790773126.207375:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 49 00000100:00100000:0.0:1790773126.207385:0:8394:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2398:x1877761484404992:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1790773126.207462:0:8394:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2398:x1877761484404992:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 78us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773126.207470:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 49 00000100:00100000:0.0:1790773126.207487:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 50 00000100:00100000:0.0:1790773126.207493:0:8394:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2397:x1877761484405120:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1790773126.207515:0:8394:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2397:x1877761484405120:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 23us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773126.207522:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 50 00000100:00080000:0.0:1790773126.207549:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790773126.207553:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790773126.207992:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484404864 00000100:00100000:3.0:1790773126.208013:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484404864 00000100:00100000:3.0:1790773126.208051:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 134 00000100:00100000:3.0:1790773126.208058:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2397:x1877761484404864:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1790773126.208097:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2397:x1877761484404864:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 39us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773126.208104:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 134 00000100:00080000:0.0:1790773126.208514:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790773126.477391:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ec63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496010368:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790773126.477463:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773126.477543:0:7666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496010368 00000100:00100000:0.0:1790773126.477551:0:7666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496010368 00000100:00100000:0.0:1790773126.477597:0:7666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1790773126.477606:0:7666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1434bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496010368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790773126.477640:0:7666:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1790773126.477686:0:7666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1434bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496010368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773126.477693:0:7666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1790773126.477739:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ec63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496010368:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790773126.477969:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3606:1877761496010624:0@lo:400:kworker.0 00000100:00100000:3.0:1790773126.478000:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773126.478019:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3606:1877761496011136:0@lo:400:kworker.0 00000100:00100000:3.0:1790773126.478040:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773126.478057:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3606:1877761496011648:0@lo:400:kworker.0 00000100:00100000:3.0:1790773126.478076:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773126.478095:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1790773126.478102:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496010752:0@lo:400:kworker.0 00000100:00100000:3.0:1790773126.478134:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773126.478152:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496011264:0@lo:400:kworker.0 00000100:00100000:3.0:1790773126.478173:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773126.478190:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ca5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496011776:0@lo:400:kworker.0 00000100:00100000:3.0:1790773126.478228:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773126.478257:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496010624 00000100:00100000:3.0:1790773126.478263:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496010624 00000100:00100000:3.0:1790773126.478288:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496011136 00000100:00100000:3.0:1790773126.478290:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496011136 00000100:00100000:3.0:1790773126.478307:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496011648 00000100:00100000:3.0:1790773126.478309:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496011648 00000100:00100000:3.0:1790773126.478322:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1790773126.478340:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ca5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1877761496010624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773126.478383:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ca5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1877761496010624:12345-0@lo:400:kworker.0 Request processed in 54us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773126.478390:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1790773126.478403:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1790773126.478409:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ca6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1877761496011136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773126.478436:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ca6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1877761496011136:12345-0@lo:400:kworker.0 Request processed in 28us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773126.478442:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1790773126.478454:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1790773126.478460:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ca5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3606:x1877761496011648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773126.478484:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ca5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3606:x1877761496011648:12345-0@lo:400:kworker.0 Request processed in 25us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773126.478490:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1790773126.478518:0:6484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496010752 00000100:00100000:3.0:1790773126.478523:0:6484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496010752 00000100:00100000:3.0:1790773126.478541:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1790773126.478548:0:6484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ca4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496010752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773126.478580:0:6484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ca4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496010752:12345-0@lo:400:kworker.0 Request processed in 32us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773126.478585:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1790773126.478604:0:8393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496011264 00000100:00100000:3.0:1790773126.478606:0:8393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496011264 00000100:00100000:3.0:1790773126.478627:0:8393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496011776 00000100:00100000:3.0:1790773126.478630:0:8393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496011776 00000100:00100000:3.0:1790773126.478649:0:8393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790773126.478655:0:8393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ca6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496011264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773126.478687:0:8393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ca6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496011264:12345-0@lo:400:kworker.0 Request processed in 32us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773126.478692:0:8393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790773126.478702:0:8393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790773126.478708:0:8393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ca4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496011776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773126.478733:0:8393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ca4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496011776:12345-0@lo:400:kworker.0 Request processed in 26us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773126.478738:0:8393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790773126.478771:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496010752:0@lo:400:kworker.0 00010000:00080000:3.0:1790773126.478783:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f9cbb80 x1877761496011264/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773126.478793:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496011264:0@lo:400:kworker.0 00010000:00080000:3.0:1790773126.478801:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143ca5180 x1877761496011776/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773126.478817:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ca5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496011776:0@lo:400:kworker.0 00000100:00100000:3.0:1790773126.478831:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3606:1877761496010624:0@lo:400:kworker.0 00010000:00080000:3.0:1790773126.478839:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f9cb480 x1877761496011136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773126.478846:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3606:1877761496011136:0@lo:400:kworker.0 00010000:00080000:3.0:1790773126.478855:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f9ca680 x1877761496011648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773126.478861:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3606:1877761496011648:0@lo:400:kworker.0 00000100:00080000:0.0:1790773126.479001:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790773126.479005:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790773126.479008:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790773126.479020:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce0675b4-b0c5-48e7-b182-565e22fed04c:3605:1877761496010496:0@lo:400:kworker.0 00000100:00100000:0.0:1790773126.479051:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773126.479086:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3605:1877761496011008:0@lo:400:kworker.0 00000100:00100000:0.0:1790773126.479107:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773126.479125:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3605:1877761496011520:0@lo:400:kworker.0 00000100:00100000:0.0:1790773126.479145:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773126.479162:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1434bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496012032:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790773126.479179:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773126.479196:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1790773126.479233:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3605:1877761496010880:0@lo:400:kworker.0 00000100:00100000:0.0:1790773126.479257:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773126.479274:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496011392:0@lo:400:kworker.0 00000100:00100000:0.0:1790773126.479294:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773126.479312:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ca5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496011904:0@lo:400:kworker.0 00000100:00100000:0.0:1790773126.479358:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773126.479386:0:8906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496011392 00000100:00100000:0.0:1790773126.479391:0:8906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496011392 00000100:00100000:0.0:1790773126.479423:0:8906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496011904 00000100:00100000:0.0:1790773126.479425:0:8906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496011904 00000100:00100000:0.0:1790773126.479443:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790773126.479449:0:8906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496011392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773126.479483:0:8906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496011392:12345-0@lo:400:kworker.0 Request processed in 35us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773126.479488:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790773126.479500:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790773126.479505:0:8906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496011904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773126.479529:0:8906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496011904:12345-0@lo:400:kworker.0 Request processed in 24us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773126.479535:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790773126.479552:0:6483:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496012032 00000100:00100000:0.0:1790773126.479555:0:6483:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496012032 00000100:00100000:0.0:1790773126.479576:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1790773126.479583:0:6483:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496012032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790773126.479604:0:6483:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1790773126.479636:0:6483:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496012032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 54us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773126.479648:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1790773126.479665:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496011008 00000100:00100000:0.0:1790773126.479669:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496011008 00000100:00100000:0.0:1790773126.479689:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496011520 00000100:00100000:0.0:1790773126.479692:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496011520 00000100:00100000:0.0:1790773126.479703:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496010880 00000100:00100000:0.0:1790773126.479706:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496010880 00000100:00100000:0.0:1790773126.479716:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1790773126.479722:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1434bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3605:x1877761496011008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773126.479752:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1434bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3605:x1877761496011008:12345-0@lo:400:kworker.0 Request processed in 31us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773126.479758:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1790773126.479769:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1790773126.479774:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ec63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3605:x1877761496011520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773126.479800:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ec63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3605:x1877761496011520:12345-0@lo:400:kworker.0 Request processed in 26us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773126.479806:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1790773126.479816:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1790773126.479822:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3605:x1877761496010880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773126.479848:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3605:x1877761496010880:12345-0@lo:400:kworker.0 Request processed in 26us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773126.479853:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:0.0:1790773126.479874:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790773126.479878:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790773126.479879:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790773126.479913:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3605:1877761496010880:0@lo:400:kworker.0 00010000:00080000:0.0:1790773126.479936:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f9c9500 x1877761496011392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773126.479945:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496011392:0@lo:400:kworker.0 00010000:00080000:0.0:1790773126.479953:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143ca5c00 x1877761496011904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773126.479960:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ca5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496011904:0@lo:400:kworker.0 00000100:00100000:0.0:1790773126.479968:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3605:1877761496011008:0@lo:400:kworker.0 00000100:00100000:0.0:1790773126.479976:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3605:1877761496011520:0@lo:400:kworker.0 00000100:00100000:0.0:1790773126.479987:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1434bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496012032:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790773126.480304:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496010496 00000100:00100000:3.0:1790773126.480309:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496010496 00000100:00100000:3.0:1790773126.480358:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1790773126.480365:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3605:x1877761496010496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773126.480401:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3605:x1877761496010496:12345-0@lo:400:kworker.0 Request processed in 37us (1351us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773126.480407:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1790773126.480478:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce0675b4-b0c5-48e7-b182-565e22fed04c:3605:1877761496010496:0@lo:400:kworker.0 00000100:00100000:1.0:1790773126.480717:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790773126.480730:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496012160:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790773126.480762:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773126.480835:0:8397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496012160 00000100:00100000:0.0:1790773126.480839:0:8397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496012160 00000100:00100000:0.0:1790773126.480873:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790773126.480880:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496012160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790773126.480900:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790773126.480935:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496012160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773126.480940:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:1.0:1790773126.481050:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1437dc000 x1877761496012160/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773142 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773126.481064:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496012160:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790773126.484409:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790773126.484433:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496012288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790773126.484503:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773126.484595:0:11145:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496012288 00000100:00100000:0.0:1790773126.484603:0:11145:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496012288 00000100:00100000:0.0:1790773126.484658:0:11145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790773126.484667:0:11145:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ca5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496012288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790773126.484690:0:11145:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790773126.484748:0:11145:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ca5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496012288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773126.484755:0:11145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:0.0:1790773126.484795:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1437ddc00 x1877761496012288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773142 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773126.484812:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496012288:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1790773126.764859:0:12150:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg219-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1790773126.990672:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773128.013542:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773129.037462:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773129.550321:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790773129.551100:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496012544:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790773129.551174:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773129.551257:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496012416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790773129.551279:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773129.551370:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496012544 00000100:00100000:1.0:1790773129.551379:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496012544 00000100:00100000:1.0:1790773129.551435:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496012416 00000100:00100000:1.0:1790773129.551438:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496012416 00000100:00100000:1.0:1790773129.551454:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790773129.551463:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496012544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790773129.551499:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1790773129.552372:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790773129.552411:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790773129.552425:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496012416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790773129.552442:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790773129.553124:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496012416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 701us (1840us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773129.553134:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790773129.553309:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496012544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1846us (2134us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773129.553317:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:3.0:1790773129.553443:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143e4f480 x1877761496012416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773145 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773129.553463:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496012416:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1790773129.553804:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143e4fb80 x1877761496012544/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773145 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773129.553817:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496012544:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1790773130.067194:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773131.085327:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773131.311813:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773131.311870:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773131.311905:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773131.311930:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773131.311947:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773131.311964:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773131.311999:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773131.312029:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484405504 00000100:00100000:0.0:1790773131.312038:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484405504 00000100:00100000:0.0:1790773131.312089:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484405760 00000100:00100000:0.0:1790773131.312092:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484405760 00000100:00100000:0.0:1790773131.312106:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484405376 00000100:00100000:0.0:1790773131.312108:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484405376 00000100:00100000:0.0:1790773131.312118:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484405632 00000100:00100000:0.0:1790773131.312120:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484405632 00000100:00100000:0.0:1790773131.312134:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 141 00000100:00100000:0.0:1790773131.312142:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+5:2398:x1877761484405504:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1790773131.312251:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+5:2398:x1877761484405504:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 109us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773131.312259:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 141 00000100:00100000:0.0:1790773131.312278:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 142 00000100:00100000:0.0:1790773131.312297:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2398:x1877761484405760:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1790773131.312335:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2398:x1877761484405760:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 39us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773131.312341:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 142 00000100:00100000:0.0:1790773131.312355:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 143 00000100:00100000:0.0:1790773131.312361:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ed68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+6:2398:x1877761484405376:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1790773131.312401:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ed68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+6:2398:x1877761484405376:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 41us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773131.312407:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 143 00000100:00100000:0.0:1790773131.312420:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 144 00000100:00100000:0.0:1790773131.312449:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2398:x1877761484405632:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1790773131.312484:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2398:x1877761484405632:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 58us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773131.312499:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 144 00000100:00100000:0.0:1790773131.312528:0:8392:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484406016 00000100:00100000:0.0:1790773131.312532:0:8392:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484406016 00000100:00100000:0.0:1790773131.312575:0:8392:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484405888 00000100:00100000:0.0:1790773131.312578:0:8392:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484405888 00000100:00100000:0.0:1790773131.312609:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 55 00000100:00100000:0.0:1790773131.312616:0:8392:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1434bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2398:x1877761484406016:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1790773131.312656:0:8392:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1434bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2398:x1877761484406016:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 40us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773131.312662:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 55 00000100:00100000:0.0:1790773131.312681:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 56 00000100:00100000:0.0:1790773131.312687:0:8392:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2398:x1877761484405888:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1790773131.312725:0:8392:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2398:x1877761484405888:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 31us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773131.312732:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 56 00000100:00080000:0.0:1790773131.312764:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790773131.312774:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790773131.312776:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790773131.312785:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790773131.313489:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484405248 00000100:00100000:2.0:1790773131.313497:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484405248 00000100:00100000:2.0:1790773131.313543:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 305 00000100:00100000:2.0:1790773131.313551:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:2398:x1877761484405248:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1790773131.313593:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:2398:x1877761484405248:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 44us (1791us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773131.313600:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 305 00000100:00100000:2.0:1790773131.597499:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1790773131.597538:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496012672:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790773131.597617:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773131.597682:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496012800:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790773131.597721:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3604:1877761496013056:0@lo:400:kworker.0 00000100:00100000:2.0:1790773131.597765:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773131.597789:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773131.597790:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce0675b4-b0c5-48e7-b182-565e22fed04c:3607:1877761496012928:0@lo:400:kworker.0 00000100:00100000:0.0:1790773131.597807:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f96bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3604:1877761496013568:0@lo:400:kworker.0 00000100:00100000:2.0:1790773131.597818:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773131.597825:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773131.597839:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f969500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877761496013440:0@lo:400:kworker.0 00000100:00100000:0.0:1790773131.597839:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f969c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3604:1877761496014080:0@lo:400:kworker.0 00000100:00100000:2.0:1790773131.597858:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773131.597863:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496013184:0@lo:400:kworker.0 00000100:00100000:2.0:1790773131.597874:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f96aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496013952:0@lo:400:kworker.0 00000100:00100000:0.0:1790773131.597884:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773131.597893:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773131.597898:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f969880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3605:1877761496013696:0@lo:400:kworker.0 00000100:00100000:2.0:1790773131.597908:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1790773131.597914:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496013312:0@lo:400:kworker.0 00000100:00100000:0.0:1790773131.597915:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773131.597928:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3605:1877761496014208:0@lo:400:kworker.0 00000100:00100000:2.0:1790773131.597931:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773131.597944:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f96b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496013824:0@lo:400:kworker.0 00000100:00100000:0.0:1790773131.597945:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773131.597964:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773131.597970:0:6483:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496012800 00000100:00100000:0.0:1790773131.597977:0:6483:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496012800 00000100:00100000:2.0:1790773131.597979:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496014336:0@lo:400:kworker.0 00000100:00100000:2.0:1790773131.597996:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773131.598011:0:6483:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496013184 00000100:00100000:0.0:1790773131.598014:0:6483:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496013184 00000100:00100000:0.0:1790773131.598026:0:6483:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496013312 00000100:00100000:0.0:1790773131.598028:0:6483:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496013312 00000100:00100000:0.0:1790773131.598041:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1790773131.598051:0:6483:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3607:x1877761496012800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790773131.598089:0:6483:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1790773131.598151:0:6483:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3607:x1877761496012800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773131.598158:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1790773131.598177:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1790773131.598182:0:6483:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496013184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773131.598248:0:6483:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496013184:12345-0@lo:400:kworker.0 Request processed in 65us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773131.598255:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1790773131.598267:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1790773131.598273:0:6483:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496013312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773131.598338:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496012800:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790773131.598435:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496013056 00000100:00100000:1.0:1790773131.598440:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496013056 00000100:00100000:2.0:1790773131.598453:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496014464:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790773131.598460:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496013568 00000100:00100000:1.0:1790773131.598463:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496013568 00000100:00100000:3.0:1790773131.598514:0:11145:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496012672 00000100:00100000:3.0:1790773131.598519:0:11145:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496012672 00000100:00100000:3.0:1790773131.598558:0:11145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790773131.598564:0:11145:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496012672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790773131.598584:0:11145:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790773131.598628:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496013440 00000100:00100000:1.0:1790773131.598632:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496013440 00000100:00100000:1.0:1790773131.598642:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496013696 00000100:00100000:1.0:1790773131.598651:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496013696 00000100:00100000:1.0:1790773131.598666:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496014208 00000100:00100000:1.0:1790773131.598669:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496014208 00000100:00100000:1.0:1790773131.598682:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1790773131.598689:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3604:x1877761496013056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773131.599886:0:6483:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496013312:12345-0@lo:400:kworker.0 Request processed in 1605us (1946us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773131.599899:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1790773131.599943:0:8393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496013952 00000100:00100000:0.0:1790773131.599949:0:8393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496013952 00000100:00100000:0.0:1790773131.599989:0:8393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496013824 00000100:00100000:0.0:1790773131.599993:0:8393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496013824 00000100:00100000:0.0:1790773131.600012:0:8393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496014336 00000100:00100000:0.0:1790773131.600015:0:8393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496014336 00000100:00100000:0.0:1790773131.600030:0:8393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790773131.600036:0:8393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496013952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773131.600088:0:8393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496013952:12345-0@lo:400:kworker.0 Request processed in 51us (2192us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773131.600094:0:8393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790773131.600106:0:8393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790773131.600113:0:8393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496013824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773131.600144:0:8393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496013824:12345-0@lo:400:kworker.0 Request processed in 32us (2179us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773131.600150:0:8393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790773131.600161:0:8393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790773131.600167:0:8393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496014336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773131.600231:0:8393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496014336:12345-0@lo:400:kworker.0 Request processed in 64us (2233us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773131.600238:0:8393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790773131.600344:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496013184:0@lo:400:kworker.0 00000100:00100000:0.0:1790773131.600362:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790773131.600375:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496014592:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790773131.600407:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773131.600439:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496014592 00000100:00100000:0.0:1790773131.600443:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496014592 00000100:00100000:0.0:1790773131.600461:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790773131.600467:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496014592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790773131.600481:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790773131.600515:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496014592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773131.600521:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:0.0:1790773131.600546:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f9f5f80 x1877761496014592/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773147 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773131.600695:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496014592:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790773131.600740:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1790773131.600749:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3604:x1877761496013568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773131.600786:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3604:x1877761496013568:12345-0@lo:400:kworker.0 Request processed in 39us (2959us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773131.600792:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1790773131.600808:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1790773131.600815:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877761496013440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773131.600855:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877761496013440:12345-0@lo:400:kworker.0 Request processed in 41us (2996us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773131.600862:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1790773131.600875:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1790773131.600882:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3605:x1877761496013696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773131.600914:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3605:x1877761496013696:12345-0@lo:400:kworker.0 Request processed in 33us (2998us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773131.600920:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1790773131.600930:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1790773131.600937:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3605:x1877761496014208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773131.600982:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3605:x1877761496014208:12345-0@lo:400:kworker.0 Request processed in 46us (3036us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773131.600989:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1790773131.601009:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773131.601044:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f96bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3604:1877761496013568:0@lo:400:kworker.0 00000100:00100000:0.0:1790773131.601062:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496014080 00000100:00100000:0.0:1790773131.601064:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496014080 00000100:00100000:0.0:1790773131.601085:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1790773131.601091:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3604:x1877761496014080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773131.601125:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3604:x1877761496014080:12345-0@lo:400:kworker.0 Request processed in 34us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773131.601131:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1790773131.601155:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f969c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3604:1877761496014080:0@lo:400:kworker.0 00010000:00080000:0.0:1790773131.601180:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f969880 x1877761496013696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773131.601223:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f969880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3605:1877761496013696:0@lo:400:kworker.0 00010000:00080000:0.0:1790773131.601238:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f9f4380 x1877761496014208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773131.601248:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3605:1877761496014208:0@lo:400:kworker.0 00000100:00100000:0.0:1790773131.601291:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496012928 00000100:00100000:0.0:1790773131.601296:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496012928 00000100:00100000:0.0:1790773131.601332:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1790773131.601339:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3607:x1877761496012928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773131.601373:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3607:x1877761496012928:12345-0@lo:400:kworker.0 Request processed in 35us (3554us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773131.601379:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00080000:0.0:1790773131.601438:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790773131.601445:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790773131.601448:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790773131.601450:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790773131.610114:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773131.610194:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496013312:0@lo:400:kworker.0 00010000:00080000:0.0:1790773131.610243:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f96b480 x1877761496013824/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773131.610254:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f96b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496013824:0@lo:400:kworker.0 00010000:00080000:0.0:1790773131.610267:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f9f7100 x1877761496014336/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773131.610276:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496014336:0@lo:400:kworker.0 00000100:00100000:0.0:1790773131.610321:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce0675b4-b0c5-48e7-b182-565e22fed04c:3607:1877761496012928:0@lo:400:kworker.0 00000100:00100000:0.0:1790773131.610336:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f969500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877761496013440:0@lo:400:kworker.0 00010000:00080000:0.0:1790773131.610347:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f96aa00 x1877761496013952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773131.610355:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f96aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496013952:0@lo:400:kworker.0 00000100:00100000:0.0:1790773131.610424:0:6484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496014464 00000100:00100000:0.0:1790773131.610431:0:6484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496014464 00000100:00100000:0.0:1790773131.610475:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1790773131.610484:0:6484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496014464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790773131.610527:0:6484:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1790773131.610589:0:6484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496014464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773131.610597:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1790773131.610637:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496014464:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790773131.616022:0:11145:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496012672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 17444us (18390us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773131.616040:0:11145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:0.0:1790773131.616258:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1437d7b80 x1877761496012672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773147 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773131.616296:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496012672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790773131.618810:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3604:x1877761496013056:12345-0@lo:400:kworker.0 Request processed in 20112us (21010us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773131.618826:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1790773131.619029:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3604:1877761496013056:0@lo:400:kworker.0 00010000:00010000:1.0:1790773132.110730:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773133.136341:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773134.157433:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773134.669694:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143c7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496014720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790773134.669834:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773134.669937:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496014720 00000100:00100000:2.0:1790773134.669947:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496014720 00000100:00100000:2.0:1790773134.670003:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790773134.670012:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496014720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790773134.670471:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790773134.670573:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496014720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 561us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773134.670580:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:2.0:1790773134.670603:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790773134.675950:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143c7f800 x1877761496014720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773150 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773134.675976:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143c7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496014720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790773134.677579:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496014848:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790773134.677683:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773134.678344:0:8397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496014848 00000100:00100000:0.0:1790773134.678353:0:8397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496014848 00000100:00100000:0.0:1790773134.678414:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790773134.678423:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ca4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496014848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790773134.678450:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1790773134.678544:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790773134.679241:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ca4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496014848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 816us (1555us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773134.679259:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:3.0:1790773134.679452:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f9cf800 x1877761496014848/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773150 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773134.679475:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496014848:0@lo:13:osp-pre-0-1.0 00000020:00000004:0.0:1790773134.795161:0:12465:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790773134.795512:0:12465:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1790773135.181726:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773136.208990:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773136.432328:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773136.432374:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773136.432399:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773136.432420:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773136.432439:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773136.432455:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773136.432468:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484406144 00000100:00100000:0.0:1790773136.432475:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773136.432478:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484406144 00000100:00100000:0.0:1790773136.432495:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484406400 00000100:00100000:0.0:1790773136.432498:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484406400 00000100:00100000:3.0:1790773136.432527:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 307 00000100:00100000:0.0:1790773136.432533:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484406656 00000100:00100000:0.0:1790773136.432535:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484406656 00000100:00100000:3.0:1790773136.432537:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:2400:x1877761484406144:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1790773136.432546:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484406272 00000100:00100000:0.0:1790773136.432548:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484406272 00000100:00100000:0.0:1790773136.432557:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484406528 00000100:00100000:0.0:1790773136.432560:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484406528 00000100:00100000:0.0:1790773136.432574:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 151 00000100:00100000:0.0:1790773136.432580:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+5:2400:x1877761484406400:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1790773136.432616:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:2400:x1877761484406144:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 76us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773136.432618:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+5:2400:x1877761484406400:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 39us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773136.432625:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 151 00000100:00100000:3.0:1790773136.432639:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 307 00000100:00100000:0.0:1790773136.432642:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 152 00000100:00100000:0.0:1790773136.432647:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2400:x1877761484406656:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1790773136.432676:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2400:x1877761484406656:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 29us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773136.432682:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 152 00000100:00100000:0.0:1790773136.432693:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 153 00000100:00100000:0.0:1790773136.432698:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+6:2400:x1877761484406272:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1790773136.432719:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+6:2400:x1877761484406272:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 20us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773136.432725:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 153 00000100:00100000:0.0:1790773136.432737:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 154 00000100:00100000:0.0:1790773136.432742:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2400:x1877761484406528:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1790773136.432764:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2400:x1877761484406528:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 22us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773136.432770:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 154 00000100:00100000:0.0:1790773136.432791:0:8393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484406912 00000100:00100000:0.0:1790773136.432794:0:8393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484406912 00000100:00100000:0.0:1790773136.432898:0:8393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484406784 00000100:00100000:0.0:1790773136.432902:0:8393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484406784 00000100:00100000:0.0:1790773136.432928:0:8393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 60 00000100:00100000:0.0:1790773136.432935:0:8393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2400:x1877761484406912:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1790773136.432960:0:8393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2400:x1877761484406912:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 26us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773136.432966:0:8393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 60 00000100:00100000:0.0:1790773136.432978:0:8393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 61 00000100:00100000:0.0:1790773136.432984:0:8393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2400:x1877761484406784:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1790773136.433014:0:8393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2400:x1877761484406784:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 30us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773136.433021:0:8393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 61 00000100:00080000:0.0:1790773136.433048:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790773136.433053:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790773136.433056:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790773136.433058:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790773136.720558:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496014976:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790773136.720633:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773136.720680:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f96aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce0675b4-b0c5-48e7-b182-565e22fed04c:3607:1877761496015488:0@lo:400:kworker.0 00000100:00100000:0.0:1790773136.720705:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773136.720726:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f969c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877761496016000:0@lo:400:kworker.0 00000100:00100000:0.0:1790773136.720749:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773136.720766:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496016512:0@lo:400:kworker.0 00000100:00100000:0.0:1790773136.720786:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773136.720801:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143dec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496017024:0@lo:400:kworker.0 00000100:00100000:0.0:1790773136.720820:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773136.720843:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1790773136.720849:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496015360:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790773136.720870:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773136.720887:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f969880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496015872:0@lo:400:kworker.0 00000100:00100000:0.0:1790773136.720932:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773136.720950:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496016384:0@lo:400:kworker.0 00000100:00100000:0.0:1790773136.720969:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773136.720992:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143dedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496016896:0@lo:400:kworker.0 00000100:00100000:0.0:1790773136.721012:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773136.721039:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496015104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790773136.721060:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773136.721076:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f969500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3604:1877761496015616:0@lo:400:kworker.0 00000100:00100000:0.0:1790773136.721095:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773136.721109:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f96bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3604:1877761496016128:0@lo:400:kworker.0 00000100:00100000:0.0:1790773136.721127:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773136.721141:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3604:1877761496016640:0@lo:400:kworker.0 00000100:00100000:0.0:1790773136.721160:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773136.721176:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1790773136.721181:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496015232:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790773136.721263:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773136.721280:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f96b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496015744:0@lo:400:kworker.0 00000100:00100000:0.0:1790773136.721297:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773136.721305:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3604:1877761496016256:0@lo:400:kworker.0 00000100:00100000:0.0:1790773136.721322:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773136.721330:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3604:1877761496016768:0@lo:400:kworker.0 00000100:00100000:0.0:1790773136.721346:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773136.721371:0:7666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496014976 00000100:00100000:0.0:1790773136.721378:0:7666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496014976 00000100:00100000:0.0:1790773136.721412:0:7666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496015872 00000100:00100000:0.0:1790773136.721414:0:7666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496015872 00000100:00100000:0.0:1790773136.721423:0:7666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496015232 00000100:00100000:0.0:1790773136.721425:0:7666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496015232 00000100:00100000:0.0:1790773136.721435:0:7666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496015744 00000100:00100000:0.0:1790773136.721444:0:7666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496015744 00000100:00100000:0.0:1790773136.721459:0:7666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1790773136.721468:0:7666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26be9f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3607:x1877761496014976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790773136.721507:0:7666:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1790773136.721554:0:7666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26be9f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3607:x1877761496014976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773136.721560:0:7666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1790773136.723197:0:7666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1790773136.725450:0:8392:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496016512 00000100:00100000:1.0:1790773136.725482:0:8392:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496016512 00000100:00100000:1.0:1790773136.725548:0:8392:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496017024 00000100:00100000:1.0:1790773136.725552:0:8392:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496017024 00000100:00100000:1.0:1790773136.725567:0:8392:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496016384 00000100:00100000:1.0:1790773136.725569:0:8392:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496016384 00000100:00100000:1.0:1790773136.725580:0:8392:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496016896 00000100:00100000:1.0:1790773136.725583:0:8392:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496016896 00000100:00100000:1.0:1790773136.725601:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790773136.725611:0:8392:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143deca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496016512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773136.725717:0:8392:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143deca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496016512:12345-0@lo:400:kworker.0 Request processed in 107us (4928us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773136.725725:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790773136.725743:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1790773136.725750:0:8392:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143dece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496017024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773136.725781:0:8392:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143dece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496017024:12345-0@lo:400:kworker.0 Request processed in 32us (4960us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773136.725786:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1790773136.725796:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790773136.725802:0:8392:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143deed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496016384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773136.725842:0:8392:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143deed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496016384:12345-0@lo:400:kworker.0 Request processed in 40us (4871us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773136.725849:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790773136.725861:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790773136.725868:0:8392:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143defb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496016896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773136.725894:0:8392:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143defb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496016896:12345-0@lo:400:kworker.0 Request processed in 27us (4881us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773136.725899:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790773136.725922:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1790773136.725930:0:6483:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143dec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3604:x1877761496015232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790773136.725957:0:6483:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1790773136.725997:0:6483:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143dec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3604:x1877761496015232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 68us (4733us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773136.726003:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1790773136.726020:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1790773136.726026:0:6483:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496015744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773136.726055:0:6483:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496015744:12345-0@lo:400:kworker.0 Request processed in 30us (4757us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773136.726061:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1790773136.726080:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496015360 00000100:00100000:1.0:1790773136.726084:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496015360 00000100:00100000:1.0:1790773136.726107:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496015104 00000100:00100000:1.0:1790773136.726109:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496015104 00000100:00100000:1.0:1790773136.726120:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790773136.726125:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143def480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496015360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790773136.726144:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790773136.726181:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143def480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496015360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (5310us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773136.726224:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790773136.726246:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790773136.726252:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143dee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496015104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790773136.726262:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790773136.726533:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143dee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496015104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 281us (5471us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773136.726539:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790773136.726566:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496016000 00000100:00100000:1.0:1790773136.726570:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496016000 00000100:00100000:1.0:1790773136.726588:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496015616 00000100:00100000:1.0:1790773136.726591:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496015616 00000100:00100000:1.0:1790773136.726600:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496016128 00000100:00100000:1.0:1790773136.726602:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496016128 00000100:00100000:1.0:1790773136.726615:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496016640 00000100:00100000:0.0:1790773136.726618:0:7666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143def800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496015872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773136.726619:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496016640 00000100:00100000:1.0:1790773136.726633:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496016256 00000100:00100000:1.0:1790773136.726636:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496016256 00000100:00100000:1.0:1790773136.726654:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496016768 00000100:00100000:1.0:1790773136.726657:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496016768 00000100:00100000:0.0:1790773136.726660:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1790773136.726672:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143dee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877761496016000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773136.726678:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1790773136.726688:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ded500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3604:x1877761496015616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773136.726724:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143dee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877761496016000:12345-0@lo:400:kworker.0 Request processed in 55us (5972us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773136.726731:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1790773136.726736:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ded500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3604:x1877761496015616:12345-0@lo:400:kworker.0 Request processed in 49us (5639us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773136.726744:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1790773136.726750:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1790773136.726760:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143dec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3604:x1877761496016128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773136.726765:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1790773136.726775:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143def100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3604:x1877761496016640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773136.726802:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143dec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3604:x1877761496016128:12345-0@lo:400:kworker.0 Request processed in 44us (5673us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773136.726811:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1790773136.726817:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143def100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3604:x1877761496016640:12345-0@lo:400:kworker.0 Request processed in 43us (5655us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773136.726832:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1790773136.726842:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1790773136.726851:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143dedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3604:x1877761496016256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773136.726852:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1790773136.726865:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ded880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3604:x1877761496016768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773136.726888:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143dedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3604:x1877761496016256:12345-0@lo:400:kworker.0 Request processed in 38us (5564us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773136.726896:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1790773136.726911:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ded880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3604:x1877761496016768:12345-0@lo:400:kworker.0 Request processed in 48us (5562us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773136.726918:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1790773136.726944:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496015488 00000100:00100000:1.0:1790773136.726948:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496015488 00010000:00080000:0.0:1790773136.726970:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f9f5500 x1877761496015360/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773152 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773136.727016:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496015360:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790773136.727030:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00010000:00080000:0.0:1790773136.727036:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1437d7b80 x1877761496016384/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773136.727042:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3607:x1877761496015488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773136.727055:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496016384:0@lo:400:kworker.0 00010000:00080000:0.0:1790773136.727070:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143dedf80 x1877761496016896/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773136.727079:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143dedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496016896:0@lo:400:kworker.0 00000100:00100000:1.0:1790773136.727089:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3607:x1877761496015488:12345-0@lo:400:kworker.0 Request processed in 50us (6381us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773136.727097:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1790773136.727100:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496014976:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790773136.727113:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f96aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce0675b4-b0c5-48e7-b182-565e22fed04c:3607:1877761496015488:0@lo:400:kworker.0 00000100:00100000:0.0:1790773136.727125:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f969c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877761496016000:0@lo:400:kworker.0 00010000:00080000:0.0:1790773136.727136:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1437d4a80 x1877761496016512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773136.727144:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496016512:0@lo:400:kworker.0 00010000:00080000:0.0:1790773136.727155:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143dec700 x1877761496017024/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773136.727163:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143dec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496017024:0@lo:400:kworker.0 00000100:00080000:1.0:1790773136.727177:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790773136.727183:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790773136.727273:0:7666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143def800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496015872:12345-0@lo:400:kworker.0 Request processed in 4049us (6340us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773136.727280:0:7666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1790773136.727361:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f969880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496015872:0@lo:400:kworker.0 00000100:00080000:1.0:1790773136.727414:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790773136.727417:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790773136.727448:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496015232:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790773136.727528:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f96b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496015744:0@lo:400:kworker.0 00010000:00080000:1.0:1790773136.727542:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1437d6680 x1877761496016256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773136.727551:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3604:1877761496016256:0@lo:400:kworker.0 00010000:00080000:1.0:1790773136.727561:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1437d4e00 x1877761496016768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773136.727581:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3604:1877761496016768:0@lo:400:kworker.0 00010000:00080000:1.0:1790773136.727593:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f9f7b80 x1877761496015104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773152 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773136.727604:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496015104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790773136.727614:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f969500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3604:1877761496015616:0@lo:400:kworker.0 00000100:00100000:1.0:1790773136.727624:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f96bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3604:1877761496016128:0@lo:400:kworker.0 00000100:00100000:1.0:1790773136.727632:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3604:1877761496016640:0@lo:400:kworker.0 00000020:00000004:1.0:1790773136.747111:0:12562:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790773136.747677:0:12562:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790773137.229358:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773138.253397:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1790773138.873670:0:12660:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790773138.873944:0:12660:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1790773139.284254:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773139.791730:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ca7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496017152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790773139.791865:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773139.792573:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496017152 00000100:00100000:2.0:1790773139.792582:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496017152 00000100:00100000:2.0:1790773139.792655:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790773139.792668:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c582050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496017152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790773139.792712:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790773139.792767:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c582050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496017152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773139.792774:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:3.0:1790773139.793171:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790773139.793234:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143ca7480 x1877761496017152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773155 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773139.793254:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ca7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496017152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790773139.793856:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790773139.793872:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143dec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496017280:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790773139.793979:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773139.794125:0:11145:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496017280 00000100:00100000:0.0:1790773139.794132:0:11145:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496017280 00000100:00100000:0.0:1790773139.794267:0:11145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1790773139.794276:0:11145:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ca7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496017280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790773139.794295:0:11145:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790773139.794345:0:11145:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ca7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496017280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773139.794362:0:11145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:0.0:1790773139.794401:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143dec700 x1877761496017280/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773155 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773139.794416:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143dec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496017280:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1790773139.797548:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790773140.301384:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1790773140.968864:0:12758:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790773140.969108:0:12758:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790773141.325552:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773141.553101:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773141.553146:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773141.553199:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773141.553246:0:8392:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484407680 00000100:00100000:0.0:1790773141.553257:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773141.553259:0:8392:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484407680 00000100:00100000:0.0:1790773141.553281:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773141.553305:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773141.553328:0:8392:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484407808 00000100:00100000:1.0:1790773141.553332:0:8392:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484407808 00000100:00100000:1.0:1790773141.553359:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 22 00000100:00100000:1.0:1790773141.553371:0:8392:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143dec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2396:x1877761484407680:12345-192.168.202.19@tcp:9:kworker.0 00000100:00100000:0.0:1790773141.553386:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000020:00000080:1.0:1790773141.553405:0:8392:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7841a46 00000100:00100000:0.0:1790773141.553414:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484407040 00000100:00080000:1.0:1790773141.553417:0:8392:0:(import.c:65:import_set_state_nolock()) ffff93d143c81000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1790773141.553419:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484407040 00000100:00100000:0.0:1790773141.553458:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 309 00000100:00100000:0.0:1790773141.553467:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:2399:x1877761484407040:12345-192.168.202.19@tcp:400:kworker.0 00000001:00000004:1.0:1790773141.553480:0:8392:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1790773141.553538:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:2399:x1877761484407040:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 71us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773141.553547:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 309 00000100:00100000:0.0:1790773141.553587:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484407296 00000100:00100000:0.0:1790773141.553598:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484407296 00000100:00100000:0.0:1790773141.553625:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484407552 00000100:00100000:0.0:1790773141.553628:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484407552 00000100:00100000:1.0:1790773141.553638:0:8392:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143dec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+2:2396:x1877761484407680:12345-192.168.202.19@tcp:9:kworker.0 Request processed in 268us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773141.553643:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484407168 00000100:00100000:0.0:1790773141.553646:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484407168 00000100:00100000:1.0:1790773141.553659:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 22 00000100:00100000:0.0:1790773141.553660:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484407424 00000100:00100000:0.0:1790773141.553664:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484407424 00000100:00100000:1.0:1790773141.553681:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 23 00000100:00100000:0.0:1790773141.553686:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 161 00000100:00100000:1.0:1790773141.553693:0:8392:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143dedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2396:x1877761484407808:12345-192.168.202.19@tcp:9:kworker.0 00000100:00100000:0.0:1790773141.553700:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143deea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+5:2399:x1877761484407296:12345-192.168.202.19@tcp:400:kworker.0 00000020:00000080:1.0:1790773141.553709:0:8392:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7841a4d 00000100:00080000:1.0:1790773141.553717:0:8392:0:(import.c:65:import_set_state_nolock()) ffff93d143c87800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1790773141.553735:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143deea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+5:2399:x1877761484407296:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 41us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773141.553742:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 161 00000001:00000004:1.0:1790773141.553744:0:8392:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1790773141.553757:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 162 00000100:00100000:0.0:1790773141.553764:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143def480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2399:x1877761484407552:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1790773141.553792:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143def480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2399:x1877761484407552:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 29us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773141.553800:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 162 00000100:00100000:0.0:1790773141.553815:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 163 00000100:00100000:0.0:1790773141.553823:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143dee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+6:2399:x1877761484407168:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773141.553841:0:8392:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143dedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+2:2396:x1877761484407808:12345-192.168.202.19@tcp:9:kworker.0 Request processed in 151us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773141.553852:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143dee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+6:2399:x1877761484407168:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 29us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773141.553853:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 23 00000100:00100000:0.0:1790773141.553864:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 163 00000100:00100000:0.0:1790773141.553879:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 164 00000100:00080000:1.0:1790773141.553884:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790773141.553885:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2399:x1877761484407424:12345-192.168.202.19@tcp:400:kworker.0 00000100:00080000:1.0:1790773141.553890:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790773141.553895:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790773141.553898:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790773141.553911:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2399:x1877761484407424:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 26us (525us total) trans 0 rc 0/0 00010000:00010000:1.0:1790773141.553912:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773141.553919:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773141.553926:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 164 00000100:00100000:0.0:1790773141.837363:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496017408:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790773141.837484:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773141.837757:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143c7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3604:1877761496017664:0@lo:400:kworker.0 00000100:00100000:2.0:1790773141.837791:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773141.837840:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143c7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3604:1877761496018176:0@lo:400:kworker.0 00000100:00100000:2.0:1790773141.837862:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773141.837896:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3604:1877761496018688:0@lo:400:kworker.0 00000100:00100000:2.0:1790773141.837934:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773141.837963:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1790773141.837970:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143c7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496017792:0@lo:400:kworker.0 00000100:00100000:2.0:1790773141.838004:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496017664 00000100:00100000:2.0:1790773141.838022:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496017664 00000100:00100000:2.0:1790773141.838063:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496018176 00000100:00100000:2.0:1790773141.838066:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496018176 00000100:00100000:2.0:1790773141.838085:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496018688 00000100:00100000:2.0:1790773141.838095:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496018688 00000100:00100000:2.0:1790773141.838114:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1790773141.838122:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3604:x1877761496017664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773141.838177:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3604:x1877761496017664:12345-0@lo:400:kworker.0 Request processed in 55us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773141.838195:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1790773141.838639:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1790773141.838648:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3604:x1877761496018176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773141.838682:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3604:x1877761496018176:12345-0@lo:400:kworker.0 Request processed in 37us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773141.838688:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1790773141.838747:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1790773141.838754:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3604:x1877761496018688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773141.838782:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3604:x1877761496018688:12345-0@lo:400:kworker.0 Request processed in 30us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773141.838789:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:2.0:1790773141.838816:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790773141.839199:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143c7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496017920:0@lo:400:kworker.0 00000100:00100000:0.0:1790773141.839311:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773141.839331:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143c7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496018432:0@lo:400:kworker.0 00000100:00100000:0.0:1790773141.839353:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773141.839369:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496018944:0@lo:400:kworker.0 00000100:00100000:0.0:1790773141.839388:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773141.839411:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1790773141.839417:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143c7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce0675b4-b0c5-48e7-b182-565e22fed04c:3606:1877761496017536:0@lo:400:kworker.0 00000100:00100000:0.0:1790773141.839443:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773141.839462:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143c7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3606:1877761496018048:0@lo:400:kworker.0 00000100:00100000:0.0:1790773141.839482:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773141.839630:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143c7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496018560:0@lo:400:kworker.0 00000100:00100000:0.0:1790773141.839656:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773141.839671:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496019072:0@lo:400:kworker.0 00000100:00100000:0.0:1790773141.840007:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773141.840059:0:6484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496017408 00000100:00100000:0.0:1790773141.840066:0:6484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496017408 00000100:00100000:0.0:1790773141.840102:0:6484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496017920 00000100:00100000:0.0:1790773141.840105:0:6484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496017920 00000100:00100000:0.0:1790773141.840118:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1790773141.840125:0:6484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3606:x1877761496017408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790773141.840168:0:6484:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1790773141.840386:0:8394:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496018432 00000100:00100000:1.0:1790773141.840390:0:8394:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496018432 00000100:00100000:1.0:1790773141.840420:0:8394:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496018944 00000100:00100000:1.0:1790773141.840423:0:8394:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496018944 00000100:00100000:1.0:1790773141.840435:0:8394:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496018560 00000100:00100000:1.0:1790773141.840438:0:8394:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496018560 00000100:00100000:1.0:1790773141.840450:0:8394:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496019072 00000100:00100000:1.0:1790773141.840452:0:8394:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496019072 00000100:00100000:1.0:1790773141.840464:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790773141.840470:0:8394:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496018432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773141.840544:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1790773141.840553:0:6483:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3606:x1877761496017920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773141.843038:0:8394:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496018432:12345-0@lo:400:kworker.0 Request processed in 2558us (3673us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773141.843053:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790773141.843096:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790773141.843107:0:8394:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496018944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773141.843176:0:8394:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496018944:12345-0@lo:400:kworker.0 Request processed in 74us (3787us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773141.843196:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790773141.843231:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790773141.843238:0:8394:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496018560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773141.843270:0:8394:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496018560:12345-0@lo:400:kworker.0 Request processed in 33us (3614us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773141.843275:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790773141.843286:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790773141.843293:0:8394:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496019072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773141.843322:0:8394:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496019072:12345-0@lo:400:kworker.0 Request processed in 29us (3629us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773141.843327:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790773141.843358:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496017536 00000100:00100000:1.0:1790773141.843365:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496017536 00000100:00100000:1.0:1790773141.843447:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1790773141.843454:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d252ea1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3606:x1877761496017536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773141.843485:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d252ea1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3606:x1877761496017536:12345-0@lo:400:kworker.0 Request processed in 32us (4041us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773141.845653:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1790773141.845822:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790773141.845839:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496019456:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790773141.845908:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773141.845969:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143c7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce0675b4-b0c5-48e7-b182-565e22fed04c:3606:1877761496017536:0@lo:400:kworker.0 00010000:00080000:1.0:1790773141.845997:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143c7f800 x1877761496018560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773141.846009:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143c7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496018560:0@lo:400:kworker.0 00010000:00080000:1.0:1790773141.846021:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143e02a00 x1877761496019072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773141.846029:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496019072:0@lo:400:kworker.0 00010000:00080000:1.0:1790773141.846039:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143c7df80 x1877761496018432/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773141.846047:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143c7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496018432:0@lo:400:kworker.0 00010000:00080000:1.0:1790773141.846057:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143e03100 x1877761496018944/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773141.846066:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496018944:0@lo:400:kworker.0 00000100:00100000:1.0:1790773141.846130:0:7666:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 3 min 2 max 116 00000100:00100000:1.0:1790773141.846139:0:7666:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_003' 00000100:00100000:1.0:1790773141.847612:0:7666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496019456 00000100:00100000:2.0:1790773141.847786:0:6483:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3606:x1877761496017920:12345-0@lo:400:kworker.0 Request processed in 7230us (8470us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773141.847799:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:2.0:1790773141.847837:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790773141.847842:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790773141.847885:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143c7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496017920:0@lo:400:kworker.0 00000100:00100000:2.0:1790773141.847915:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496019328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790773141.847957:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773141.847987:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790773141.847993:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496019200:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790773141.848014:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773141.848039:0:8397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496019328 00000100:00100000:2.0:1790773141.848044:0:8397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496019328 00000100:00100000:2.0:1790773141.848082:0:8397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496019200 00000100:00100000:2.0:1790773141.848085:0:8397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496019200 00000100:00100000:2.0:1790773141.848098:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790773141.848106:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496019328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790773141.848139:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790773141.848199:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496019328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773141.848379:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790773141.848394:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790773141.848401:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496019200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790773141.848411:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790773141.848437:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496019200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 37us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773141.848442:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:2.0:1790773141.848475:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f9ced80 x1877761496019200/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773157 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773141.848494:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496019200:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1790773141.848504:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f9cfb80 x1877761496019328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773157 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773141.848515:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496019328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790773141.848550:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496018048 00000100:00100000:2.0:1790773141.848553:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496018048 00000100:00100000:2.0:1790773141.848579:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1790773141.848585:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1877761496018048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773141.848635:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1877761496018048:12345-0@lo:400:kworker.0 Request processed in 38us (9139us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773141.848641:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1790773141.848672:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143c7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3606:1877761496018048:0@lo:400:kworker.0 00000100:00100000:2.0:1790773141.848692:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773141.848716:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143c7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3604:1877761496018304:0@lo:400:kworker.0 00000100:00100000:2.0:1790773141.848743:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773141.848760:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3604:1877761496018816:0@lo:400:kworker.0 00000100:00100000:2.0:1790773141.848780:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773141.848805:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143c7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3604:1877761496017664:0@lo:400:kworker.0 00000100:00100000:2.0:1790773141.848816:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143c7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3604:1877761496018176:0@lo:400:kworker.0 00000100:00100000:2.0:1790773141.848828:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3604:1877761496018688:0@lo:400:kworker.0 00000100:00100000:2.0:1790773141.848849:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496018304 00000100:00100000:2.0:1790773141.848852:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496018304 00000100:00100000:2.0:1790773141.848879:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496018816 00000100:00100000:2.0:1790773141.848882:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496018816 00000100:00100000:2.0:1790773141.848896:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1790773141.848902:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3604:x1877761496018304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773141.848935:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3604:x1877761496018304:12345-0@lo:400:kworker.0 Request processed in 33us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773141.848950:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1790773141.848961:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1790773141.848966:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3604:x1877761496018816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773141.848991:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3604:x1877761496018816:12345-0@lo:400:kworker.0 Request processed in 26us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773141.848997:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00080000:2.0:1790773141.849015:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790773141.849023:0:6483:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496017792 00000100:00100000:2.0:1790773141.849025:0:6483:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496017792 00000100:00100000:2.0:1790773141.849039:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1790773141.849044:0:6483:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496017792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773141.849071:0:6483:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496017792:12345-0@lo:400:kworker.0 Request processed in 27us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773141.849077:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1790773141.849101:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143c7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496017792:0@lo:400:kworker.0 00010000:00080000:2.0:1790773141.849112:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143c7ca80 x1877761496018304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773141.849120:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143c7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3604:1877761496018304:0@lo:400:kworker.0 00010000:00080000:2.0:1790773141.849129:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143e00380 x1877761496018816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773141.849137:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3604:1877761496018816:0@lo:400:kworker.0 00000100:00100000:1.0:1790773141.849562:0:7666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496019456 00000100:00100000:1.0:1790773141.849599:0:7666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1790773141.849607:0:7666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496019456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790773141.849643:0:7666:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1790773141.849692:0:7666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496019456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (3784us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773141.849699:0:7666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1790773141.849739:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496019456:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790773141.855678:0:6484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496017408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 15530us (18171us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773141.855695:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1790773141.856361:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496017408:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1790773142.349726:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1790773142.918830:0:12856:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790773142.919126:0:12856:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1790773143.374352:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773144.398392:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773144.909762:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496019584:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790773144.909839:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773144.910028:0:8397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496019584 00000100:00100000:0.0:1790773144.910037:0:8397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496019584 00000100:00100000:0.0:1790773144.910106:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790773144.910117:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496019584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790773144.910147:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790773144.910244:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496019584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 129us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773144.910252:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:0.0:1790773144.910301:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d2447df100 x1877761496019584/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773160 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773144.910319:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496019584:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1790773144.910622:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790773144.912095:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790773144.914241:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496019712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790773144.914317:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773144.914807:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496019712 00000100:00100000:2.0:1790773144.914823:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496019712 00000100:00100000:2.0:1790773144.914889:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790773144.914898:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496019712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790773144.914921:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790773144.914966:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496019712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773144.914972:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1790773144.915135:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790773144.915178:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f9cc380 x1877761496019712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773160 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773144.915229:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496019712:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790773145.429292:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773146.447324:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773146.683535:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773146.684402:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773146.684437:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773146.684469:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773146.684548:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773146.684750:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484408192 00000100:00100000:2.0:1790773146.684761:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484408192 00000100:00100000:2.0:1790773146.684818:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484408448 00000100:00100000:2.0:1790773146.684822:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484408448 00000100:00100000:2.0:1790773146.684851:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484408064 00000100:00100000:2.0:1790773146.684853:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484408064 00000100:00100000:2.0:1790773146.684864:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484408320 00000100:00100000:2.0:1790773146.684867:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484408320 00000100:00100000:2.0:1790773146.684881:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 171 00000100:00100000:2.0:1790773146.684890:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+5:2397:x1877761484408192:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1790773146.684968:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+5:2397:x1877761484408192:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 79us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773146.684975:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 171 00000100:00100000:2.0:1790773146.684992:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 172 00000100:00100000:2.0:1790773146.684998:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2397:x1877761484408448:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1790773146.685022:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2397:x1877761484408448:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 24us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773146.685027:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 172 00000100:00100000:2.0:1790773146.685037:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 173 00000100:00100000:2.0:1790773146.685051:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ed69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+6:2397:x1877761484408064:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1790773146.685076:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ed69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+6:2397:x1877761484408064:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 27us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773146.685082:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 173 00000100:00100000:2.0:1790773146.685093:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 174 00000100:00100000:2.0:1790773146.685098:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ed6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2397:x1877761484408320:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1790773146.685116:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ed6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2397:x1877761484408320:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 19us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773146.685121:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 174 00000100:00080000:0.0:1790773146.687133:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790773146.687154:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790773146.688582:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484407936 00000100:00100000:3.0:1790773146.688595:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484407936 00000100:00100000:3.0:1790773146.688656:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 311 00000100:00100000:3.0:1790773146.688666:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d252ea0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:2397:x1877761484407936:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1790773146.688757:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d252ea0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:2397:x1877761484407936:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 91us (5234us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773146.688765:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 311 00000100:00100000:1.0:1790773146.957680:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496019840:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790773146.957768:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773146.957842:0:7666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496019840 00000100:00100000:1.0:1790773146.957850:0:7666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496019840 00000100:00100000:1.0:1790773146.957898:0:7666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1790773146.957908:0:7666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496019840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790773146.957942:0:7666:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1790773146.957995:0:7666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496019840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773146.958004:0:7666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1790773146.958081:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3604:1877761496020224:0@lo:400:kworker.0 00000100:00100000:2.0:1790773146.958087:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496019968:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790773146.958127:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773146.958148:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773146.958165:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ec63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3604:1877761496020736:0@lo:400:kworker.0 00000100:00100000:2.0:1790773146.958177:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3606:1877761496020480:0@lo:400:kworker.0 00000100:00100000:1.0:1790773146.958193:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773146.958233:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce0675b4-b0c5-48e7-b182-565e22fed04c:3607:1877761496020096:0@lo:400:kworker.0 00000100:00100000:1.0:1790773146.958248:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ec60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3604:1877761496021376:0@lo:400:kworker.0 00000100:00100000:2.0:1790773146.958267:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773146.958277:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773146.958304:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ec60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3607:1877761496020608:0@lo:400:kworker.0 00000100:00100000:1.0:1790773146.958304:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496021760:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790773146.958344:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773146.958349:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773146.958371:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1790773146.958376:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ec63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3607:1877761496021120:0@lo:400:kworker.0 00000100:00100000:1.0:1790773146.958381:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496020352:0@lo:400:kworker.0 00000100:00100000:2.0:1790773146.958402:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773146.958416:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ec61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496021632:0@lo:400:kworker.0 00000100:00100000:1.0:1790773146.958422:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773146.958446:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773146.958450:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ec61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496020864:0@lo:400:kworker.0 00000100:00100000:1.0:1790773146.958481:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773146.958493:0:6483:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496019968 00000100:00100000:2.0:1790773146.958498:0:6483:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496019968 00000100:00100000:1.0:1790773146.958503:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496021248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790773146.958527:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773146.958529:0:6483:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496020352 00000100:00100000:2.0:1790773146.958533:0:6483:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496020352 00000100:00100000:1.0:1790773146.958562:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496020224 00000100:00100000:1.0:1790773146.958567:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496020224 00000100:00100000:2.0:1790773146.958569:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1790773146.958579:0:6483:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3606:x1877761496019968:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790773146.958592:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496020736 00000100:00100000:1.0:1790773146.958596:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496020736 00000004:00000024:2.0:1790773146.958602:0:6483:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1790773146.958623:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496021376 00000100:00100000:1.0:1790773146.958627:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496021376 00000100:00100000:2.0:1790773146.958643:0:6483:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3606:x1877761496019968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 65us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773146.958644:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496020608 00000100:00100000:1.0:1790773146.958648:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496020608 00000100:00100000:2.0:1790773146.958654:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1790773146.958666:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496021120 00000100:00100000:1.0:1790773146.958670:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496021120 00000100:00100000:2.0:1790773146.958674:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1790773146.958689:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1790773146.958754:0:6483:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496020352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773146.958796:0:6483:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496020352:12345-0@lo:400:kworker.0 Request processed in 114us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773146.958802:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1790773146.961966:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3604:x1877761496020224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773146.962074:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3604:x1877761496020224:12345-0@lo:400:kworker.0 Request processed in 3378us (3947us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773146.962085:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1790773146.962276:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1790773146.962289:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3604:x1877761496020736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773146.962328:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3604:x1877761496020736:12345-0@lo:400:kworker.0 Request processed in 45us (4135us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773146.962335:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1790773146.962349:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1790773146.962356:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3604:x1877761496021376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773146.962407:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3604:x1877761496021376:12345-0@lo:400:kworker.0 Request processed in 52us (4131us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773146.962414:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1790773146.962430:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1790773146.962439:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1877761496020608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773146.962485:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1877761496020608:12345-0@lo:400:kworker.0 Request processed in 49us (4139us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773146.962491:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1790773146.962501:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1790773146.962507:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1877761496021120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773146.962535:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1877761496021120:12345-0@lo:400:kworker.0 Request processed in 27us (4133us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773146.962540:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1790773146.962567:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496020096 00000100:00100000:1.0:1790773146.962576:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496020096 00000100:00100000:1.0:1790773146.962612:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1790773146.962618:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d252ea3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3607:x1877761496020096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773146.962648:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d252ea3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3607:x1877761496020096:12345-0@lo:400:kworker.0 Request processed in 30us (4381us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773146.962655:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1790773146.962691:0:11145:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496021760 00000100:00100000:1.0:1790773146.962695:0:11145:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496021760 00000100:00100000:1.0:1790773146.962724:0:11145:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496021248 00000100:00100000:1.0:1790773146.962728:0:11145:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496021248 00000100:00100000:1.0:1790773146.962742:0:11145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790773146.962748:0:11145:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496021760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790773146.962780:0:11145:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790773146.962882:0:11145:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496021760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 131us (4536us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773146.962888:0:11145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790773146.962900:0:11145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790773146.962907:0:11145:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496021248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790773146.962916:0:11145:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790773146.962942:0:11145:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496021248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 37us (4415us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773146.962948:0:11145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790773146.962973:0:8394:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496021632 00000100:00100000:1.0:1790773146.962977:0:8394:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496021632 00000100:00100000:1.0:1790773146.963001:0:8394:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496020864 00000100:00100000:1.0:1790773146.963004:0:8394:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496020864 00000100:00100000:1.0:1790773146.963023:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790773146.963029:0:8394:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496021632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773146.963060:0:8394:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496021632:12345-0@lo:400:kworker.0 Request processed in 31us (4615us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773146.963066:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790773146.963076:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1790773146.963082:0:8394:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496020864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773146.963232:0:8394:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496020864:12345-0@lo:400:kworker.0 Request processed in 149us (4750us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773146.963238:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:1.0:1790773146.963264:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790773146.963269:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790773146.963278:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790773146.963281:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790773146.963327:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773146.963367:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ec60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496020992:0@lo:400:kworker.0 00000100:00100000:1.0:1790773146.963406:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773146.963424:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ec61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496021504:0@lo:400:kworker.0 00000100:00100000:1.0:1790773146.963445:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773146.963493:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496019968:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790773146.963524:0:8393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496020992 00000100:00100000:1.0:1790773146.963527:0:8393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496020992 00000100:00100000:1.0:1790773146.963554:0:8393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496021504 00000100:00100000:1.0:1790773146.963556:0:8393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496021504 00000100:00100000:1.0:1790773146.963569:0:8393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790773146.963574:0:8393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496020992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773146.963605:0:8393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496020992:12345-0@lo:400:kworker.0 Request processed in 30us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773146.963611:0:8393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790773146.963621:0:8393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790773146.963626:0:8393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496021504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773146.963653:0:8393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496021504:12345-0@lo:400:kworker.0 Request processed in 27us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773146.963659:0:8393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:1.0:1790773146.963676:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790773146.963702:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496019840:0@lo:41:osp-pre-1-0.0 00010000:00080000:1.0:1790773146.963754:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d26ec60380 x1877761496020992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773146.963777:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ec60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496020992:0@lo:400:kworker.0 00010000:00080000:1.0:1790773146.963789:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d26ec61c00 x1877761496021504/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773146.963797:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ec61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496021504:0@lo:400:kworker.0 00000001:00100000:2.0:1790773146.964461:0:9475:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f 00000020:00000080:2.0:1790773146.964467:0:9475:0:(genops.c:885:class_export_put()) final put ffff93d143c85800/18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f 00000020:00000080:2.0:1790773146.964490:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93d143c85800/18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f for lustre-OST0001 00000020:00000080:2.0:1790773146.964530:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d143c87800 for lustre-OST0001 00000001:00100000:3.0:1790773146.965610:0:8388:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f 00000020:00000080:3.0:1790773146.965616:0:8388:0:(genops.c:885:class_export_put()) final put ffff93d143c84800/18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f 00000020:00000080:3.0:1790773146.965644:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93d143c84800/18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f for lustre-OST0000 00000020:00000080:3.0:1790773146.965674:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d143c81000 for lustre-OST0000 00000100:00100000:1.0:1790773146.965977:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496020352:0@lo:400:kworker.0 00010000:00080000:1.0:1790773146.965998:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d26ec61500 x1877761496020864/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773146.966009:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ec61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496020864:0@lo:400:kworker.0 00010000:00080000:1.0:1790773146.966023:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f9cd180 x1877761496021248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773162 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773146.966041:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496021248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790773146.966054:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3604:1877761496020224:0@lo:400:kworker.0 00010000:00080000:1.0:1790773146.966066:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d26ec63800 x1877761496020736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773146.966074:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ec63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3604:1877761496020736:0@lo:400:kworker.0 00010000:00080000:1.0:1790773146.966084:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d26ec60000 x1877761496021376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773146.966092:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ec60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3604:1877761496021376:0@lo:400:kworker.0 00010000:00080000:1.0:1790773146.966318:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f9cdc00 x1877761496021760/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773162 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773146.966345:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496021760:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790773146.966406:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496020480 00000100:00100000:1.0:1790773146.966413:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496020480 00000100:00100000:1.0:1790773146.966459:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1790773146.966469:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1877761496020480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773146.966556:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1877761496020480:12345-0@lo:400:kworker.0 Request processed in 88us (3227us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773146.966563:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1790773146.966605:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3606:1877761496020480:0@lo:400:kworker.0 00000100:00100000:0.0:1790773146.966929:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce0675b4-b0c5-48e7-b182-565e22fed04c:3607:1877761496020096:0@lo:400:kworker.0 00000100:00100000:0.0:1790773146.966945:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ec60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3607:1877761496020608:0@lo:400:kworker.0 00000100:00100000:0.0:1790773146.966957:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ec63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3607:1877761496021120:0@lo:400:kworker.0 00010000:00080000:0.0:1790773146.966970:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d26ec61f80 x1877761496021632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773146.966979:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ec61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496021632:0@lo:400:kworker.0 00000001:02000400:0.0:1790773147.009486:0:13000:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1790773147.470931:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773148.497843:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773149.521189:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773150.032965:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ed6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496021888:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790773150.033027:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773150.033095:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790773150.033112:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496022016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790773150.033139:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773150.033173:0:11145:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496021888 00000100:00100000:1.0:1790773150.033191:0:11145:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496021888 00000100:00100000:1.0:1790773150.033264:0:11145:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496022016 00000100:00100000:1.0:1790773150.033268:0:11145:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496022016 00000100:00080000:0.0:1790773150.033274:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790773150.033287:0:11145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790773150.033300:0:11145:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496021888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790773150.033331:0:11145:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790773150.033386:0:11145:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496021888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773150.033393:0:11145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790773150.033409:0:11145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00010000:00080000:0.0:1790773150.033416:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d26ed6b800 x1877761496021888/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773166 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773150.033425:0:11145:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ec61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496022016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790773150.033434:0:11145:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790773150.033435:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ed6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496021888:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790773150.033463:0:11145:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ec61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496022016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 38us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773150.033469:0:11145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:1.0:1790773150.033498:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143e03100 x1877761496022016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773166 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773150.033511:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496022016:0@lo:13:osp-pre-0-0.0 00000020:00000080:3.0:1790773150.468026:0:13148:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe92c3ed10 20000000:00000080:3.0:1790773150.468044:0:13148:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93d143c23c00 uarg=0000000000000000 20000000:01000000:3.0:1790773150.468088:0:13148:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1790773150.468096:0:13148:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1790773150.468109:0:13148:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1790773150.471243:0:13149:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1790773150.471497:0:13148:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1790773150.481948:0:13148:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1790773150.483076:0:13148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93d26efc4c00/0xabf1cc0bc7841a54 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773150.483110:0:13148:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d26c4a2600/0xabf1cc0bc78419e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bacf expref: 12 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773150.483120:0:13148:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d26c4a2c00/0xabf1cc0bc78419f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78419eb expref: 23 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773150.483127:0:13148:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d279de3000/0xabf1cc0bc7841a00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78419f9 expref: 23 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773150.483151:0:13148:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d279de3600/0xabf1cc0bc7841a0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7841a07 expref: 23 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773150.483158:0:13148:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d279de2000/0xabf1cc0bc7841a1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7841a15 expref: 23 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773150.483165:0:13148:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d26efc5c00/0xabf1cc0bc7841a31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb0e expref: 12 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773150.483173:0:13148:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93d26efc4c00/0xabf1cc0bc7841a54 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773150.483239:0:13148:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d26efc5c00/0xabf1cc0bc7841a31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb0e expref: 12 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773150.483255:0:13148:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d26efc5c00/0xabf1cc0bc7841a31 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb0e expref: 12 pid: 6471 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773150.483270:0:13148:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13148:1877761496022144:192.168.202.19@tcp:104: 00010000:00010000:2.0:1790773150.483374:0:13148:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d279de2000/0xabf1cc0bc7841a1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc7841a15 expref: 23 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773150.483382:0:13148:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d279de2000/0xabf1cc0bc7841a1c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc7841a15 expref: 23 pid: 6471 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773150.483391:0:13148:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13148:1877761496022272:0@lo:104: 00000100:00100000:2.0:1790773150.483426:0:13148:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790773150.483450:0:13148:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d279de3600/0xabf1cc0bc7841a0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc7841a07 expref: 23 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773150.483464:0:13148:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d279de3600/0xabf1cc0bc7841a0e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc7841a07 expref: 23 pid: 6471 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773150.483472:0:13148:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13148:1877761496022400:0@lo:104: 00000100:00100000:2.0:1790773150.483490:0:13148:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790773150.483514:0:13148:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d279de3000/0xabf1cc0bc7841a00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc78419f9 expref: 23 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773150.483521:0:13148:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d279de3000/0xabf1cc0bc7841a00 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc78419f9 expref: 23 pid: 6473 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773150.483529:0:13148:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f96b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13148:1877761496022528:0@lo:104: 00000100:00100000:2.0:1790773150.483544:0:13148:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790773150.483562:0:13148:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d26c4a2c00/0xabf1cc0bc78419f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc78419eb expref: 23 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773150.483570:0:13148:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d26c4a2c00/0xabf1cc0bc78419f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc78419eb expref: 23 pid: 6472 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773150.483577:0:13148:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f96bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13148:1877761496022656:0@lo:104: 00000100:00100000:2.0:1790773150.483595:0:13148:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790773150.483607:0:13148:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d26c4a2600/0xabf1cc0bc78419e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bacf expref: 12 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773150.483615:0:13148:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d26c4a2600/0xabf1cc0bc78419e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bacf expref: 12 pid: 6473 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773150.483623:0:13148:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f969500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13148:1877761496022784:192.168.202.19@tcp:104: 00000100:00100000:2.0:1790773150.483647:0:13148:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d143012cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790773150.483736:0:9484:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1790773150.483748:0:9484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496022272 00000100:00100000:3.0:1790773150.483754:0:9484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496022272 00000100:00100000:3.0:1790773150.483785:0:9484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496022400 00000100:00100000:3.0:1790773150.483787:0:9484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496022400 00000100:00100000:3.0:1790773150.483804:0:9484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496022528 00000100:00100000:3.0:1790773150.483806:0:9484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496022528 00000100:00100000:3.0:1790773150.483813:0:9484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496022656 00000100:00100000:3.0:1790773150.483815:0:9484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496022656 00000100:00100000:3.0:1790773150.483824:0:9484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790773150.483831:0:9484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+6:13148:x1877761496022272:12345-0@lo:104: 00010000:00010000:3.0:1790773150.483842:0:9484:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d279de2c00/0xabf1cc0bc7841a15 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7841a1c expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773150.483893:0:9484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790773150.483899:0:9484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+6:13148:x1877761496022272:12345-0@lo:104: Request processed in 68us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773150.483905:0:9484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790773150.483926:0:9484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790773150.483931:0:9484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+5:13148:x1877761496022400:12345-0@lo:104: 00010000:00010000:3.0:1790773150.483938:0:9484:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d279de3200/0xabf1cc0bc7841a07 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7841a0e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773150.483966:0:9484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790773150.483970:0:9484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+5:13148:x1877761496022400:12345-0@lo:104: Request processed in 39us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773150.483975:0:9484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790773150.483984:0:9484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790773150.483989:0:9484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f96a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+4:13148:x1877761496022528:12345-0@lo:104: 00010000:00010000:3.0:1790773150.483995:0:9484:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3a00/0xabf1cc0bc78419f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7841a00 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773150.484024:0:9484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1790773150.484029:0:9484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f96a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+4:13148:x1877761496022528:12345-0@lo:104: Request processed in 40us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773150.484034:0:9484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790773150.484045:0:9484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790773150.484051:0:9484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+3:13148:x1877761496022656:12345-0@lo:104: 00010000:00010000:3.0:1790773150.484058:0:9484:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d279de3400/0xabf1cc0bc78419eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc78419f2 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773150.484084:0:9484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1790773150.484088:0:9484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+3:13148:x1877761496022656:12345-0@lo:104: Request processed in 39us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773150.484093:0:9484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:3.0:1790773150.484143:0:6466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1790773150.484149:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d279de2c00/0xabf1cc0bc7841a15 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7841a1c expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773150.484156:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d279de2c00 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:3.0:1790773150.484161:0:6466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d279de2c00/0xabf1cc0bc7841a15 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc7841a1c expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773150.484168:0:6466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d279de2c00/0xabf1cc0bc7841a15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc7841a1c expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790773150.484174:0:6466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d279de2c00/0xabf1cc0bc7841a15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc7841a1c expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773150.484180:0:6466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790773150.484231:0:6466:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d279de2c00/0xabf1cc0bc7841a15 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841a1c expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773150.484237:0:6466:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790773150.484257:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d279de2c00/0xabf1cc0bc7841a15 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841a1c expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773150.484263:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d279de2c00/0xabf1cc0bc7841a15 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841a1c expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773150.484275:0:6466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1790773150.484278:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d279de3200/0xabf1cc0bc7841a07 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7841a0e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773150.484283:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d279de3200 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:3.0:1790773150.484286:0:6466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d279de3200/0xabf1cc0bc7841a07 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc7841a0e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773150.484299:0:6466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d279de3200/0xabf1cc0bc7841a07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc7841a0e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790773150.484305:0:6466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d279de3200/0xabf1cc0bc7841a07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc7841a0e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773150.484311:0:6466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790773150.484324:0:6466:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d279de3200/0xabf1cc0bc7841a07 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841a0e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773150.484330:0:6466:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790773150.484345:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d279de3200/0xabf1cc0bc7841a07 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841a0e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773150.484352:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d279de3200/0xabf1cc0bc7841a07 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841a0e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773150.484361:0:6466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790773150.484363:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3a00/0xabf1cc0bc78419f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7841a00 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773150.484368:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a3a00 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:3.0:1790773150.484371:0:6466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3a00/0xabf1cc0bc78419f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc7841a00 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773150.484377:0:6466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3a00/0xabf1cc0bc78419f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc7841a00 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790773150.484383:0:6466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3a00/0xabf1cc0bc78419f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc7841a00 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773150.484394:0:6466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790773150.484408:0:6466:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3a00/0xabf1cc0bc78419f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841a00 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773150.484413:0:6466:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790773150.484419:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3a00/0xabf1cc0bc78419f9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841a00 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773150.484425:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3a00/0xabf1cc0bc78419f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841a00 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773150.484433:0:6466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790773150.484436:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d279de3400/0xabf1cc0bc78419eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc78419f2 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773150.484441:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d279de3400 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:3.0:1790773150.484444:0:6466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d279de3400/0xabf1cc0bc78419eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc78419f2 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773150.484450:0:6466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d279de3400/0xabf1cc0bc78419eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc78419f2 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790773150.484456:0:6466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d279de3400/0xabf1cc0bc78419eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc78419f2 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773150.484460:0:6466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790773150.484470:0:6466:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d279de3400/0xabf1cc0bc78419eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78419f2 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773150.484476:0:6466:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790773150.484488:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d279de3400/0xabf1cc0bc78419eb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78419f2 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773150.484493:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d279de3400/0xabf1cc0bc78419eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78419f2 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773150.484505:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773150.484507:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773150.484508:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773150.484515:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773150.484520:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773150.484537:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ca7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce0675b4-b0c5-48e7-b182-565e22fed04c:3607:1877761496022912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790773150.484568:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773150.484598:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790773150.484603:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ca6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce0675b4-b0c5-48e7-b182-565e22fed04c:3607:1877761496023296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790773150.484621:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773150.484642:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ca7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce0675b4-b0c5-48e7-b182-565e22fed04c:3605:1877761496023168:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790773150.484660:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773150.484676:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790773150.484681:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ca6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce0675b4-b0c5-48e7-b182-565e22fed04c:3605:1877761496023040:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790773150.484697:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773150.484718:0:6464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496022912 00000100:00100000:3.0:1790773150.484723:0:6464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496022912 00010000:00010000:3.0:1790773150.484741:0:6464:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d279de2000/0xabf1cc0bc7841a1c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7841a15 expref: 24 pid: 6471 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773150.484760:0:6464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496023296 00000100:00100000:3.0:1790773150.484763:0:6464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496023296 00010000:00010000:3.0:1790773150.484772:0:6464:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d26c4a2c00/0xabf1cc0bc78419f2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc78419eb expref: 25 pid: 6472 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773150.484790:0:6464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496023168 00000100:00100000:3.0:1790773150.484793:0:6464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496023168 00010000:00010000:3.0:1790773150.484802:0:6464:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d279de3000/0xabf1cc0bc7841a00 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc78419f9 expref: 26 pid: 6473 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773150.484810:0:6464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496023040 00000100:00100000:3.0:1790773150.484812:0:6464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496023040 00010000:00010000:3.0:1790773150.484820:0:6464:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d279de3600/0xabf1cc0bc7841a0e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7841a07 expref: 27 pid: 6471 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773150.484831:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790773150.484837:0:6464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ca5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+27:3607:x1877761496022912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790773150.484846:0:6464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773150.484851:0:6464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d279de2000/0xabf1cc0bc7841a1c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7841a15 expref: 27 pid: 6471 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773150.484861:0:6464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d279de2000/0xabf1cc0bc7841a1c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc7841a15 expref: 27 pid: 6471 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773150.484876:0:6464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790773150.484902:0:6464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ca5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+27:3607:x1877761496022912:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773150.484908:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790773150.484920:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790773150.484926:0:6464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ca4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+26:3607:x1877761496023296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790773150.484933:0:6464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773150.484936:0:6464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d26c4a2c00/0xabf1cc0bc78419f2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc78419eb expref: 26 pid: 6472 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773150.484955:0:6464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d26c4a2c00/0xabf1cc0bc78419f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc78419eb expref: 26 pid: 6472 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773150.484964:0:6464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790773150.484985:0:6464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ca4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+26:3607:x1877761496023296:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773150.484991:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790773150.485003:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790773150.485008:0:6464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ca7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+25:3605:x1877761496023168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790773150.485015:0:6464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773150.485019:0:6464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d279de3000/0xabf1cc0bc7841a00 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc78419f9 expref: 25 pid: 6473 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773150.485027:0:6464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d279de3000/0xabf1cc0bc7841a00 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc78419f9 expref: 25 pid: 6473 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773150.485035:0:6464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790773150.485060:0:6464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ca7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+25:3605:x1877761496023168:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773150.485066:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790773150.485077:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790773150.485083:0:6464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ca4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3605:x1877761496023040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790773150.485089:0:6464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773150.485093:0:6464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d279de3600/0xabf1cc0bc7841a0e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7841a07 expref: 24 pid: 6471 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773150.485113:0:6464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d279de3600/0xabf1cc0bc7841a0e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc7841a07 expref: 24 pid: 6471 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773150.485129:0:6464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790773150.485153:0:6464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ca4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3605:x1877761496023040:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773150.485159:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790773150.485229:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ca6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce0675b4-b0c5-48e7-b182-565e22fed04c:3605:1877761496023040:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790773150.485240:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ca7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce0675b4-b0c5-48e7-b182-565e22fed04c:3605:1877761496023168:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790773150.485265:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ca6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce0675b4-b0c5-48e7-b182-565e22fed04c:3607:1877761496023296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790773150.485273:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ca7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce0675b4-b0c5-48e7-b182-565e22fed04c:3607:1877761496022912:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790773150.485987:0:13148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d279de2000/0xabf1cc0bc7841a1c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc7841a15 expref: 23 pid: 6471 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773150.486002:0:13148:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13148:1877761496022272:0@lo:104: 00010000:00010000:2.0:1790773150.486012:0:13148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d279de3600/0xabf1cc0bc7841a0e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc7841a07 expref: 22 pid: 6471 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773150.486020:0:13148:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13148:1877761496022400:0@lo:104: 00010000:00010000:2.0:1790773150.486029:0:13148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d279de3000/0xabf1cc0bc7841a00 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc78419f9 expref: 21 pid: 6473 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773150.486036:0:13148:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f96b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13148:1877761496022528:0@lo:104: 00010000:00010000:2.0:1790773150.486045:0:13148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d26c4a2c00/0xabf1cc0bc78419f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc78419eb expref: 20 pid: 6472 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773150.486052:0:13148:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f96bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13148:1877761496022656:0@lo:104: 00000100:00100000:1.0:1790773150.494656:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773150.495378:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773150.495468:0:6465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484408576 00000100:00100000:0.0:1790773150.495480:0:6465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484408576 00010000:00010000:0.0:1790773150.495521:0:6465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d26c4a2600/0xabf1cc0bc78419e4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bacf expref: 13 pid: 6473 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773150.495569:0:6465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484408704 00000100:00100000:0.0:1790773150.495573:0:6465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484408704 00010000:00010000:0.0:1790773150.495585:0:6465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d26efc5c00/0xabf1cc0bc7841a31 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb0e expref: 14 pid: 6471 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773150.495610:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 44 00000100:00100000:0.0:1790773150.495636:0:6465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ec63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+14:2398:x1877761484408576:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790773150.495651:0:6465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773150.495657:0:6465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d26c4a2600/0xabf1cc0bc78419e4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bacf expref: 14 pid: 6473 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773150.495668:0:6465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d26c4a2600/0xabf1cc0bc78419e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bacf expref: 14 pid: 6473 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773150.495690:0:6465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790773150.495741:0:6465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ec63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+14:2398:x1877761484408576:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 107us (1095us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773150.495749:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 44 00000100:00100000:0.0:1790773150.495767:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 45 00000100:00100000:0.0:1790773150.495774:0:6465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512cac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:2397:x1877761484408704:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790773150.495782:0:6465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773150.495786:0:6465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d26efc5c00/0xabf1cc0bc7841a31 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb0e expref: 13 pid: 6471 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773150.495807:0:6465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d26efc5c00/0xabf1cc0bc7841a31 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb0e expref: 13 pid: 6471 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773150.495819:0:6465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93d26efc4c00/0xabf1cc0bc7841a54 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773150.495827:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d26efc4c00/0xabf1cc0bc7841a54 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773150.495843:0:6465:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d26efc4c00/0xabf1cc0bc7841a54 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773150.495856:0:6465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d26efc4c00/0xabf1cc0bc7841a54 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773150.495863:0:6465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93d26efc4c00/0xabf1cc0bc7841a54 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773150.495870:0:6465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93d26efc4c00/0xabf1cc0bc7841a54 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773150.495876:0:6465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc4c00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:0.0:1790773150.495880:0:6465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93d26efc4c00/0xabf1cc0bc7841a54 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773150.495888:0:6465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93d26efc4c00/0xabf1cc0bc7841a54 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773150.495897:0:6465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93d26efc4c00/0xabf1cc0bc7841a54 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773150.495909:0:6465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790773150.495931:0:6465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512cac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:2397:x1877761484408704:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 157us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773150.495938:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 45 00010000:00010000:2.0:1790773150.496425:0:13148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d26efc5c00/0xabf1cc0bc7841a31 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb0e expref: 12 pid: 6471 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773150.496442:0:13148:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13148:1877761496022144:192.168.202.19@tcp:104: 00010000:00010000:2.0:1790773150.496456:0:13148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d26c4a2600/0xabf1cc0bc78419e4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bacf expref: 11 pid: 6473 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773150.496464:0:13148:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f969500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13148:1877761496022784:192.168.202.19@tcp:104: 00010000:00010000:2.0:1790773150.496494:0:13148:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93d26efc4c00/0xabf1cc0bc7841a54 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773150.496570:0:13148:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93d26efc4c00/0xabf1cc0bc7841a54 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773150.496578:0:13148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93d26efc4c00/0xabf1cc0bc7841a54 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773150.496584:0:13148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d26efc4c00/0xabf1cc0bc7841a54 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773150.546437:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773151.568659:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773151.789506:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773151.789560:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773151.789589:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773151.789628:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773151.789655:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773151.789937:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484408832 00000100:00100000:0.0:1790773151.789950:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484408832 00000100:00100000:0.0:1790773151.790007:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 313 00000100:00100000:0.0:1790773151.790019:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d279eaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+11:2400:x1877761484408832:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1790773151.790109:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d279eaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+11:2400:x1877761484408832:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 93us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773151.790132:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 313 00000100:00100000:1.0:1790773151.790332:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484408960 00000100:00100000:1.0:1790773151.790336:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484408960 00000100:00100000:1.0:1790773151.790373:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484409088 00000100:00100000:1.0:1790773151.790376:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484409088 00000100:00100000:1.0:1790773151.790390:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484409216 00000100:00100000:1.0:1790773151.790393:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484409216 00000100:00100000:1.0:1790773151.790404:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484409344 00000100:00100000:1.0:1790773151.790406:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484409344 00000100:00100000:1.0:1790773151.790421:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 181 00000100:00100000:1.0:1790773151.790428:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ec60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+6:2399:x1877761484408960:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773151.790468:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ec60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+6:2399:x1877761484408960:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 41us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773151.790482:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 181 00000100:00100000:1.0:1790773151.790496:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 182 00000100:00100000:1.0:1790773151.790502:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ec60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+5:2400:x1877761484409088:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773151.790529:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ec60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+5:2400:x1877761484409088:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 27us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773151.790536:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 182 00000100:00100000:1.0:1790773151.790547:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 183 00000100:00100000:1.0:1790773151.790553:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ec63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2399:x1877761484409216:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773151.790577:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ec63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2399:x1877761484409216:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 24us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773151.790582:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 183 00000100:00100000:1.0:1790773151.790592:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 184 00000100:00100000:1.0:1790773151.790612:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ec61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2400:x1877761484409344:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773151.790635:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ec61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2400:x1877761484409344:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 38us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773151.790641:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 184 00000100:00080000:3.0:1790773151.791126:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790773151.791131:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790773151.882877:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773151.884258:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484409472 00000100:00100000:2.0:1790773151.884271:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484409472 00000100:00100000:2.0:1790773151.884332:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 314 00000100:00100000:2.0:1790773151.884343:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d279eaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+11:6170:x1877761484409472:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790773151.884361:0:6473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773151.884383:0:6473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d26efc4c00/0xabf1cc0bc7841a5b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bb3f expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773151.884417:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d26efc4c00/0xabf1cc0bc7841a5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb3f expref: 12 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773151.884430:0:6473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d26efc4c00/0xabf1cc0bc7841a5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb3f expref: 12 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773151.884441:0:6473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26efc4c00, rc 0) 00000100:00100000:2.0:1790773151.884512:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d279eaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+12:6170:x1877761484409472:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 Request processed in 170us (1645us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773151.884520:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 314 00000100:00100000:2.0:1790773151.898746:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773151.902185:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484409600 00000100:00100000:1.0:1790773151.902220:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484409600 00000100:00100000:1.0:1790773151.902285:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 315 00000100:00100000:1.0:1790773151.902296:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d251208850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+12:6170:x1877761484409600:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790773151.902483:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d251208850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+12:6170:x1877761484409600:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 Request processed in 188us (3745us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773151.902493:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 315 00000100:00100000:2.0:1790773151.912077:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773151.912289:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484409728 00000100:00100000:0.0:1790773151.912302:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484409728 00000100:00100000:0.0:1790773151.912362:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 316 00000100:00100000:0.0:1790773151.912374:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25120b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+12:6170:x1877761484409728:12345-192.168.202.19@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790773151.912517:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25120b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+12:6170:x1877761484409728:12345-192.168.202.19@tcp:503:ll_cfg_requeue.0 Request processed in 145us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773151.912526:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 316 00000100:00100000:1.0:1790773151.922765:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773151.922856:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484409856 00000100:00100000:2.0:1790773151.922868:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484409856 00000100:00100000:2.0:1790773151.922926:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 317 00000100:00100000:2.0:1790773151.922936:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25120ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+12:6170:x1877761484409856:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790773151.922955:0:6473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773151.922972:0:6473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d26efc4800/0xabf1cc0bc7841a62 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bb46 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773151.923013:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d26efc4800/0xabf1cc0bc7841a62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb46 expref: 13 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773151.923026:0:6473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d26efc4800/0xabf1cc0bc7841a62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb46 expref: 13 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773151.923036:0:6473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26efc4800, rc 0) 00000100:00100000:2.0:1790773151.923106:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25120ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:6170:x1877761484409856:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 Request processed in 171us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773151.923114:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 317 00000100:00100000:1.0:1790773151.937153:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773151.937197:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484409984 00000100:00100000:1.0:1790773151.937230:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484409984 00000100:00100000:1.0:1790773151.937287:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 318 00000100:00100000:1.0:1790773151.937297:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d251209450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:6170:x1877761484409984:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790773151.937441:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d251209450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:6170:x1877761484409984:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 Request processed in 145us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773151.937450:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 318 00000100:00100000:0.0:1790773151.948872:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773151.952694:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484410112 00000100:00100000:2.0:1790773151.952711:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484410112 00000100:00100000:2.0:1790773151.952777:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 319 00000100:00100000:2.0:1790773151.952788:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d251208c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:6170:x1877761484410112:12345-192.168.202.19@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790773151.952942:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d251208c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:6170:x1877761484410112:12345-192.168.202.19@tcp:503:ll_cfg_requeue.0 Request processed in 156us (4080us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773151.952950:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 319 00000100:00100000:3.0:1790773152.079538:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ec61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496023424:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790773152.079609:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773152.079671:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790773152.079679:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ca7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496023552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790773152.079706:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773152.083674:0:6483:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496023424 00000100:00100000:2.0:1790773152.083691:0:6483:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496023424 00000100:00100000:2.0:1790773152.083745:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1790773152.083755:0:6483:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ca6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496023424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790773152.083792:0:6483:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790773152.083869:0:6483:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ca6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496023424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (4260us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773152.083876:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1790773152.083909:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f969500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496023680:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790773152.083947:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773152.083986:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f96bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496023808:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790773152.084023:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773152.084081:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ec61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496023424:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790773152.084115:0:6484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496023808 00000100:00100000:2.0:1790773152.084118:0:6484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496023808 00000100:00100000:2.0:1790773152.084142:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1790773152.084148:0:6484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f96b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496023808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790773152.084166:0:6484:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1790773152.084200:0:6484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f96b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496023808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 52us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773152.084227:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1790773152.084244:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496023552 00000100:00100000:2.0:1790773152.084247:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496023552 00000100:00100000:2.0:1790773152.084275:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496023680 00000100:00100000:2.0:1790773152.084278:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496023680 00000100:00100000:2.0:1790773152.084291:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1790773152.084296:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ca7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496023552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790773152.084325:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790773152.084358:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ca7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496023552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (4651us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773152.084365:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1790773152.084376:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1790773152.084382:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f96b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496023680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790773152.084391:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790773152.084412:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f96b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496023680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 31us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773152.084418:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:2.0:1790773152.084438:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790773152.084460:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f96bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496023808:0@lo:41:osp-pre-0-1.0 00010000:00080000:2.0:1790773152.084481:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f969500 x1877761496023680/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773168 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773152.084494:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f969500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496023680:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1790773152.084505:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143ca7800 x1877761496023552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773168 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773152.084517:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ca7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496023552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790773152.093538:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790773152.093557:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790773152.093562:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f96bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3605:1877761496024064:0@lo:400:kworker.0 00000100:00100000:0.0:1790773152.093566:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f969500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce0675b4-b0c5-48e7-b182-565e22fed04c:3606:1877761496023936:0@lo:400:kworker.0 00000100:00100000:3.0:1790773152.094442:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790773152.094455:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ca6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3604:1877761496024192:0@lo:400:kworker.0 00000100:00100000:0.0:1790773152.095035:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773152.095183:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496023936 00000100:00100000:0.0:1790773152.095192:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496023936 00000100:00100000:0.0:1790773152.095256:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1790773152.095266:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26be9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+20:3606:x1877761496023936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773152.095319:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26be9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+20:3606:x1877761496023936:12345-0@lo:400:kworker.0 Request processed in 56us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773152.095326:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1790773152.095371:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f969500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce0675b4-b0c5-48e7-b182-565e22fed04c:3606:1877761496023936:0@lo:400:kworker.0 00000100:00100000:3.0:1790773152.097427:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773152.097564:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ca5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3606:1877761496024320:0@lo:400:kworker.0 00000100:00100000:3.0:1790773152.097595:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773152.101349:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f96ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3606:1877761496024832:0@lo:400:kworker.0 00000100:00100000:3.0:1790773152.101418:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773152.104227:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496024192 00000100:00100000:1.0:1790773152.104244:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496024192 00000100:00100000:1.0:1790773152.104327:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496024320 00000100:00100000:1.0:1790773152.104331:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496024320 00000100:00100000:1.0:1790773152.104370:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1790773152.104381:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ca7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3604:x1877761496024192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773152.104892:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ca7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3604:x1877761496024192:12345-0@lo:400:kworker.0 Request processed in 511us (7470us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773152.104901:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1790773152.104921:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1790773152.104929:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ca4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1877761496024320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773152.104963:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ca4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1877761496024320:12345-0@lo:400:kworker.0 Request processed in 37us (7368us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773152.104969:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00080000:2.0:1790773152.106419:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790773152.107283:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f969c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496024576:0@lo:400:kworker.0 00000100:00100000:1.0:1790773152.107389:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773152.107483:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ca6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3604:1877761496024192:0@lo:400:kworker.0 00000100:00100000:1.0:1790773152.107516:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790773152.107524:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f96aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496024704:0@lo:400:kworker.0 00000100:00100000:1.0:1790773152.107552:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773152.107590:0:8393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496024576 00000100:00100000:1.0:1790773152.107597:0:8393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496024576 00000100:00100000:1.0:1790773152.107644:0:8393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496024704 00000100:00100000:1.0:1790773152.107647:0:8393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496024704 00000100:00100000:1.0:1790773152.107670:0:8393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790773152.107679:0:8393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ec60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496024576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773152.107729:0:8393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ec60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496024576:12345-0@lo:400:kworker.0 Request processed in 51us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773152.107737:0:8393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790773152.107753:0:8393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790773152.107760:0:8393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ec61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496024704:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1790773152.108313:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790773152.108590:0:8393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ec61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496024704:12345-0@lo:400:kworker.0 Request processed in 828us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773152.108600:0:8393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790773152.108641:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f969880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3607:1877761496024448:0@lo:400:kworker.0 00010000:00080000:1.0:1790773152.108697:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f96aa00 x1877761496024704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773152.108710:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f96aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496024704:0@lo:400:kworker.0 00010000:00080000:1.0:1790773152.108723:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f969c00 x1877761496024576/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773152.108731:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f969c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496024576:0@lo:400:kworker.0 00000100:00100000:3.0:1790773152.109730:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ca5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3606:1877761496024320:0@lo:400:kworker.0 00000100:00100000:3.0:1790773152.109770:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773152.114365:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773152.117338:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496024832 00000100:00100000:1.0:1790773152.117370:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496024832 00000100:00100000:2.0:1790773152.117425:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496024064 00000100:00100000:2.0:1790773152.117431:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496024064 00000100:00100000:2.0:1790773152.117512:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1790773152.117523:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ca5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3605:x1877761496024064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773152.117615:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ca5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3605:x1877761496024064:12345-0@lo:400:kworker.0 Request processed in 94us (7845us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773152.117622:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1790773152.117638:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496024448 00000100:00100000:2.0:1790773152.117641:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496024448 00000100:00100000:2.0:1790773152.117664:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1790773152.117665:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f968000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3607:1877761496024960:0@lo:400:kworker.0 00000100:00100000:2.0:1790773152.117669:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ca4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1877761496024448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773152.117699:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ca4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1877761496024448:12345-0@lo:400:kworker.0 Request processed in 30us (3350us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773152.117702:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773152.117705:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1790773152.117713:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496024960 00000100:00100000:2.0:1790773152.117716:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496024960 00000100:00100000:2.0:1790773152.117729:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1790773152.117734:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ca5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1877761496024960:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1790773152.117736:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f969880 x1877761496024448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773152.117749:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f969880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3607:1877761496024448:0@lo:400:kworker.0 00000100:00100000:2.0:1790773152.117773:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ca5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1877761496024960:12345-0@lo:400:kworker.0 Request processed in 39us (71us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773152.117780:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00080000:2.0:1790773152.117799:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790773152.117828:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1790773152.117834:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ca7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3606:x1877761496024832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773152.117870:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ca7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3606:x1877761496024832:12345-0@lo:400:kworker.0 Request processed in 36us (16451us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773152.117876:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00080000:2.0:1790773152.117889:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790773152.118201:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f968000 x1877761496024960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773152.118332:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f968000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3607:1877761496024960:0@lo:400:kworker.0 00000100:00100000:3.0:1790773152.118384:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f96ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3606:1877761496024832:0@lo:400:kworker.0 00000100:00100000:2.0:1790773152.118389:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f96bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3605:1877761496024064:0@lo:400:kworker.0 10000000:01000000:3.0:1790773152.205409:0:6475:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790773152.205418:0:6475:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d141fee800 from 7 10000000:01000000:3.0:1790773152.205424:0:6475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790773152.205486:0:6475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d1434ad800/0xabf1cc0bc7841a69 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773152.205499:0:6475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d1434ad800/0xabf1cc0bc7841a69 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773152.205510:0:6475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d1434ad800/0xabf1cc0bc7841a69 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773152.205537:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ca4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761496025088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790773152.205628:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773152.205681:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d246b25780 going to sleep for 11 seconds 00000100:00100000:2.0:1790773152.205912:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496025088 00000100:00100000:2.0:1790773152.205920:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496025088 00000100:00100000:2.0:1790773152.205970:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1790773152.205979:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26be9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+20:6475:x1877761496025088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790773152.205995:0:6472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773152.206008:0:6472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d26efc5000/0xabf1cc0bc7841a70 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7841a69 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773152.206030:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d26efc5000/0xabf1cc0bc7841a70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7841a69 expref: 21 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773152.206039:0:6472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d26efc5000/0xabf1cc0bc7841a70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7841a69 expref: 21 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773152.206049:0:6472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26efc5000, rc 0) 00000100:00100000:2.0:1790773152.206103:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26be9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:6475:x1877761496025088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773152.206110:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1790773152.206196:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ca4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761496025088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790773152.206241:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d1434ad800/0xabf1cc0bc7841a69 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841a70 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773152.206251:0:6475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d1434ad800/0xabf1cc0bc7841a69 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7841a70 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773152.206313:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ca4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761496025216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790773152.206339:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773152.206358:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d246b25780 going to sleep for 11 seconds 00000100:00100000:2.0:1790773152.206447:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496025216 00000100:00100000:2.0:1790773152.206452:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496025216 00000100:00100000:2.0:1790773152.206474:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1790773152.206481:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26be9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:6475:x1877761496025216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790773152.206603:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26be9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:6475:x1877761496025216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773152.206609:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1790773152.206863:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ca4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761496025216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790773152.206892:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ca4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761496025344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790773152.206937:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773152.206999:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d246b25780 going to sleep for 11 seconds 00000100:00100000:2.0:1790773152.210840:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496025344 00000100:00100000:2.0:1790773152.210858:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496025344 00000100:00100000:2.0:1790773152.210977:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1790773152.210995:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26be9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:6475:x1877761496025344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790773152.211237:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26be9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:6475:x1877761496025344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 243us (4299us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773152.211245:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1790773152.211359:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ca4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761496025344:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790773152.220870:0:13204:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1790773152.221620:0:6475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1790773152.221646:0:6475:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790773152.221658:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d1434ad800/0xabf1cc0bc7841a69 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841a70 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773152.221672:0:6475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d1434ad800/0xabf1cc0bc7841a69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841a70 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790773152.221682:0:6475:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790773152.221685:0:6475:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d26ff80800 from 7 10000000:01000000:1.0:1790773152.222865:0:6475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790773152.222917:0:6475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12bc00/0xabf1cc0bc7841a77 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773152.222929:0:6475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d27b12bc00/0xabf1cc0bc7841a77 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773152.222941:0:6475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d27b12bc00/0xabf1cc0bc7841a77 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773152.222970:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ec63b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761496025472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790773152.223049:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773152.223330:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496025472 00000100:00100000:2.0:1790773152.223339:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496025472 00000100:00100000:2.0:1790773152.223397:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1790773152.223407:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26be9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:6475:x1877761496025472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790773152.223421:0:6472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773152.223512:0:6472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d26efc5400/0xabf1cc0bc7841a7e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7841a77 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773152.223546:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d26efc5400/0xabf1cc0bc7841a7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7841a77 expref: 22 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773152.223558:0:6472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d26efc5400/0xabf1cc0bc7841a7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7841a77 expref: 22 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773152.223566:0:6472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26efc5400, rc 0) 00000100:00100000:2.0:1790773152.223609:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26be9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+22:6475:x1877761496025472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 203us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773152.223615:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1790773152.224266:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d248d33c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790773152.224298:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ec63b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761496025472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790773152.224316:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d27b12bc00/0xabf1cc0bc7841a77 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841a7e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773152.224325:0:6475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d27b12bc00/0xabf1cc0bc7841a77 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7841a7e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773152.224405:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ec63b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761496025600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790773152.224768:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773152.224902:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d248d33c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790773152.229871:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496025600 00000100:00100000:2.0:1790773152.229891:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496025600 00000100:00100000:2.0:1790773152.230002:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1790773152.230014:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26be9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+22:6475:x1877761496025600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790773152.230266:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26be9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+22:6475:x1877761496025600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 254us (5497us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773152.230285:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1790773152.230396:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ec63b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761496025600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790773152.230466:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ec63b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761496025728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790773152.230526:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773152.236614:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d248d33c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790773152.238291:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496025728 00000100:00100000:3.0:1790773152.238307:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496025728 00000100:00100000:3.0:1790773152.238384:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1790773152.238394:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+22:6475:x1877761496025728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790773152.239010:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+22:6475:x1877761496025728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 614us (8481us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773152.239021:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1790773152.243297:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ec63b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761496025728:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1790773152.246299:0:13205:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1790773152.246860:0:6475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1790773152.246891:0:6475:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790773152.246906:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12bc00/0xabf1cc0bc7841a77 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841a7e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773152.246920:0:6475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d27b12bc00/0xabf1cc0bc7841a77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841a7e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790773152.246931:0:6475:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790773152.246934:0:6475:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d26ed89000 from 7 10000000:01000000:1.0:1790773152.246936:0:6475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790773152.246979:0:6475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12a800/0xabf1cc0bc7841a85 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773152.246987:0:6475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d27b12a800/0xabf1cc0bc7841a85 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773152.246999:0:6475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d27b12a800/0xabf1cc0bc7841a85 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773152.247036:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ec63b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761496025856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790773152.247611:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773152.247711:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d248d33c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790773152.253595:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496025856 00000100:00100000:3.0:1790773152.253612:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496025856 00000100:00100000:3.0:1790773152.253682:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1790773152.253840:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+22:6475:x1877761496025856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790773152.253860:0:6471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773152.253881:0:6471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d1434ac800/0xabf1cc0bc7841a8c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7841a85 expref: -99 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773152.253911:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d1434ac800/0xabf1cc0bc7841a8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7841a85 expref: 23 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773152.253922:0:6471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d1434ac800/0xabf1cc0bc7841a8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7841a85 expref: 23 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773152.253931:0:6471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d1434ac800, rc 0) 00000100:00100000:3.0:1790773152.254020:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+23:6475:x1877761496025856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 249us (6410us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773152.254026:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1790773152.254103:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ec63b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761496025856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790773152.255331:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d27b12a800/0xabf1cc0bc7841a85 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841a8c expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773152.255349:0:6475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d27b12a800/0xabf1cc0bc7841a85 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7841a8c expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773152.255533:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ca4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761496025984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790773152.255598:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773152.255705:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d246b25c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790773152.257241:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496025984 00000100:00100000:2.0:1790773152.257256:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496025984 00000100:00100000:2.0:1790773152.257322:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1790773152.257332:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+23:6475:x1877761496025984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790773152.262337:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+23:6475:x1877761496025984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 4996us (6728us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773152.262352:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1790773152.262612:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ca4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761496025984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790773152.262680:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ca4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761496026112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790773152.262794:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773152.262831:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d246b25c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790773152.263104:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496026112 00000100:00100000:2.0:1790773152.263121:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496026112 00000100:00100000:2.0:1790773152.263178:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1790773152.263187:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+23:6475:x1877761496026112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790773152.263318:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+23:6475:x1877761496026112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 127us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773152.263325:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1790773152.263342:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ca4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761496026112:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790773152.264634:0:13206:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1790773152.264862:0:6475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1790773152.264885:0:6475:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790773152.264896:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12a800/0xabf1cc0bc7841a85 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841a8c expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773152.264908:0:6475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d27b12a800/0xabf1cc0bc7841a85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841a8c expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790773152.264919:0:6475:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790773152.264922:0:6475:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d25268e800 from 7 10000000:01000000:2.0:1790773152.264925:0:6475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790773152.264959:0:6475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26efc4600/0xabf1cc0bc7841a93 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773152.264967:0:6475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d26efc4600/0xabf1cc0bc7841a93 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773152.264990:0:6475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d26efc4600/0xabf1cc0bc7841a93 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773152.265011:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f96bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761496026240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790773152.265067:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773152.265185:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d242c57900 going to sleep for 11 seconds 00000100:00100000:3.0:1790773152.266570:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496026240 00000100:00100000:3.0:1790773152.266587:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496026240 00000100:00100000:3.0:1790773152.266664:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1790773152.266674:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+23:6475:x1877761496026240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790773152.266869:0:6473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773152.266889:0:6473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d1434acc00/0xabf1cc0bc7841a9a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7841a93 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773152.266919:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d1434acc00/0xabf1cc0bc7841a9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7841a93 expref: 24 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773152.266929:0:6473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d1434acc00/0xabf1cc0bc7841a9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7841a93 expref: 24 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773152.266938:0:6473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d1434acc00, rc 0) 00000100:00100000:3.0:1790773152.267028:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:6475:x1877761496026240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 355us (1960us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773152.267035:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1790773152.267135:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f96bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761496026240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790773152.267155:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d26efc4600/0xabf1cc0bc7841a93 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841a9a expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773152.267164:0:6475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d26efc4600/0xabf1cc0bc7841a93 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7841a9a expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773152.267272:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f96bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761496026368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790773152.267308:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773152.267338:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d242c57900 going to sleep for 11 seconds 00000100:00100000:3.0:1790773152.267532:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496026368 00000100:00100000:3.0:1790773152.267537:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496026368 00000100:00100000:3.0:1790773152.267569:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1790773152.267577:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:6475:x1877761496026368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790773152.267847:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f96bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761496026368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790773152.267877:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f96bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761496026496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790773152.270387:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773152.270458:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496026496 00000100:00100000:2.0:1790773152.270462:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d242c57900 going to sleep for 11 seconds 00000100:00100000:1.0:1790773152.270468:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496026496 00000100:00100000:1.0:1790773152.270527:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1790773152.270538:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+25:6475:x1877761496026496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790773152.270675:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+25:6475:x1877761496026496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773152.270683:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1790773152.270791:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f96bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761496026496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790773152.270849:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:6475:x1877761496026368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3205us (3473us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773152.270858:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000040:00080000:3.0:1790773152.272061:0:13207:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1790773152.272363:0:6475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1790773152.272390:0:6475:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790773152.272400:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26efc4600/0xabf1cc0bc7841a93 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841a9a expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773152.272428:0:6475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d26efc4600/0xabf1cc0bc7841a93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841a9a expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773152.590367:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773153.614267:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773154.638919:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790773154.747949:0:13347:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg219-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1790773155.149520:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790773155.152376:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ca4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496026752:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790773155.153287:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773155.153691:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ed6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496026624:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790773155.153722:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773155.153940:0:8397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496026752 00000100:00100000:0.0:1790773155.153949:0:8397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496026752 00000100:00100000:0.0:1790773155.154005:0:8397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496026624 00000100:00100000:0.0:1790773155.154026:0:8397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496026624 00000100:00100000:0.0:1790773155.154051:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1790773155.154078:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f96bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496026752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790773155.154263:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790773155.154320:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f96bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496026752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 244us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773155.154329:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1790773155.154348:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1790773155.154354:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f968a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496026624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790773155.154366:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790773155.154391:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f968a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496026624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773155.154397:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:0.0:1790773155.154417:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790773155.154938:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143ca4700 x1877761496026752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773171 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773155.154959:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ca4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496026752:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1790773155.154971:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d26ed6b800 x1877761496026624/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773171 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773155.154982:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ed6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496026624:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1790773155.662785:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773156.685620:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773156.912555:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773156.913001:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773156.913301:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773156.913337:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773156.913395:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484410240 00000100:00100000:0.0:1790773156.913408:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484410240 00000100:00100000:0.0:1790773156.913469:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 333 00000100:00100000:0.0:1790773156.913481:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:2400:x1877761484410240:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1790773156.913586:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:2400:x1877761484410240:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 106us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773156.913603:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 333 00000100:00100000:2.0:1790773156.913824:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484410368 00000100:00100000:2.0:1790773156.913829:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484410368 00000100:00080000:0.0:1790773156.913951:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790773156.914887:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484410624 00000100:00100000:3.0:1790773156.914899:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484410624 00000100:00100000:3.0:1790773156.915003:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 191 00000100:00100000:3.0:1790773156.915013:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ec63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+6:2400:x1877761484410368:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1790773156.915230:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ec63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+6:2400:x1877761484410368:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 218us (2750us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773156.915239:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 191 00000100:00100000:3.0:1790773156.915257:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 192 00000100:00100000:3.0:1790773156.915263:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2400:x1877761484410624:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1790773156.915289:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2400:x1877761484410624:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 26us (2290us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773156.915295:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 192 00000100:00100000:1.0:1790773156.916142:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773156.916167:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484410496 00000100:00100000:1.0:1790773156.916174:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484410496 00000100:00100000:2.0:1790773156.916241:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484410752 00000100:00100000:2.0:1790773156.916245:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484410752 00000100:00080000:0.0:1790773156.917219:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790773156.917227:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790773156.917409:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 193 00000100:00100000:1.0:1790773156.917422:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+5:2400:x1877761484410496:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773156.917503:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+5:2400:x1877761484410496:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 73us (4153us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773156.917530:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 193 00000100:00100000:2.0:1790773156.918268:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 194 00000100:00100000:2.0:1790773156.918279:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2400:x1877761484410752:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1790773156.918333:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2400:x1877761484410752:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 56us (2195us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773156.918341:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 194 00000100:00100000:2.0:1790773157.197605:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f969880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3604:1877761496027136:0@lo:400:kworker.0 00000100:00100000:2.0:1790773157.197904:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773157.197964:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f969f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3604:1877761496027648:0@lo:400:kworker.0 00000100:00100000:2.0:1790773157.197994:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773157.198012:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3604:1877761496028160:0@lo:400:kworker.0 00000100:00100000:2.0:1790773157.198047:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773157.198239:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1790773157.198247:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f969c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496027264:0@lo:400:kworker.0 00000100:00100000:2.0:1790773157.198274:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773157.198296:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f968700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3604:1877761496027776:0@lo:400:kworker.0 00000100:00100000:2.0:1790773157.198313:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773157.198324:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3604:1877761496028288:0@lo:400:kworker.0 00000100:00100000:2.0:1790773157.198339:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773157.198366:0:6483:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496027264 00000100:00100000:2.0:1790773157.198374:0:6483:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496027264 00000100:00100000:2.0:1790773157.198416:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1790773157.198424:0:6483:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496027264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773157.198483:0:6483:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496027264:12345-0@lo:400:kworker.0 Request processed in 59us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773157.198551:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1790773157.198579:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496027136 00000100:00100000:2.0:1790773157.198583:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496027136 00000100:00100000:2.0:1790773157.198600:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496027648 00000100:00100000:2.0:1790773157.198602:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496027648 00000100:00100000:2.0:1790773157.198622:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496028160 00000100:00100000:2.0:1790773157.198624:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496028160 00000100:00100000:2.0:1790773157.198633:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496027776 00000100:00100000:2.0:1790773157.198635:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496027776 00000100:00100000:1.0:1790773157.198766:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790773157.198775:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496028672:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790773157.198804:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790773157.198841:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790773157.198852:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496028288 00000100:00100000:1.0:1790773157.198855:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496028288 00000100:00100000:1.0:1790773157.198876:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1790773157.198882:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3604:x1877761496027136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773157.198912:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3604:x1877761496027136:12345-0@lo:400:kworker.0 Request processed in 31us (1009us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773157.198918:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1790773157.198928:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1790773157.198933:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3604:x1877761496027648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773157.198952:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3604:x1877761496027648:12345-0@lo:400:kworker.0 Request processed in 20us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773157.198969:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1790773157.198978:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1790773157.198983:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3604:x1877761496028160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773157.199004:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3604:x1877761496028160:12345-0@lo:400:kworker.0 Request processed in 21us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773157.199009:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1790773157.199026:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1790773157.199032:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3604:x1877761496028288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773157.199063:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3604:x1877761496028288:12345-0@lo:400:kworker.0 Request processed in 32us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773157.202610:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1790773157.202621:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3604:x1877761496027776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773157.202740:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00080000:1.0:1790773157.202772:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790773157.202831:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f969c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496027264:0@lo:400:kworker.0 00010000:00080000:1.0:1790773157.202848:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1437d4e00 x1877761496028288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773157.202859:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3604:1877761496028288:0@lo:400:kworker.0 00000100:00100000:1.0:1790773157.202870:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f969880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3604:1877761496027136:0@lo:400:kworker.0 00000100:00100000:1.0:1790773157.202882:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f969f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3604:1877761496027648:0@lo:400:kworker.0 00000100:00100000:1.0:1790773157.202893:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3604:1877761496028160:0@lo:400:kworker.0 00000100:00100000:3.0:1790773157.203267:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f96ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496026880:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790773157.203330:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773157.203371:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f96aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496027392:0@lo:400:kworker.0 00000100:00100000:3.0:1790773157.203391:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773157.203409:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f968e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496027904:0@lo:400:kworker.0 00000100:00100000:3.0:1790773157.203431:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773157.203458:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496028416:0@lo:400:kworker.0 00000100:00100000:3.0:1790773157.203477:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773157.203507:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1790773157.203514:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f968000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce0675b4-b0c5-48e7-b182-565e22fed04c:3606:1877761496027008:0@lo:400:kworker.0 00000100:00100000:3.0:1790773157.203540:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773157.203561:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f969500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3606:1877761496027520:0@lo:400:kworker.0 00000100:00100000:3.0:1790773157.203583:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773157.203598:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f96a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496028032:0@lo:400:kworker.0 00000100:00100000:3.0:1790773157.203616:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773157.203631:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496028544:0@lo:400:kworker.0 00000100:00100000:2.0:1790773157.203833:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3604:x1877761496027776:12345-0@lo:400:kworker.0 Request processed in 1212us (5517us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773157.203841:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1790773157.203858:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496027520 00000100:00100000:2.0:1790773157.203864:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496027520 00000100:00100000:2.0:1790773157.203887:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1790773157.203893:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1877761496027520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773157.203924:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1877761496027520:12345-0@lo:400:kworker.0 Request processed in 31us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773157.203930:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1790773157.203949:0:12789:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496026880 00000100:00100000:2.0:1790773157.203952:0:12789:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496026880 00000100:00100000:3.0:1790773157.204058:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773157.204251:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f969500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3606:1877761496027520:0@lo:400:kworker.0 00000100:00100000:3.0:1790773157.204279:0:7666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496027392 00000100:00100000:3.0:1790773157.204283:0:7666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496027392 00000100:00100000:3.0:1790773157.204313:0:7666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1790773157.204319:0:7666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ca4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496027392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773157.204355:0:7666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ca4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496027392:12345-0@lo:400:kworker.0 Request processed in 36us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773157.204360:0:7666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1790773157.204377:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496027008 00000100:00100000:3.0:1790773157.204380:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496027008 00000100:00100000:3.0:1790773157.204401:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1790773157.204407:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3606:x1877761496027008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773157.204443:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3606:x1877761496027008:12345-0@lo:400:kworker.0 Request processed in 36us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773157.204461:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1790773157.205231:0:12789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1790773157.205241:0:12789:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ca4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496026880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790773157.205278:0:12789:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790773157.205324:0:12789:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ca4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496026880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (1994us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773157.205330:0:12789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1790773157.205454:0:8393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496027904 00000100:00100000:3.0:1790773157.205461:0:8393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496027904 00000100:00100000:2.0:1790773157.205521:0:8906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496028416 00000100:00100000:2.0:1790773157.205525:0:8906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496028416 00000100:00100000:2.0:1790773157.205548:0:8906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496028032 00000100:00100000:2.0:1790773157.205551:0:8906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496028032 00000100:00100000:2.0:1790773157.205563:0:8906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496028544 00000100:00100000:2.0:1790773157.205565:0:8906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496028544 00000100:00100000:2.0:1790773157.205579:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790773157.205585:0:8906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ca6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496027904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773157.205630:0:8906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ca6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496027904:12345-0@lo:400:kworker.0 Request processed in 45us (2197us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773157.205636:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790773157.205662:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1790773157.205670:0:8906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496028416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773157.205697:0:8906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496028416:12345-0@lo:400:kworker.0 Request processed in 28us (2219us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773157.205703:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1790773157.205714:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1790773157.205720:0:8906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496028032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773157.205747:0:8906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496028032:12345-0@lo:400:kworker.0 Request processed in 28us (2130us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773157.205753:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1790773157.205763:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1790773157.205768:0:8906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496028544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773157.205791:0:8906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496028544:12345-0@lo:400:kworker.0 Request processed in 23us (1733us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773157.205796:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:2.0:1790773157.205884:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f968700 x1877761496027776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773157.205897:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f968700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3604:1877761496027776:0@lo:400:kworker.0 00000100:00100000:2.0:1790773157.205914:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790773157.205923:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ca5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496028800:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790773157.205952:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773157.206047:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f968000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce0675b4-b0c5-48e7-b182-565e22fed04c:3606:1877761496027008:0@lo:400:kworker.0 00010000:00080000:2.0:1790773157.206062:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f96a300 x1877761496028032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773157.206534:0:8397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496028672 00000100:00100000:0.0:1790773157.206540:0:8397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496028672 00000100:00100000:0.0:1790773157.206580:0:8397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496028800 00000100:00100000:0.0:1790773157.206585:0:8397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496028800 00000100:00100000:0.0:1790773157.206598:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1790773157.206605:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496028672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790773157.206644:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790773157.206683:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496028672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (7879us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773157.206689:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1790773157.206702:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1790773157.206708:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496028800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790773157.206716:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790773157.206743:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496028800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773157.206748:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1790773157.206765:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790773157.206774:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ed6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496028928:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790773157.206800:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773157.206825:0:7666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496028928 00000100:00100000:0.0:1790773157.206828:0:7666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496028928 00000100:00100000:0.0:1790773157.206850:0:7666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1790773157.206855:0:7666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ed6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496028928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790773157.206874:0:7666:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1790773157.206903:0:7666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ed6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496028928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 49us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773157.206908:0:7666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1790773157.206933:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ed6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496028928:0@lo:41:osp-pre-0-1.0 00010000:00080000:0.0:1790773157.206990:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143ca5c00 x1877761496028800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773173 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773157.207002:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ca5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496028800:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1790773157.207062:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f9cf100 x1877761496028672/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773173 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773157.207424:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f96a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496028032:0@lo:400:kworker.0 00010000:00080000:2.0:1790773157.207443:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1437d4a80 x1877761496028544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773157.207451:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496028544:0@lo:400:kworker.0 00000100:00100000:2.0:1790773157.207465:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f96ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496026880:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790773157.207474:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f96aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496027392:0@lo:400:kworker.0 00000100:00100000:0.0:1790773157.207574:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496028672:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1790773157.207611:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790773157.207615:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790773157.207768:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f968e00 x1877761496027904/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773157.207777:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f968e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496027904:0@lo:400:kworker.0 00010000:00080000:2.0:1790773157.207792:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1437d6680 x1877761496028416/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773157.207799:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496028416:0@lo:400:kworker.0 00010000:00010000:3.0:1790773157.725561:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773158.741165:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790773159.454849:0:13495:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 08:59:18 (1790773158) === 00000100:00100000:1.0:1790773159.561195:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773159.561459:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484410880 00000100:00100000:2.0:1790773159.561469:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484410880 00000100:00100000:1.0:1790773159.561519:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773159.561552:0:6487:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484411008 00000100:00100000:1.0:1790773159.561557:0:6487:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484411008 00000100:00100000:2.0:1790773159.561584:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 22 00000100:00100000:1.0:1790773159.561584:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 2 00000100:00100000:2.0:1790773159.561594:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+7:2398:x1877761484410880:12345-192.168.202.19@tcp:41:mkdir.0 00000100:00100000:1.0:1790773159.561594:0:6487:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:110130ab-04fa-4d7c-984e-562032df4432+7:10464:x1877761484411008:12345-192.168.202.19@tcp:700:mkdir.0 00000004:00000024:2.0:1790773159.561644:0:6478:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1790773159.561744:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+7:2398:x1877761484410880:12345-192.168.202.19@tcp:41:mkdir.0 Request processed in 151us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773159.561751:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 22 00000100:00100000:1.0:1790773159.562156:0:6487:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:110130ab-04fa-4d7c-984e-562032df4432+6:10464:x1877761484411008:12345-192.168.202.19@tcp:700:mkdir.0 Request processed in 562us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773159.562163:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 2 00000100:00080000:0.0:1790773159.562190:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790773159.576625:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773159.576671:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484411264 00000100:00100000:1.0:1790773159.576681:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484411264 00000100:00100000:1.0:1790773159.576743:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 23 00000100:00100000:1.0:1790773159.576754:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+6:10464:x1877761484411264:12345-192.168.202.19@tcp:36:mkdir.0 00010000:00010000:1.0:1790773159.576824:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790773159.576906:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2a00/0xabf1cc0bc7841943 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6baba expref: 6 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773159.576922:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d26ede0400) 00010000:00010000:1.0:1790773159.576932:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790773159.577005:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc7841aa1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773159.577027:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc7841aa1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773159.577038:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc7841aa1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773159.577066:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7841aa8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773159.577074:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7841aa8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773159.577081:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7841aa8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773159.578186:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc7841aaf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773159.578521:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc7841aaf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773159.578533:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc7841aaf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790773159.578700:0:6479:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000006569b574 reply state 00000000319a1d68 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc7841aaf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.578761:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc7841aaf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.578767:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93d14363dc00) 00010000:00010000:0.0:1790773159.578769:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790773159.578772:0:6479:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1790773159.578777:0:6479:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1790773159.578783:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc7841aa1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.578788:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc7841aa1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.578793:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc7841aa1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.578797:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12ba00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773159.578805:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc7841aa1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.578810:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc7841aa1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.578816:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d14363d700) 00010000:00010000:0.0:1790773159.578817:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773159.578819:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc7841aa1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.578823:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc7841aa1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790773159.578839:0:6479:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000006569b574 reply state 00000000319a1d68 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7841aa8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.578844:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7841aa8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.578848:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93d14363d900) 00010000:00010000:0.0:1790773159.578850:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790773159.578852:0:6479:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1790773159.578964:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+7:10464:x1877761484411264:12345-192.168.202.19@tcp:36:mkdir.0 Request processed in 2208us (2359us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1790773159.578974:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 23 00000100:00100000:1.0:1790773159.594878:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773159.600619:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484411392 00000100:00100000:3.0:1790773159.600637:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484411392 00000100:00100000:3.0:1790773159.600742:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 24 00000100:00100000:3.0:1790773159.600755:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+7:10465:x1877761484411392:12345-192.168.202.19@tcp:101:chmod.0 00010000:00010000:3.0:1790773159.600780:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773159.600813:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7841ab6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bb4d expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773159.600897:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc7841abd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773159.600914:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc7841abd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773159.600927:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc7841abd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790773159.600969:0:6478:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1790773159.600972:0:6478:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790773159.601000:0:6478:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc7841abd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773159.601033:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7841ab6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb4d expref: 9 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773159.601051:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc7841abd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb4d expref: 8 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773159.601070:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d280936c00) 00010000:00010000:3.0:1790773159.601073:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790773159.601077:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d1434ac200, rc 0) 00000100:00100000:3.0:1790773159.601155:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+8:10465:x1877761484411392:12345-192.168.202.19@tcp:101:chmod.0 Request processed in 403us (6286us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773159.601164:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 24 00000100:00100000:0.0:1790773159.616189:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773159.616688:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484411648 00000100:00100000:0.0:1790773159.616698:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484411648 00000100:00100000:0.0:1790773159.616752:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 25 00000100:00100000:0.0:1790773159.616761:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ed6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+8:10465:x1877761484411648:12345-192.168.202.19@tcp:36:chmod.0 00010000:00010000:0.0:1790773159.616829:0:8697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773159.616857:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc7841abd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb4d expref: 8 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.616876:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d280936c00) 00010000:00010000:0.0:1790773159.616887:0:8697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790773159.616917:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5c00/0xabf1cc0bc7841ac4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.616931:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5c00/0xabf1cc0bc7841ac4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.616942:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5c00/0xabf1cc0bc7841ac4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790773159.617150:0:8697:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005c7e9980 reply state 00000000cf984a2c transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5c00/0xabf1cc0bc7841ac4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.617164:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5c00/0xabf1cc0bc7841ac4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.617171:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d2432d4d00) 00010000:00010000:0.0:1790773159.617174:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1790773159.617176:0:8697:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1790773159.617184:0:8697:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1790773159.617298:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ed6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+9:10465:x1877761484411648:12345-192.168.202.19@tcp:36:chmod.0 Request processed in 537us (1119us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1790773159.617305:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 25 00000100:00100000:2.0:1790773159.660249:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773159.660331:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484411776 00000100:00100000:0.0:1790773159.660342:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484411776 00000100:00100000:0.0:1790773159.660420:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 26 00000100:00100000:0.0:1790773159.660431:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+9:10466:x1877761484411776:12345-192.168.202.19@tcp:101:chown.0 00010000:00010000:0.0:1790773159.660456:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773159.660477:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4e00/0xabf1cc0bc7841acb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bb54 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.660541:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4800/0xabf1cc0bc7841ad2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.660556:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4800/0xabf1cc0bc7841ad2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.660567:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4800/0xabf1cc0bc7841ad2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790773159.660607:0:6480:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1790773159.660611:0:6480:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790773159.660648:0:6480:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4800/0xabf1cc0bc7841ad2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.660674:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4e00/0xabf1cc0bc7841acb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb54 expref: 11 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.660692:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4800/0xabf1cc0bc7841ad2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb54 expref: 10 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.660700:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d2432d4d00) 00010000:00010000:0.0:1790773159.660703:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790773159.660707:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d2532e4800, rc 0) 00000100:00100000:0.0:1790773159.660759:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+10:10466:x1877761484411776:12345-192.168.202.19@tcp:101:chown.0 Request processed in 330us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773159.660772:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 26 00000100:00100000:1.0:1790773159.662689:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773159.662770:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484411904 00000100:00100000:0.0:1790773159.662779:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484411904 00000100:00100000:0.0:1790773159.662876:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 27 00000100:00100000:0.0:1790773159.662886:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f968e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+10:10466:x1877761484411904:12345-192.168.202.19@tcp:101:chown.0 00010000:00010000:0.0:1790773159.662904:0:8697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773159.662921:0:8697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5200/0xabf1cc0bc7841ad9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bb5b expref: -99 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.662971:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4a00/0xabf1cc0bc7841ae0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.662982:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4a00/0xabf1cc0bc7841ae0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.662991:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4a00/0xabf1cc0bc7841ae0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.663000:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5800/0xabf1cc0bc7841ae7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.663007:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5800/0xabf1cc0bc7841ae7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.663029:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5800/0xabf1cc0bc7841ae7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.663109:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030c00/0xabf1cc0bc7841aee lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.663132:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030c00/0xabf1cc0bc7841aee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.663139:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030c00/0xabf1cc0bc7841aee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790773159.663176:0:8697:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1790773159.663180:0:8697:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790773159.663196:0:8697:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030c00/0xabf1cc0bc7841aee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.663242:0:8697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4a00/0xabf1cc0bc7841ae0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.663250:0:8697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4a00/0xabf1cc0bc7841ae0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.663256:0:8697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4a00/0xabf1cc0bc7841ae0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.663263:0:8697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d2532e4a00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773159.663267:0:8697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4a00/0xabf1cc0bc7841ae0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.663275:0:8697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4a00/0xabf1cc0bc7841ae0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.663287:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d2432d4d00) 00010000:00010000:0.0:1790773159.663290:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773159.663294:0:8697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4a00/0xabf1cc0bc7841ae0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.663313:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4a00/0xabf1cc0bc7841ae0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.663327:0:8697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5800/0xabf1cc0bc7841ae7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.663332:0:8697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5800/0xabf1cc0bc7841ae7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.663338:0:8697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5800/0xabf1cc0bc7841ae7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.663343:0:8697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d2532e5800 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773159.663346:0:8697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5800/0xabf1cc0bc7841ae7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.663351:0:8697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5800/0xabf1cc0bc7841ae7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.663359:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93d14363d900) 00010000:00010000:0.0:1790773159.663361:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773159.663364:0:8697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5800/0xabf1cc0bc7841ae7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.663369:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5800/0xabf1cc0bc7841ae7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.663393:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5200/0xabf1cc0bc7841ad9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb5b expref: 12 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.663405:0:8697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030c00/0xabf1cc0bc7841aee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb5b expref: 11 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.663418:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93d14363dc00) 00010000:00010000:0.0:1790773159.663420:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790773159.663473:0:8697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d240030c00, rc 0) 00000100:00100000:0.0:1790773159.663522:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f968e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+11:10466:x1877761484411904:12345-192.168.202.19@tcp:101:chown.0 Request processed in 638us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773159.663529:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 27 00000100:00100000:1.0:1790773159.665528:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773159.668236:0:6489:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484412032 00000100:00100000:2.0:1790773159.668252:0:6489:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484412032 00000100:00100000:2.0:1790773159.668329:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:2.0:1790773159.668343:0:6489:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f96aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:110130ab-04fa-4d7c-984e-562032df4432+11:10466:x1877761484412032:12345-192.168.202.19@tcp:900:chown.0 00000100:00100000:2.0:1790773159.668437:0:6489:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f96aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:110130ab-04fa-4d7c-984e-562032df4432+11:10466:x1877761484412032:12345-192.168.202.19@tcp:900:chown.0 Request processed in 98us (2917us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773159.668443:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:1.0:1790773159.671384:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773159.671442:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484412288 00000100:00100000:3.0:1790773159.671534:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484412288 00000100:00100000:3.0:1790773159.671588:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 28 00000100:00100000:3.0:1790773159.671599:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f96ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+11:10466:x1877761484412288:12345-192.168.202.19@tcp:36:chown.0 00010000:00010000:3.0:1790773159.671714:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773159.671742:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030c00/0xabf1cc0bc7841aee lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb5b expref: 11 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773159.671763:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93d14363dc00) 00010000:00010000:3.0:1790773159.671768:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790773159.671790:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7841af5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773159.671873:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7841af5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773159.671884:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7841af5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790773159.679067:0:6457:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:0.0:1790773159.679274:0:6478:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000094a843aa reply state 000000003f63d9ba transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7841af5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.679298:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7841af5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.679309:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93d14363dc00) 00010000:00010000:0.0:1790773159.679311:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1790773159.679316:0:6478:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1790773159.679329:0:6478:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:0.0:1790773159.679420:0:6478:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1790773159.679440:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f96ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+9:10466:x1877761484412288:12345-192.168.202.19@tcp:36:chown.0 Request processed in 7839us (8061us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1790773159.679450:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 28 00010000:00010000:3.0:1790773159.679678:0:3590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7841aa8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773159.679776:0:3590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7841aa8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773159.679785:0:3590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7841aa8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773159.679792:0:3590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12be00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773159.679797:0:3590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7841aa8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773159.679806:0:3590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7841aa8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773159.679819:0:3590:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93d14363d900) 00010000:00010000:3.0:1790773159.679822:0:3590:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790773159.679826:0:3590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7841aa8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773159.679832:0:3590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7841aa8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773159.679854:0:3590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc7841aaf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773159.679862:0:3590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc7841aaf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773159.679868:0:3590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc7841aaf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773159.679873:0:3590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12ae00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773159.679883:0:3590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc7841aaf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773159.679889:0:3591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7841af5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773159.679899:0:3591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7841af5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773159.679907:0:3591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7841af5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773159.679908:0:3590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc7841aaf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773159.679920:0:3591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ada00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773159.679929:0:3590:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93d14363dc00) 00010000:00010000:2.0:1790773159.679929:0:3591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7841af5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773159.679937:0:3590:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790773159.679942:0:3590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc7841aaf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773159.679943:0:3591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7841af5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773159.679961:0:3590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc7841aaf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773159.679967:0:3591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93d14363dc00) 00010000:00010000:3.0:1790773159.679977:0:3590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5c00/0xabf1cc0bc7841ac4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773159.679977:0:3591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790773159.679982:0:3591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7841af5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773159.679988:0:3590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5c00/0xabf1cc0bc7841ac4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773159.679994:0:3591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7841af5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773159.679999:0:3590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5c00/0xabf1cc0bc7841ac4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773159.680009:0:3590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d2532e5c00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773159.680024:0:3590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5c00/0xabf1cc0bc7841ac4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773159.680031:0:3590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5c00/0xabf1cc0bc7841ac4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773159.680040:0:3590:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d2432d4d00) 00010000:00010000:3.0:1790773159.680043:0:3590:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790773159.680052:0:3590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5c00/0xabf1cc0bc7841ac4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773159.680058:0:3590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5c00/0xabf1cc0bc7841ac4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773159.711383:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773159.711719:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484412416 00000100:00100000:2.0:1790773159.711730:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484412416 00000100:00100000:2.0:1790773159.711832:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 29 00000100:00100000:2.0:1790773159.711843:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+6:10467:x1877761484412416:12345-192.168.202.19@tcp:101:touch.500 00010000:00010000:2.0:1790773159.711872:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773159.711894:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7841afc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bb62 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790773159.718505:0:6479:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 6558us 00010000:00010000:0.0:1790773159.750606:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031800/0xabf1cc0bc7841b03 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.750631:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031800/0xabf1cc0bc7841b03 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.750644:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031800/0xabf1cc0bc7841b03 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.750675:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030800/0xabf1cc0bc7841b0a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.750683:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030800/0xabf1cc0bc7841b0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.750690:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030800/0xabf1cc0bc7841b0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.750815:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030200/0xabf1cc0bc7841b11 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.750825:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030200/0xabf1cc0bc7841b11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.750832:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030200/0xabf1cc0bc7841b11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790773159.750859:0:6479:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1790773159.750863:0:6479:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790773159.750901:0:6479:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030200/0xabf1cc0bc7841b11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.750914:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031800/0xabf1cc0bc7841b03 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.750921:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031800/0xabf1cc0bc7841b03 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.750927:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031800/0xabf1cc0bc7841b03 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.750943:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d240031800 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773159.750947:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031800/0xabf1cc0bc7841b03 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.750955:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031800/0xabf1cc0bc7841b03 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.750967:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d2432d4d00) 00010000:00010000:0.0:1790773159.750970:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773159.750976:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031800/0xabf1cc0bc7841b03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.750982:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031800/0xabf1cc0bc7841b03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.750996:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030800/0xabf1cc0bc7841b0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.751001:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030800/0xabf1cc0bc7841b0a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.751007:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030800/0xabf1cc0bc7841b0a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.751023:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d240030800 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773159.751026:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030800/0xabf1cc0bc7841b0a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.751032:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030800/0xabf1cc0bc7841b0a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.751051:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93d2432d4400) 00010000:00010000:0.0:1790773159.751053:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773159.751056:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030800/0xabf1cc0bc7841b0a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.751062:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030800/0xabf1cc0bc7841b0a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.751106:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7841afc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb62 expref: 8 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.751122:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030200/0xabf1cc0bc7841b11 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb62 expref: 7 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.751130:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93d2432d4600) 00010000:00010000:0.0:1790773159.751133:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1790773159.751135:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d240030200, rc 0) 00000100:00100000:0.0:1790773159.752076:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+7:10467:x1877761484412416:12345-192.168.202.19@tcp:101:touch.500 Request processed in 40231us (40698us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773159.752086:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 29 00000100:00100000:1.0:1790773159.757057:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773159.757135:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484412672 00000100:00100000:0.0:1790773159.757158:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484412672 00000100:00100000:0.0:1790773159.757239:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 30 00000100:00100000:0.0:1790773159.757248:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f96a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+7:10467:x1877761484412672:12345-192.168.202.19@tcp:101:touch.500 00010000:00010000:0.0:1790773159.757268:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773159.757287:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030800/0xabf1cc0bc7841b18 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bb69 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.757415:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031800/0xabf1cc0bc7841b1f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.757430:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031800/0xabf1cc0bc7841b1f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.757439:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031800/0xabf1cc0bc7841b1f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.757474:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030600/0xabf1cc0bc7841b26 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.757479:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030600/0xabf1cc0bc7841b26 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.757483:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030600/0xabf1cc0bc7841b26 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790773159.757855:0:6480:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:0.0:1790773159.757963:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031a00/0xabf1cc0bc7841b2d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.757969:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031a00/0xabf1cc0bc7841b2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.757974:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031a00/0xabf1cc0bc7841b2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.757995:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031800/0xabf1cc0bc7841b1f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.758007:0:6480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031800/0xabf1cc0bc7841b1f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.758025:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031800/0xabf1cc0bc7841b1f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.758031:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d240031800 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773159.758036:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031800/0xabf1cc0bc7841b1f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.758044:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031800/0xabf1cc0bc7841b1f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.758058:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93d2432d4600) 00010000:00010000:0.0:1790773159.758061:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773159.758067:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031800/0xabf1cc0bc7841b1f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.758073:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031800/0xabf1cc0bc7841b1f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773159.758082:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:0.0:1790773159.758086:0:6480:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000000214f88 reply state 0000000018ae796e transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030600/0xabf1cc0bc7841b26 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.758096:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030600/0xabf1cc0bc7841b26 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.758102:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xf79bc41e (ffff93d2432d4400) 00010000:00010000:0.0:1790773159.758104:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790773159.758107:0:6480:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790773159.758132:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030800/0xabf1cc0bc7841b18 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb69 expref: 10 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.758155:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031a00/0xabf1cc0bc7841b2d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb69 expref: 9 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.758162:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff93d2432d4300) 00010000:00010000:0.0:1790773159.758165:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790773159.758167:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d240031a00, rc 0) 00000100:00100000:0.0:1790773159.758259:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f96a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+10:10467:x1877761484412672:12345-192.168.202.19@tcp:101:touch.500 Request processed in 1012us (1210us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1790773159.758267:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 30 00000100:00100000:0.0:1790773159.763862:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773159.768334:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484412928 00000100:00100000:2.0:1790773159.768351:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484412928 00000100:00100000:2.0:1790773159.768515:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 31 00000100:00100000:2.0:1790773159.768535:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ed68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+10:10467:x1877761484412928:12345-192.168.202.19@tcp:36:touch.500 00010000:00010000:2.0:1790773159.768593:0:8697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790773159.768619:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031a00/0xabf1cc0bc7841b2d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb69 expref: 10 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773159.768639:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff93d2432d4300) 00010000:00010000:2.0:1790773159.768650:0:8697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790773159.768703:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc7841b3b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773159.768716:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc7841b3b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773159.768738:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc7841b3b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790773159.768934:0:8697:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000080d3d75f reply state 00000000823e1b31 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc7841b3b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773159.768947:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc7841b3b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773159.768954:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff93d255bad200) 00010000:00010000:2.0:1790773159.768957:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790773159.768959:0:8697:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790773159.769070:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ed68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+11:10467:x1877761484412928:12345-192.168.202.19@tcp:36:touch.500 Request processed in 536us (5217us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1790773159.769077:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 31 00000100:00100000:1.0:1790773159.776472:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773159.777338:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484413056 00000100:00100000:3.0:1790773159.777349:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484413056 00000100:00100000:3.0:1790773159.777408:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 32 00000100:00100000:3.0:1790773159.777419:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f968000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+11:10467:x1877761484413056:12345-192.168.202.19@tcp:101:touch.500 00010000:00010000:3.0:1790773159.777444:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773159.777465:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc7841b42 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bb70 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773159.777525:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc7841b42 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb70 expref: 12 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773159.777540:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc7841b42 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb70 expref: 12 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773159.777559:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff93d255bad200) 00010000:00010000:3.0:1790773159.777563:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790773159.777566:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d1434ade00, rc 0) 00000100:00100000:3.0:1790773159.777645:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f968000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+12:10467:x1877761484413056:12345-192.168.202.19@tcp:101:touch.500 Request processed in 228us (1187us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773159.777652:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 32 00000100:00100000:1.0:1790773159.780639:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773159.780729:0:8392:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484413184 00000100:00100000:2.0:1790773159.780738:0:8392:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484413184 00000100:00100000:2.0:1790773159.780786:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 24 00000100:00100000:2.0:1790773159.780793:0:8392:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f968700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2396:x1877761484413184:12345-192.168.202.19@tcp:8:touch.500 00010000:00080000:2.0:1790773159.780826:0:8392:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 110130ab-04fa-4d7c-984e-562032df4432@192.168.202.19@tcp t0 exp 0000000000000000 cur 302 last 0 00000020:00000080:2.0:1790773159.780855:0:8392:0:(genops.c:1384:class_connect()) connect: client 110130ab-04fa-4d7c-984e-562032df4432, cookie 0xabf1cc0bc7841b49 00002000:00100000:2.0:1790773159.780865:0:8392:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 110130ab-04fa-4d7c-984e-562032df4432/ffff93d143c84800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b04 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790773159.780881:0:8392:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790773159.780946:0:8392:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790773159.780970:0:8392:0:(import.c:65:import_set_state_nolock()) ffff93d143c81000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790773159.781136:0:8392:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f968700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:110130ab-04fa-4d7c-984e-562032df4432+6:2396:x1877761484413184:12345-192.168.202.19@tcp:8:touch.500 Request processed in 251us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773159.781162:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 24 00000100:00100000:0.0:1790773159.782617:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773159.782690:0:8394:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484413312 00000100:00100000:1.0:1790773159.782697:0:8394:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484413312 00000100:00100000:1.0:1790773159.782749:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 25 00000100:00100000:1.0:1790773159.782757:0:8394:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ed6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:110130ab-04fa-4d7c-984e-562032df4432+6:0:x1877761484413312:12345-192.168.202.19@tcp:2:touch.500 00000100:00080000:0.0:1790773159.783136:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1790773159.793450:0:9475:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:2.0:1790773159.793466:0:9475:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 110130ab-04fa-4d7c-984e-562032df4432 00000100:00100000:0.0:1790773159.803417:0:8394:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ed6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:110130ab-04fa-4d7c-984e-562032df4432+5:0:x1877761484413312:12345-192.168.202.19@tcp:2:touch.500 Request processed in 20649us (20795us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1790773159.803431:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 25 00000100:00100000:3.0:1790773159.810663:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773159.810764:0:6482:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484413568 00000100:00100000:2.0:1790773159.810776:0:6482:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484413568 00000100:00100000:2.0:1790773159.810834:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 2 00000100:00100000:2.0:1790773159.810844:0:6482:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+12:10467:x1877761484413568:12345-192.168.202.19@tcp:35:touch.500 00000100:00100000:2.0:1790773159.811138:0:6482:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+13:10467:x1877761484413568:12345-192.168.202.19@tcp:35:touch.500 Request processed in 295us (485us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1790773159.811154:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 2 00000100:00100000:1.0:1790773159.828425:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773159.828555:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484413696 00000100:00100000:0.0:1790773159.828567:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484413696 00000100:00100000:0.0:1790773159.828636:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 33 00000100:00100000:0.0:1790773159.828647:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f969500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+13:10468:x1877761484413696:12345-192.168.202.19@tcp:101:rm.0 00010000:00010000:0.0:1790773159.828674:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773159.828695:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030c00/0xabf1cc0bc7841b50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bb77 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.828776:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031800/0xabf1cc0bc7841b57 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.828807:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031800/0xabf1cc0bc7841b57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.828818:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031800/0xabf1cc0bc7841b57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790773159.828862:0:6479:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1790773159.828866:0:6479:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790773159.828905:0:6479:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031800/0xabf1cc0bc7841b57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.828932:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030c00/0xabf1cc0bc7841b50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb77 expref: 15 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.828951:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031800/0xabf1cc0bc7841b57 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb77 expref: 14 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.828961:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93d2432d4600) 00010000:00010000:0.0:1790773159.828964:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790773159.828967:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d240031800, rc 0) 00000100:00100000:0.0:1790773159.829040:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f969500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+14:10468:x1877761484413696:12345-192.168.202.19@tcp:101:rm.0 Request processed in 395us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773159.829047:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 33 00000100:00100000:0.0:1790773159.834952:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773159.835039:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484413952 00000100:00100000:2.0:1790773159.835050:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484413952 00000100:00100000:2.0:1790773159.835116:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 34 00000100:00100000:2.0:1790773159.835127:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ed6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+14:10468:x1877761484413952:12345-192.168.202.19@tcp:101:rm.0 00010000:00010000:2.0:1790773159.835149:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773159.835170:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7841b5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bb7e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790773159.835298:0:6480:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1790773159.835661:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7841b5e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb7e expref: 16 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773159.835677:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d2432d4d00) 00010000:00010000:2.0:1790773159.835681:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790773159.835686:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7841b5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb7e expref: 16 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773159.835726:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26efc5600, rc 0) 00000100:00100000:2.0:1790773159.835790:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ed6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+15:10468:x1877761484413952:12345-192.168.202.19@tcp:101:rm.0 Request processed in 665us (850us total) trans 4294967305 rc 301/301 00000100:00100000:2.0:1790773159.835798:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 34 00000100:00100000:3.0:1790773159.842601:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773159.842734:0:6482:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484414080 00000100:00100000:2.0:1790773159.842745:0:6482:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484414080 00000100:00100000:2.0:1790773159.842796:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 3 00000100:00100000:2.0:1790773159.842806:0:6482:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+15:10468:x1877761484414080:12345-192.168.202.19@tcp:37:rm.0 00000100:00100000:2.0:1790773159.850829:0:6482:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+15:10468:x1877761484414080:12345-192.168.202.19@tcp:37:rm.0 Request processed in 8010us (8223us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773159.850844:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 3 00000100:00100000:0.0:1790773159.862927:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773159.863022:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484414336 00000100:00100000:3.0:1790773159.863035:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484414336 00000100:00100000:3.0:1790773159.863100:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00100000:3.0:1790773159.863113:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d279db8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:110130ab-04fa-4d7c-984e-562032df4432+15:10468:x1877761484414336:12345-192.168.202.19@tcp:35:rm.0 00000100:00100000:3.0:1790773159.863455:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d279db8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:110130ab-04fa-4d7c-984e-562032df4432+16:10468:x1877761484414336:12345-192.168.202.19@tcp:35:rm.0 Request processed in 343us (538us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1790773159.863464:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00100000:2.0:1790773159.870990:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773159.871103:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484414592 00000100:00100000:0.0:1790773159.871116:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484414592 00000100:00100000:0.0:1790773159.871185:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 35 00000100:00100000:0.0:1790773159.871197:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+16:10468:x1877761484414592:12345-192.168.202.19@tcp:101:rm.0 00010000:00010000:0.0:1790773159.871258:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773159.871284:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030800/0xabf1cc0bc7841b6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bb85 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.871397:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031a00/0xabf1cc0bc7841b73 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.871415:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031a00/0xabf1cc0bc7841b73 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.871427:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031a00/0xabf1cc0bc7841b73 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790773159.871452:0:6479:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1790773159.871840:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030800/0xabf1cc0bc7841b6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb85 expref: 19 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.871862:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031a00/0xabf1cc0bc7841b73 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb85 expref: 18 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.871872:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93d2432d4600) 00010000:00010000:0.0:1790773159.871875:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790773159.871878:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d240031a00, rc 0) 00000100:00100000:0.0:1790773159.871949:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+18:10468:x1877761484414592:12345-192.168.202.19@tcp:101:rm.0 Request processed in 753us (967us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1790773159.871957:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 35 00000100:00100000:1.0:1790773159.875130:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773159.875240:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484414720 00000100:00100000:0.0:1790773159.875250:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484414720 00000100:00100000:0.0:1790773159.875308:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 36 00000100:00100000:0.0:1790773159.875332:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f969f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+18:10468:x1877761484414720:12345-192.168.202.19@tcp:41:rm.0 00000004:00000024:0.0:1790773159.875389:0:6478:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:0.0:1790773159.875454:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f969f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+18:10468:x1877761484414720:12345-192.168.202.19@tcp:41:rm.0 Request processed in 124us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773159.875462:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 36 00000100:00100000:1.0:1790773159.880750:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773159.881022:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484414848 00000100:00100000:0.0:1790773159.881143:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484414848 00000100:00100000:0.0:1790773159.881295:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 37 00000100:00100000:0.0:1790773159.881307:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+18:10468:x1877761484414848:12345-192.168.202.19@tcp:101:rm.0 00010000:00010000:0.0:1790773159.881330:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773159.881350:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030800/0xabf1cc0bc7841b81 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bb8c expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.881416:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030c00/0xabf1cc0bc7841b88 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.881430:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030c00/0xabf1cc0bc7841b88 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.881441:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030c00/0xabf1cc0bc7841b88 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.881451:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5c00/0xabf1cc0bc7841b8f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.881457:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5c00/0xabf1cc0bc7841b8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.881463:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5c00/0xabf1cc0bc7841b8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.881567:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5200/0xabf1cc0bc7841b96 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.881576:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5200/0xabf1cc0bc7841b96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.881583:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5200/0xabf1cc0bc7841b96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790773159.881618:0:6479:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:0.0:1790773159.881622:0:6479:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790773159.881638:0:6479:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5200/0xabf1cc0bc7841b96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.881649:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5200/0xabf1cc0bc7841b96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.881657:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030c00/0xabf1cc0bc7841b88 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.881664:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030c00/0xabf1cc0bc7841b88 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.881671:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030c00/0xabf1cc0bc7841b88 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.881677:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d240030c00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773159.881681:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030c00/0xabf1cc0bc7841b88 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.881689:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030c00/0xabf1cc0bc7841b88 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.883255:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93d2432d4600) 00010000:00010000:0.0:1790773159.883260:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773159.883267:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030c00/0xabf1cc0bc7841b88 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.883275:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030c00/0xabf1cc0bc7841b88 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.883293:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5c00/0xabf1cc0bc7841b8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.883300:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5c00/0xabf1cc0bc7841b8f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.883307:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5c00/0xabf1cc0bc7841b8f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.883312:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d2532e5c00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773159.883315:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5c00/0xabf1cc0bc7841b8f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.883323:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5c00/0xabf1cc0bc7841b8f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.883331:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xf79bc41e (ffff93d2432d4400) 00010000:00010000:0.0:1790773159.883333:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773159.883336:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5c00/0xabf1cc0bc7841b8f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.883341:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5c00/0xabf1cc0bc7841b8f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.883391:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030800/0xabf1cc0bc7841b81 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb8c expref: 20 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.883405:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5200/0xabf1cc0bc7841b96 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb8c expref: 19 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.883411:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff93d255bad200) 00010000:00010000:0.0:1790773159.883414:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790773159.883416:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d2532e5200, rc 0) 00000100:00100000:0.0:1790773159.883479:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+19:10468:x1877761484414848:12345-192.168.202.19@tcp:101:rm.0 Request processed in 2174us (2739us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773159.883488:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 37 00000100:00100000:1.0:1790773159.887693:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773159.887966:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484415104 00000100:00100000:0.0:1790773159.887975:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484415104 00000100:00100000:0.0:1790773159.888038:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 38 00000100:00100000:0.0:1790773159.888059:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f969c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+19:10468:x1877761484415104:12345-192.168.202.19@tcp:36:rm.0 00010000:00010000:0.0:1790773159.888113:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1790773159.888137:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5200/0xabf1cc0bc7841b96 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb8c expref: 19 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.888158:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc7841b42 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb70 expref: 18 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.888170:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff93d255bad200) 00010000:00010000:0.0:1790773159.888180:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031800/0xabf1cc0bc7841b57 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb77 expref: 17 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.889045:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93d2432d4600) 00010000:00010000:0.0:1790773159.889049:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790773159.889074:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5800/0xabf1cc0bc7841b9d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.889088:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5800/0xabf1cc0bc7841b9d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.889098:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5800/0xabf1cc0bc7841b9d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.889107:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4a00/0xabf1cc0bc7841ba4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.889112:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4a00/0xabf1cc0bc7841ba4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.889117:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4a00/0xabf1cc0bc7841ba4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.889406:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4e00/0xabf1cc0bc7841bab lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.889414:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4e00/0xabf1cc0bc7841bab lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.889420:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4e00/0xabf1cc0bc7841bab lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790773159.889643:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1790773159.889651:0:6478:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 302691446396ns, next at 303691444356ns, rc = 0 00010000:00010000:0.0:1790773159.889820:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc7841bb2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.889830:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc7841bb2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.889837:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc7841bb2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.889843:0:6478:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc7841bb2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.889850:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc7841bb2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.889856:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc7841bb2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.889910:0:6478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790773159.889931:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4e00/0xabf1cc0bc7841bab lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.889938:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4e00/0xabf1cc0bc7841bab lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.889944:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4e00/0xabf1cc0bc7841bab lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.889950:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d2532e4e00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773159.889954:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4e00/0xabf1cc0bc7841bab lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.889963:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4e00/0xabf1cc0bc7841bab lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.889979:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff93d255bad200) 00010000:00010000:0.0:1790773159.889982:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1790773159.889986:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4e00/0xabf1cc0bc7841bab lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.889992:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4e00/0xabf1cc0bc7841bab lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.890017:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5800/0xabf1cc0bc7841b9d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.890023:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5800/0xabf1cc0bc7841b9d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.890029:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5800/0xabf1cc0bc7841b9d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.890034:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d2532e5800 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773159.890037:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5800/0xabf1cc0bc7841b9d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.890051:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5800/0xabf1cc0bc7841b9d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.890057:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93d2432d4600) 00010000:00010000:0.0:1790773159.890060:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773159.890062:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5800/0xabf1cc0bc7841b9d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.890067:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5800/0xabf1cc0bc7841b9d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790773159.890087:0:6478:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003d81558f reply state 00000000c6d62282 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4a00/0xabf1cc0bc7841ba4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.890097:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4a00/0xabf1cc0bc7841ba4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773159.890103:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xf79bc41e (ffff93d2432d4400) 00010000:00010000:0.0:1790773159.890106:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790773159.890109:0:6478:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790773159.890194:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f969c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+18:10468:x1877761484415104:12345-192.168.202.19@tcp:36:rm.0 Request processed in 2144us (2508us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1790773159.890233:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 38 00010000:00010000:3.0:1790773159.891288:0:8409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790773159.891298:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc7841bb2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773159.891306:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074bc00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:3.0:1790773159.891309:0:8409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc7841bb2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773159.891317:0:8409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc7841bb2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773159.891327:0:8409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff93d255bad200) 00010000:00010000:3.0:1790773159.891329:0:8409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790773159.891332:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc7841bb2 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773159.891338:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc7841bb2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773159.891349:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773159.891351:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773159.891352:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773159.895374:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773159.901870:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484415360 00000100:00100000:3.0:1790773159.901899:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484415360 00000100:00100000:3.0:1790773159.902029:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00100000:3.0:1790773159.902039:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:110130ab-04fa-4d7c-984e-562032df4432+18:10468:x1877761484415360:12345-192.168.202.19@tcp:35:rm.0 00000100:00100000:3.0:1790773159.903430:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:110130ab-04fa-4d7c-984e-562032df4432+19:10468:x1877761484415360:12345-192.168.202.19@tcp:35:rm.0 Request processed in 1386us (8059us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1790773159.903440:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00100000:1.0:1790773159.906041:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773159.906127:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484415616 00000100:00100000:2.0:1790773159.906138:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484415616 00000100:00100000:2.0:1790773159.906189:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 39 00000100:00100000:2.0:1790773159.906197:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+19:10468:x1877761484415616:12345-192.168.202.19@tcp:36:rm.0 00010000:00010000:2.0:1790773159.906266:0:8697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1790773159.906288:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031a00/0xabf1cc0bc7841b73 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb85 expref: 19 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773159.906303:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030200/0xabf1cc0bc7841b11 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb62 expref: 18 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773159.906312:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93d2432d4600) 00010000:00010000:2.0:1790773159.906338:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4800/0xabf1cc0bc7841ad2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb54 expref: 17 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773159.906343:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d2432d4d00) 00010000:00010000:2.0:1790773159.906347:0:8697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790773159.906368:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7841bb9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773159.906377:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7841bb9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773159.906383:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7841bb9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773159.906392:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc7841bc0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773159.906396:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc7841bc0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773159.906400:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc7841bc0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773159.906473:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7841bc7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773159.906481:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7841bc7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773159.906488:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7841bc7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790773159.906687:0:8697:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1790773159.906709:0:8697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7841bc7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773159.906717:0:8697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7841bc7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773159.906724:0:8697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7841bc7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773159.906730:0:8697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc5200 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:2.0:1790773159.906734:0:8697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7841bc7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773159.906741:0:8697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7841bc7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773159.906750:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff93d255bad500) 00010000:00010000:2.0:1790773159.906753:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1790773159.906766:0:8697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7841bc7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773159.906773:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7841bc7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773159.906789:0:8697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7841bb9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773159.906794:0:8697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7841bb9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773159.906800:0:8697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7841bb9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773159.906805:0:8697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc5600 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:2.0:1790773159.906814:0:8697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7841bb9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773159.906820:0:8697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7841bb9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773159.906827:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d255badf00) 00010000:00010000:2.0:1790773159.906830:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790773159.906833:0:8697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7841bb9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773159.906838:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7841bb9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790773159.906850:0:8697:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000028e79c81 reply state 00000000051b811b transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc7841bc0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773159.906859:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc7841bc0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773159.906865:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93d255bad400) 00010000:00010000:2.0:1790773159.906867:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790773159.906869:0:8697:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790773159.906930:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+18:10468:x1877761484415616:12345-192.168.202.19@tcp:36:rm.0 Request processed in 733us (899us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1790773159.906938:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 39 00000100:00100000:1.0:1790773160.269871:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496029056:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790773160.269910:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496029184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790773160.269947:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773160.269991:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773160.270089:0:11145:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496029056 00000100:00100000:1.0:1790773160.270098:0:11145:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496029056 00000100:00080000:0.0:1790773160.270132:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790773160.270150:0:11145:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496029184 00000100:00100000:1.0:1790773160.270154:0:11145:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496029184 00000100:00100000:0.0:1790773160.270159:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1790773160.270171:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143c7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496029056:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790773160.270183:0:11145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1790773160.270192:0:11145:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ca5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496029184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790773160.270223:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:1.0:1790773160.270259:0:11145:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790773160.270275:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143c7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496029056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773160.270284:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1790773160.270304:0:11145:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ca5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496029184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773160.270313:0:11145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:1.0:1790773160.270349:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1437d4e00 x1877761496029184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773176 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773160.270367:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496029184:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790773160.270522:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790773160.270543:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f9cf100 x1877761496029056/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773176 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773160.270557:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496029056:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1790773160.783756:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773161.806645:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773162.029849:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773162.029897:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773162.029937:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773162.029969:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773162.029999:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773162.030102:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484415872 00000100:00100000:3.0:1790773162.030115:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484415872 00000100:00100000:3.0:1790773162.030182:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484416384 00000100:00100000:3.0:1790773162.030186:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484416384 00000100:00100000:3.0:1790773162.030221:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484416000 00000100:00100000:3.0:1790773162.030225:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484416000 00000100:00100000:3.0:1790773162.030246:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 201 00000100:00100000:3.0:1790773162.030256:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143c7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+18:2400:x1877761484415872:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1790773162.030339:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143c7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+18:2400:x1877761484415872:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 84us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773162.030347:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 201 00000100:00100000:3.0:1790773162.030365:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 202 00000100:00100000:3.0:1790773162.030372:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143c7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2400:x1877761484416384:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1790773162.030399:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143c7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2400:x1877761484416384:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 28us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773162.030404:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 202 00000100:00100000:3.0:1790773162.030416:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 203 00000100:00100000:3.0:1790773162.030422:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143c7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+5:2400:x1877761484416000:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1790773162.030444:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143c7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+5:2400:x1877761484416000:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 22us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773162.030458:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 203 00000100:00080000:3.0:1790773162.030475:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790773162.030480:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790773162.031227:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773162.031255:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484416256 00000100:00100000:1.0:1790773162.031261:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484416256 00000100:00100000:1.0:1790773162.031299:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 204 00000100:00100000:1.0:1790773162.031307:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143c7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2400:x1877761484416256:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773162.031347:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143c7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2400:x1877761484416256:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 41us (1321us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773162.031354:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 204 00000100:00100000:1.0:1790773162.031374:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484415744 00000100:00100000:1.0:1790773162.031378:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484415744 00000100:00100000:1.0:1790773162.031401:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 335 00000100:00100000:1.0:1790773162.031408:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:2400:x1877761484415744:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773162.031433:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:2400:x1877761484415744:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 25us (1464us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773162.031446:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 335 00000100:00100000:2.0:1790773162.033085:0:8906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484416128 00000100:00100000:2.0:1790773162.033099:0:8906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484416128 00000100:00100000:2.0:1790773162.033191:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 80 00000100:00100000:2.0:1790773162.033201:0:8906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:110130ab-04fa-4d7c-984e-562032df4432+5:2400:x1877761484416128:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1790773162.033295:0:8906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:110130ab-04fa-4d7c-984e-562032df4432+5:2400:x1877761484416128:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 95us (3397us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773162.033303:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 80 00000100:00080000:3.0:1790773162.039434:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790773162.039445:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790773162.317555:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496029312:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790773162.317653:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773162.318548:0:6484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496029312 00000100:00100000:2.0:1790773162.318558:0:6484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496029312 00000100:00100000:2.0:1790773162.318610:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1790773162.318621:0:6484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496029312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790773162.318655:0:6484:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1790773162.318727:0:6484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496029312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773162.318735:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1790773162.318776:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496029440:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790773162.318807:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773162.318847:0:6483:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496029440 00000100:00100000:2.0:1790773162.318851:0:6483:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496029440 00000100:00100000:2.0:1790773162.318874:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1790773162.318880:0:6483:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496029440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790773162.318900:0:6483:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790773162.318933:0:6483:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496029440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 52us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773162.318939:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1790773162.318978:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496029312:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790773162.319027:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496029440:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790773162.320036:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143c7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496029568:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790773162.320093:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773162.320226:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496029568 00000100:00100000:1.0:1790773162.320233:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496029568 00000100:00100000:1.0:1790773162.320283:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1790773162.320292:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496029568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790773162.320323:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790773162.320376:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496029568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773162.320383:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:2.0:1790773162.320766:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1790773162.320794:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143c7ce00 x1877761496029568/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773178 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773162.320813:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143c7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496029568:0@lo:13:osp-pre-1-1.0 00000004:00080000:2.0:1790773162.321630:0:9869:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 305123424420ns, next at 306123421918ns, rc = 0 00000100:00100000:2.0:1790773162.321652:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790773162.321666:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496029696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790773162.321825:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773162.321862:0:8397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496029696 00000100:00100000:2.0:1790773162.321868:0:8397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496029696 00000100:00100000:2.0:1790773162.322124:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1790773162.322136:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496029696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790773162.322157:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790773162.322198:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496029696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773162.322225:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:2.0:1790773162.322245:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1790773162.322269:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143ce2300 x1877761496029696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773178 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773162.322287:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496029696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790773162.322578:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3606:1877761496029952:0@lo:400:kworker.0 00000100:00100000:1.0:1790773162.322672:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790773162.322748:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce0675b4-b0c5-48e7-b182-565e22fed04c:3604:1877761496029824:0@lo:400:kworker.0 00000100:00100000:1.0:1790773162.322788:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773162.322826:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496029824 00000100:00100000:1.0:1790773162.322830:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496029824 00000100:00100000:1.0:1790773162.322859:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1790773162.322865:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3604:x1877761496029824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773162.322902:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3604:x1877761496029824:12345-0@lo:400:kworker.0 Request processed in 36us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773162.322909:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1790773162.323023:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773162.323077:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877761496030080:0@lo:400:kworker.0 00000100:00100000:3.0:1790773162.323101:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773162.323132:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496029952 00000100:00100000:3.0:1790773162.323136:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496029952 00000100:00100000:3.0:1790773162.323161:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496030080 00000100:00100000:3.0:1790773162.323164:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496030080 00000100:00100000:3.0:1790773162.323180:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1790773162.323186:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1877761496029952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773162.323244:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1877761496029952:12345-0@lo:400:kworker.0 Request processed in 58us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773162.323251:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1790773162.323266:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1790773162.323272:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877761496030080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773162.323304:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877761496030080:12345-0@lo:400:kworker.0 Request processed in 33us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773162.323310:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1790773162.323820:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce0675b4-b0c5-48e7-b182-565e22fed04c:3604:1877761496029824:0@lo:400:kworker.0 00000100:00100000:3.0:1790773162.325523:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3606:1877761496029952:0@lo:400:kworker.0 00000100:00100000:3.0:1790773162.325588:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877761496030080:0@lo:400:kworker.0 00000100:00100000:1.0:1790773162.326237:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3604:1877761496030208:0@lo:400:kworker.0 00000100:00100000:1.0:1790773162.326303:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773162.326805:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496030464:0@lo:400:kworker.0 00000100:00100000:3.0:1790773162.326840:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773162.326873:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790773162.326881:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496030592:0@lo:400:kworker.0 00000100:00100000:3.0:1790773162.326903:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773162.327006:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3604:1877761496030720:0@lo:400:kworker.0 00000100:00100000:1.0:1790773162.327033:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773162.327063:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1790773162.327069:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3604:1877761496030336:0@lo:400:kworker.0 00000100:00100000:1.0:1790773162.327095:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773162.327113:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3604:1877761496030848:0@lo:400:kworker.0 00000100:00100000:1.0:1790773162.327132:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773162.327164:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496030208 00000100:00100000:1.0:1790773162.327171:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496030208 00000100:00100000:1.0:1790773162.328119:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496030720 00000100:00100000:1.0:1790773162.328126:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496030720 00000100:00100000:1.0:1790773162.328147:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496030336 00000100:00100000:1.0:1790773162.328149:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496030336 00000100:00100000:1.0:1790773162.328162:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496030848 00000100:00100000:1.0:1790773162.328165:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496030848 00000100:00100000:1.0:1790773162.328182:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1790773162.328190:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3604:x1877761496030208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773162.328309:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3604:x1877761496030208:12345-0@lo:400:kworker.0 Request processed in 118us (2004us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773162.328316:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1790773162.328336:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1790773162.328343:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14378ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3604:x1877761496030720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773162.328373:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14378ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3604:x1877761496030720:12345-0@lo:400:kworker.0 Request processed in 31us (1339us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773162.328379:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1790773162.328390:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1790773162.328396:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14378f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3604:x1877761496030336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773162.328426:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14378f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3604:x1877761496030336:12345-0@lo:400:kworker.0 Request processed in 30us (1330us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773162.328442:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1790773162.328454:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1790773162.328460:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14378c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3604:x1877761496030848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773162.328490:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14378c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3604:x1877761496030848:12345-0@lo:400:kworker.0 Request processed in 30us (1356us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773162.328495:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00080000:1.0:1790773162.328513:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790773162.328517:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790773162.328696:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143ce3b80 x1877761496030336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773162.328711:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3604:1877761496030336:0@lo:400:kworker.0 00010000:00080000:0.0:1790773162.328724:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f9e4700 x1877761496030848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773162.328732:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3604:1877761496030848:0@lo:400:kworker.0 00000100:00100000:0.0:1790773162.328742:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3604:1877761496030208:0@lo:400:kworker.0 00000100:00100000:0.0:1790773162.328751:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3604:1877761496030720:0@lo:400:kworker.0 00000100:00100000:2.0:1790773162.328998:0:8393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496030464 00000100:00100000:2.0:1790773162.329004:0:8393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496030464 00000100:00100000:2.0:1790773162.329048:0:8393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496030592 00000100:00100000:2.0:1790773162.329052:0:8393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496030592 00000100:00100000:2.0:1790773162.329072:0:8393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1790773162.329088:0:8393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496030464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773162.329132:0:8393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496030464:12345-0@lo:400:kworker.0 Request processed in 47us (2292us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773162.329139:0:8393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1790773162.329152:0:8393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1790773162.329158:0:8393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496030592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773162.329189:0:8393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496030592:12345-0@lo:400:kworker.0 Request processed in 30us (2285us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773162.329195:0:8393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1790773162.329340:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790773162.332434:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f9cf100 x1877761496030592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773162.332455:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496030592:0@lo:400:kworker.0 00010000:00080000:3.0:1790773162.332472:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1437d4e00 x1877761496030464/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773162.332480:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496030464:0@lo:400:kworker.0 00010000:00010000:3.0:1790773162.829435:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790773163.735502:0:13643:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:0.0:1790773163.853578:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790773164.703193:0:13691:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdd9b69530 20000000:00000080:1.0:1790773164.703234:0:13691:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93d141f91000 uarg=0000000000000000 20000000:01000000:1.0:1790773164.703279:0:13691:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1790773164.703285:0:13691:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1790773164.703289:0:13691:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1790773164.709557:0:13692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1790773164.709769:0:13691:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1790773164.714464:0:13691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1790773164.714499:0:13691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1790773164.714512:0:13691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1790773164.714526:0:13691:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1790773164.714546:0:13691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93d27b12a200/0xabf1cc0bc7841bce lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773164.714569:0:13691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d26efc4c00/0xabf1cc0bc7841a5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb3f expref: 12 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773164.714577:0:13691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d26efc4800/0xabf1cc0bc7841a62 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb46 expref: 12 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773164.714586:0:13691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d26efc5000/0xabf1cc0bc7841a70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7841a69 expref: 23 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773164.714608:0:13691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d26efc5400/0xabf1cc0bc7841a7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7841a77 expref: 23 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773164.714615:0:13691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d1434ac800/0xabf1cc0bc7841a8c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7841a85 expref: 23 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773164.714622:0:13691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d1434acc00/0xabf1cc0bc7841a9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7841a93 expref: 23 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773164.714631:0:13691:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93d27b12a200/0xabf1cc0bc7841bce lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773164.714673:0:13691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d1434acc00/0xabf1cc0bc7841a9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc7841a93 expref: 23 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773164.714688:0:13691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d1434acc00/0xabf1cc0bc7841a9a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc7841a93 expref: 23 pid: 6473 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773164.714703:0:13691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14378df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13691:1877761496030976:0@lo:104: 00000100:00100000:1.0:1790773164.714769:0:13691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790773164.714820:0:13691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d1434ac800/0xabf1cc0bc7841a8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc7841a85 expref: 23 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773164.714829:0:13691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d1434ac800/0xabf1cc0bc7841a8c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc7841a85 expref: 23 pid: 6471 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773164.714837:0:13691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14378ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13691:1877761496031104:0@lo:104: 00000100:00100000:1.0:1790773164.714859:0:13691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790773164.714980:0:13691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d26efc5400/0xabf1cc0bc7841a7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc7841a77 expref: 23 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773164.714996:0:13691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d26efc5400/0xabf1cc0bc7841a7e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc7841a77 expref: 23 pid: 6472 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773164.715005:0:13691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14378c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13691:1877761496031232:0@lo:104: 00000100:00100000:1.0:1790773164.715029:0:13691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790773164.720153:0:13691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d26efc5000/0xabf1cc0bc7841a70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc7841a69 expref: 23 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773164.720174:0:13691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d26efc5000/0xabf1cc0bc7841a70 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc7841a69 expref: 23 pid: 6472 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773164.720190:0:13691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f987800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13691:1877761496031360:0@lo:104: 00000100:00100000:1.0:1790773164.720282:0:13691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773164.724149:0:6461:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496031104 00000100:00100000:0.0:1790773164.724166:0:6461:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496031104 00000100:00100000:0.0:1790773164.724256:0:6461:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496031232 00000100:00100000:0.0:1790773164.724261:0:6461:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496031232 00000100:00100000:0.0:1790773164.724281:0:6461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790773164.724291:0:6461:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14378d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce0675b4-b0c5-48e7-b182-565e22fed04c+4:13691:x1877761496031104:12345-0@lo:104: 00010000:00010000:0.0:1790773164.724310:0:6461:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d27b12a800/0xabf1cc0bc7841a85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7841a8c expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773164.724409:0:6461:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790773164.724415:0:6461:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14378d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce0675b4-b0c5-48e7-b182-565e22fed04c+4:13691:x1877761496031104:12345-0@lo:104: Request processed in 126us (9555us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773164.724422:0:6461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790773164.724439:0:6461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790773164.724459:0:6461:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14378dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce0675b4-b0c5-48e7-b182-565e22fed04c+3:13691:x1877761496031232:12345-0@lo:104: 00010000:00010000:0.0:1790773164.724468:0:6461:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d27b12bc00/0xabf1cc0bc7841a77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7841a7e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773164.724505:0:6461:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790773164.724510:0:6461:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14378dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce0675b4-b0c5-48e7-b182-565e22fed04c+3:13691:x1877761496031232:12345-0@lo:104: Request processed in 52us (9480us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773164.724516:0:6461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:0.0:1790773164.724555:0:6466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790773164.724561:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d27b12a800/0xabf1cc0bc7841a85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7841a8c expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773164.724568:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12a800 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:0.0:1790773164.724728:0:6466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d27b12a800/0xabf1cc0bc7841a85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc7841a8c expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773164.724739:0:6466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d27b12a800/0xabf1cc0bc7841a85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc7841a8c expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790773164.724747:0:6466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d27b12a800/0xabf1cc0bc7841a85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc7841a8c expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790773164.724753:0:6466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790773164.724798:0:6466:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d27b12a800/0xabf1cc0bc7841a85 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841a8c expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773164.724804:0:6466:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790773164.724825:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d27b12a800/0xabf1cc0bc7841a85 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841a8c expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773164.724843:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d27b12a800/0xabf1cc0bc7841a85 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841a8c expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773164.724856:0:6466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790773164.724858:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d27b12bc00/0xabf1cc0bc7841a77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7841a7e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773164.724864:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12bc00 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:0.0:1790773164.724866:0:6466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d27b12bc00/0xabf1cc0bc7841a77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc7841a7e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773164.724873:0:6466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d27b12bc00/0xabf1cc0bc7841a77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc7841a7e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790773164.724878:0:6466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d27b12bc00/0xabf1cc0bc7841a77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc7841a7e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790773164.724883:0:6466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790773164.724896:0:6466:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d27b12bc00/0xabf1cc0bc7841a77 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841a7e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773164.724901:0:6466:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790773164.724906:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d27b12bc00/0xabf1cc0bc7841a77 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841a7e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773164.724912:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d27b12bc00/0xabf1cc0bc7841a77 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841a7e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773164.724920:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773164.724927:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773164.724928:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773164.724935:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773164.724949:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce0675b4-b0c5-48e7-b182-565e22fed04c:3606:1877761496031488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790773164.724997:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773164.725036:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790773164.725042:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce0675b4-b0c5-48e7-b182-565e22fed04c:3606:1877761496031616:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790773164.725063:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773164.725094:0:6465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496031488 00000100:00100000:0.0:1790773164.725099:0:6465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496031488 00010000:00010000:0.0:1790773164.725117:0:6465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d1434ac800/0xabf1cc0bc7841a8c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7841a85 expref: 24 pid: 6471 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773164.725139:0:6465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496031616 00000100:00100000:0.0:1790773164.725142:0:6465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496031616 00010000:00010000:0.0:1790773164.725153:0:6465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d26efc5400/0xabf1cc0bc7841a7e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7841a77 expref: 25 pid: 6472 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773164.725169:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790773164.725175:0:6465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+25:3606:x1877761496031488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790773164.725185:0:6465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773164.725190:0:6465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d1434ac800/0xabf1cc0bc7841a8c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7841a85 expref: 25 pid: 6471 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773164.725199:0:6465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d1434ac800/0xabf1cc0bc7841a8c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc7841a85 expref: 25 pid: 6471 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773164.725243:0:6465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790773164.725272:0:6465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+25:3606:x1877761496031488:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773164.725288:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790773164.725302:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790773164.725308:0:6465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3606:x1877761496031616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790773164.725316:0:6465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773164.725321:0:6465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d26efc5400/0xabf1cc0bc7841a7e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7841a77 expref: 24 pid: 6472 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773164.725329:0:6465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d26efc5400/0xabf1cc0bc7841a7e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc7841a77 expref: 24 pid: 6472 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773164.725338:0:6465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790773164.725360:0:6465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3606:x1877761496031616:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773164.725366:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790773164.725403:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce0675b4-b0c5-48e7-b182-565e22fed04c:3606:1877761496031616:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790773164.725411:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce0675b4-b0c5-48e7-b182-565e22fed04c:3606:1877761496031488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790773164.726239:0:6462:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496030976 00000100:00100000:3.0:1790773164.726248:0:6462:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496030976 00000100:00100000:2.0:1790773164.728152:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790773164.728166:0:6462:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14378d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+3:13691:x1877761496030976:12345-0@lo:104: 00010000:00010000:2.0:1790773164.728186:0:6462:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d26efc4600/0xabf1cc0bc7841a93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7841a9a expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773164.728301:0:6462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790773164.728309:0:6462:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14378d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce0675b4-b0c5-48e7-b182-565e22fed04c+3:13691:x1877761496030976:12345-0@lo:104: Request processed in 145us (13539us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773164.728316:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:0.0:1790773164.728747:0:6467:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790773164.728755:0:6467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d26efc4600/0xabf1cc0bc7841a93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7841a9a expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773164.728764:0:6467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc4600 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:0.0:1790773164.728769:0:6467:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d26efc4600/0xabf1cc0bc7841a93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc7841a9a expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773164.728778:0:6467:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d26efc4600/0xabf1cc0bc7841a93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc7841a9a expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790773164.728805:0:6467:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d26efc4600/0xabf1cc0bc7841a93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc7841a9a expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790773164.728811:0:6467:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790773164.728848:0:6467:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d26efc4600/0xabf1cc0bc7841a93 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841a9a expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773164.728853:0:6467:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790773164.728886:0:6467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d26efc4600/0xabf1cc0bc7841a93 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841a9a expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773164.728892:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d26efc4600/0xabf1cc0bc7841a93 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841a9a expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773164.728907:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773164.728909:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773164.728911:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773164.728919:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790773164.728937:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce0675b4-b0c5-48e7-b182-565e22fed04c:3605:1877761496031744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790773164.728996:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773164.729048:0:6463:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496031744 00000100:00100000:0.0:1790773164.729056:0:6463:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496031744 00010000:00010000:0.0:1790773164.729078:0:6463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d1434acc00/0xabf1cc0bc7841a9a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7841a93 expref: 24 pid: 6473 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773164.729104:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790773164.729111:0:6463:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3605:x1877761496031744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790773164.729122:0:6463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773164.729133:0:6463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d1434acc00/0xabf1cc0bc7841a9a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7841a93 expref: 24 pid: 6473 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773164.729143:0:6463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d1434acc00/0xabf1cc0bc7841a9a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc7841a93 expref: 24 pid: 6473 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773164.729159:0:6463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790773164.729191:0:6463:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3605:x1877761496031744:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773164.729198:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790773164.729256:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce0675b4-b0c5-48e7-b182-565e22fed04c:3605:1877761496031744:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790773164.729771:0:13691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d26efc4800/0xabf1cc0bc7841a62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb46 expref: 12 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773164.729790:0:13691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d26efc4800/0xabf1cc0bc7841a62 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb46 expref: 12 pid: 6473 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773164.729803:0:13691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f986680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13691:1877761496031872:192.168.202.19@tcp:104: 00010000:00010000:1.0:1790773164.729877:0:13691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d26efc4c00/0xabf1cc0bc7841a5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb3f expref: 12 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773164.729885:0:13691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d26efc4c00/0xabf1cc0bc7841a5b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb3f expref: 12 pid: 6473 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773164.729893:0:13691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f985180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13691:1877761496032000:192.168.202.19@tcp:104: 00000100:00100000:1.0:1790773164.729917:0:13691:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c343780 going to sleep for 11 seconds 00010000:00010000:1.0:1790773164.729945:0:13691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d1434acc00/0xabf1cc0bc7841a9a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc7841a93 expref: 23 pid: 6473 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773164.729955:0:13691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14378df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13691:1877761496030976:0@lo:104: 00010000:00010000:1.0:1790773164.729979:0:13691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d1434ac800/0xabf1cc0bc7841a8c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc7841a85 expref: 22 pid: 6471 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773164.729986:0:13691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14378ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13691:1877761496031104:0@lo:104: 00010000:00010000:1.0:1790773164.729997:0:13691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d26efc5400/0xabf1cc0bc7841a7e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc7841a77 expref: 21 pid: 6472 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773164.730004:0:13691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14378c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13691:1877761496031232:0@lo:104: 00000100:00100000:2.0:1790773164.730182:0:9484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496031360 00000100:00100000:2.0:1790773164.730188:0:9484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496031360 00000100:00100000:2.0:1790773164.730397:0:9484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790773164.730407:0:9484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f985500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+3:13691:x1877761496031360:12345-0@lo:104: 00010000:00010000:2.0:1790773164.730420:0:9484:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d1434ad800/0xabf1cc0bc7841a69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7841a70 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773164.730485:0:9484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790773164.730491:0:9484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f985500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+3:13691:x1877761496031360:12345-0@lo:104: Request processed in 86us (10210us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773164.730505:0:9484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790773164.730583:0:13691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f987800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13691:1877761496031360:0@lo:104: 00010000:00010000:3.0:1790773164.730663:0:6466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790773164.730671:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d1434ad800/0xabf1cc0bc7841a69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7841a70 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773164.730679:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ad800 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:3.0:1790773164.730684:0:6466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d1434ad800/0xabf1cc0bc7841a69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc7841a70 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773164.730692:0:6466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d1434ad800/0xabf1cc0bc7841a69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc7841a70 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790773164.730700:0:6466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d1434ad800/0xabf1cc0bc7841a69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc7841a70 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773164.730721:0:6466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790773164.730758:0:6466:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d1434ad800/0xabf1cc0bc7841a69 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841a70 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773164.730765:0:6466:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790773164.730783:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d1434ad800/0xabf1cc0bc7841a69 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841a70 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773164.730789:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d1434ad800/0xabf1cc0bc7841a69 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841a70 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773164.730804:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773164.730806:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773164.730808:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773164.730814:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790773164.730824:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce0675b4-b0c5-48e7-b182-565e22fed04c:3604:1877761496032128:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790773164.730865:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773164.730898:0:10300:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496032128 00000100:00100000:3.0:1790773164.730902:0:10300:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496032128 00010000:00010000:3.0:1790773164.730918:0:10300:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d26efc5000/0xabf1cc0bc7841a70 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7841a69 expref: 21 pid: 6472 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773164.730938:0:10300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790773164.730944:0:10300:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:3604:x1877761496032128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790773164.730952:0:10300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773164.730957:0:10300:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d26efc5000/0xabf1cc0bc7841a70 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7841a69 expref: 21 pid: 6472 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773164.730980:0:10300:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d26efc5000/0xabf1cc0bc7841a70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc7841a69 expref: 21 pid: 6472 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773164.730999:0:10300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d26efc5000/0xabf1cc0bc7841a70 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc7841a69 expref: 21 pid: 6472 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773164.731010:0:10300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790773164.731046:0:10300:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ce0675b4-b0c5-48e7-b182-565e22fed04c+20:3604:x1877761496032128:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773164.731054:0:10300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790773164.731073:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce0675b4-b0c5-48e7-b182-565e22fed04c:3604:1877761496032128:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790773164.736903:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773164.736961:0:6464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484416512 00000100:00100000:2.0:1790773164.736980:0:6464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484416512 00000100:00100000:1.0:1790773164.737006:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00010000:00010000:2.0:1790773164.737020:0:6464:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d26efc4800/0xabf1cc0bc7841a62 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb46 expref: 13 pid: 6473 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773164.737052:0:6464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484416640 00000100:00100000:2.0:1790773164.737056:0:6464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484416640 00010000:00010000:2.0:1790773164.737070:0:6464:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d26efc4c00/0xabf1cc0bc7841a5b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb3f expref: 14 pid: 6473 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773164.737074:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 50 00000100:00100000:1.0:1790773164.737090:0:6465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f984000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+14:2397:x1877761484416512:12345-192.168.202.19@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1790773164.737104:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 51 00000100:00100000:2.0:1790773164.737113:0:6464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f986300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+14:2397:x1877761484416640:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790773164.737124:0:6464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790773164.737129:0:6464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d26efc4c00/0xabf1cc0bc7841a5b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb3f expref: 14 pid: 6473 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773164.737140:0:6464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d26efc4c00/0xabf1cc0bc7841a5b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb3f expref: 14 pid: 6473 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773164.737150:0:6465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790773164.737159:0:6465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d26efc4800/0xabf1cc0bc7841a62 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb46 expref: 14 pid: 6473 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773164.737161:0:6464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790773164.737173:0:6465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d26efc4800/0xabf1cc0bc7841a62 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb46 expref: 14 pid: 6473 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773164.737188:0:6465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93d27b12a200/0xabf1cc0bc7841bce lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773164.737197:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d27b12a200/0xabf1cc0bc7841bce lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773164.737240:0:6464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f986300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+14:2397:x1877761484416640:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 127us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773164.737251:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 51 00010000:00010000:1.0:1790773164.737258:0:6465:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d27b12a200/0xabf1cc0bc7841bce lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773164.737266:0:6465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d27b12a200/0xabf1cc0bc7841bce lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773164.737273:0:6465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93d27b12a200/0xabf1cc0bc7841bce lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773164.737280:0:6465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93d27b12a200/0xabf1cc0bc7841bce lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773164.737286:0:6465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12a200 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:1.0:1790773164.737290:0:6465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93d27b12a200/0xabf1cc0bc7841bce lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773164.737297:0:6465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93d27b12a200/0xabf1cc0bc7841bce lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773164.737305:0:6465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93d27b12a200/0xabf1cc0bc7841bce lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773164.737314:0:6465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790773164.737336:0:6465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f984000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:2397:x1877761484416512:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 251us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773164.737342:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 50 00010000:00010000:0.0:1790773164.737451:0:13691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d26efc4800/0xabf1cc0bc7841a62 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb46 expref: 12 pid: 6473 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773164.737465:0:13691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f986680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13691:1877761496031872:192.168.202.19@tcp:104: 00010000:00010000:0.0:1790773164.737476:0:13691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d26efc4c00/0xabf1cc0bc7841a5b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb3f expref: 11 pid: 6473 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773164.737484:0:13691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f985180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13691:1877761496032000:192.168.202.19@tcp:104: 00010000:00010000:0.0:1790773164.737521:0:13691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93d27b12a200/0xabf1cc0bc7841bce lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773164.737529:0:13691:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93d27b12a200/0xabf1cc0bc7841bce lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773164.737535:0:13691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93d27b12a200/0xabf1cc0bc7841bce lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773164.737552:0:13691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d27b12a200/0xabf1cc0bc7841bce lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773164.883479:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773165.394257:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790773165.394293:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496032256:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790773165.394394:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773165.394465:0:11145:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496032256 00000100:00100000:3.0:1790773165.394475:0:11145:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496032256 00000100:00100000:3.0:1790773165.394556:0:11145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1790773165.394567:0:11145:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496032256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790773165.394614:0:11145:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790773165.395811:0:11145:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496032256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1237us (1410us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773165.395824:0:11145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:3.0:1790773165.395865:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790773165.395911:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f9ca680 x1877761496032256/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773181 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773165.395939:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496032256:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790773165.398577:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496032384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790773165.399883:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1790773165.400638:0:6457:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000100:00100000:0.0:1790773165.400933:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496032384 00000100:00100000:0.0:1790773165.400949:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496032384 00000100:00100000:0.0:1790773165.401875:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1790773165.401889:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f985180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496032384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790773165.401925:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790773165.402037:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f985180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496032384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 152us (2161us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773165.402044:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000001:00080000:2.0:1790773165.402111:0:6457:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:2.0:1790773165.402125:0:6457:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00080000:3.0:1790773165.403038:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790773165.403667:0:3590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030600/0xabf1cc0bc7841b26 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773165.403685:0:3590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030600/0xabf1cc0bc7841b26 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773165.403694:0:3590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030600/0xabf1cc0bc7841b26 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773165.403701:0:3590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d240030600 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773165.403707:0:3590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030600/0xabf1cc0bc7841b26 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773165.403715:0:3590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030600/0xabf1cc0bc7841b26 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773165.403739:0:3590:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xf79bc41e (ffff93d2432d4400) 00010000:00010000:0.0:1790773165.403743:0:3590:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773165.403759:0:3590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030600/0xabf1cc0bc7841b26 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773165.403767:0:3590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030600/0xabf1cc0bc7841b26 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773165.403791:0:3590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc7841b3b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773165.403798:0:3590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc7841b3b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773165.403804:0:3590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc7841b3b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773165.403809:0:3590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc4e00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773165.403812:0:3590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc7841b3b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773165.403819:0:3590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc7841b3b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773165.403827:0:3590:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff93d255bad200) 00010000:00010000:0.0:1790773165.403829:0:3590:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773165.403833:0:3590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc7841b3b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773165.403838:0:3590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc7841b3b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773165.403859:0:3590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4a00/0xabf1cc0bc7841ba4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773165.403864:0:3590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4a00/0xabf1cc0bc7841ba4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773165.403876:0:3590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4a00/0xabf1cc0bc7841ba4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773165.403882:0:3590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d2532e4a00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773165.403886:0:3590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4a00/0xabf1cc0bc7841ba4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773165.403892:0:3590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4a00/0xabf1cc0bc7841ba4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773165.403899:0:3590:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xf79bc41e (ffff93d2432d4400) 00010000:00010000:0.0:1790773165.403902:0:3590:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773165.403905:0:3590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4a00/0xabf1cc0bc7841ba4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773165.403910:0:3590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4a00/0xabf1cc0bc7841ba4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xf79bc41e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773165.403927:0:3590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc7841bc0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773165.403934:0:3590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc7841bc0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773165.403940:0:3590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc7841bc0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773165.403945:0:3590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc4200 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773165.403948:0:3590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc7841bc0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773165.403978:0:3590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc7841bc0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773165.403986:0:3590:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93d255bad400) 00010000:00010000:0.0:1790773165.403997:0:3590:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773165.404001:0:3590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc7841bc0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773165.404007:0:3590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc7841bc0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1790773165.404408:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d25074e680 x1877761496032384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773181 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773165.404443:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496032384:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790773165.404649:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790773165.404666:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f986680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496032512:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1790773165.404748:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773165.404936:0:8906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496032512 00000100:00100000:1.0:1790773165.404944:0:8906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496032512 00000100:00100000:1.0:1790773165.405086:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790773165.405098:0:8906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496032512:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1790773165.405134:0:8906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:1.0:1790773165.405178:0:8906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6abd07a7, atime: 0x6abd07a7, ctime: 0x6abd07a7, blocks: 0x0 00010000:00010000:1.0:1790773165.405186:0:8906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd0890f6/0xabf1cc0bc7841bd5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773165.405231:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=308s v=(0 0) 00010000:00010000:1.0:1790773165.405236:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790773165.405244:0:8906:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd0890f6/0xabf1cc0bc7841bd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773165.405264:0:8906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd0890f6/0xabf1cc0bc7841bd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773165.405275:0:8906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd0890f6/0xabf1cc0bc7841bd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773165.405282:0:8906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd0890f6/0xabf1cc0bc7841bd5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773165.405305:0:8906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790773165.405513:0:8906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3605:x1877761496032512:12345-0@lo:6:osp-syn-1-0.0 Request processed in 418us (765us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1790773165.405520:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1790773165.405550:0:6467:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790773165.405556:0:6467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd0890f6/0xabf1cc0bc7841bd5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773165.405565:0:6467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12b600 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:1.0:1790773165.405569:0:6467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd0890f6/0xabf1cc0bc7841bd5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773165.405580:0:6467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd0890f6/0xabf1cc0bc7841bd5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773165.405595:0:6467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd0890f6/0xabf1cc0bc7841bd5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773165.405600:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd0890f6/0xabf1cc0bc7841bd5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773165.405613:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773165.405614:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773165.405615:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790773165.405809:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1790773165.405997:0:3605:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93d27f986680/2, rc 0, transno 4294967301 00000100:00100000:1.0:1790773165.406004:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f986680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496032512:0@lo:6:osp-syn-1-0.0 00000020:00000080:2.0:1790773165.774581:0:13740:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd10afba90 20000000:00000080:2.0:1790773165.774620:0:13740:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93d27c149c00 uarg=0000000000000000 10000000:01000000:1.0:1790773165.775050:0:6475:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790773165.775058:0:6475:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d141fee800 from 7 10000000:01000000:1.0:1790773165.775063:0:6475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790773165.775139:0:6475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12b600/0xabf1cc0bc7841bdc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773165.775167:0:6475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d27b12b600/0xabf1cc0bc7841bdc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773165.775183:0:6475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d27b12b600/0xabf1cc0bc7841bdc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773165.775236:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f987800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761496032640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790773165.775339:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773165.775393:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c343a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790773165.775929:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496032640 00000100:00100000:3.0:1790773165.775941:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496032640 00000100:00100000:3.0:1790773165.776024:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1790773165.776036:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+20:6475:x1877761496032640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790773165.776056:0:6472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773165.776075:0:6472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d1434ac600/0xabf1cc0bc7841be3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7841bdc expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773165.776106:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d1434ac600/0xabf1cc0bc7841be3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7841bdc expref: 21 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773165.776118:0:6472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d1434ac600/0xabf1cc0bc7841be3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7841bdc expref: 21 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773165.776130:0:6472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d1434ac600, rc 0) 00000100:00100000:3.0:1790773165.776201:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:6475:x1877761496032640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773165.776228:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 20000000:01000000:2.0:1790773165.776437:0:13740:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1790773165.776448:0:13740:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1790773165.776454:0:13740:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000100:00100000:0.0:1790773165.776701:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f987800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761496032640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790773165.776723:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d27b12b600/0xabf1cc0bc7841bdc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841be3 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773165.776732:0:6475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d27b12b600/0xabf1cc0bc7841bdc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7841be3 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773165.776826:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761496032768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790773165.776868:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773165.776904:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d246b25a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790773165.777499:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496032768 00000100:00100000:2.0:1790773165.777510:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496032768 00000100:00100000:2.0:1790773165.777562:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1790773165.777573:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:6475:x1877761496032768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790773165.778017:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:6475:x1877761496032768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 444us (1147us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773165.778027:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1790773165.778983:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761496032768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790773165.779055:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f987800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761496032896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790773165.779140:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773165.779192:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c343240 going to sleep for 11 seconds 00000040:00080000:0.0:1790773165.779768:0:13741:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:3.0:1790773165.780051:0:13740:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:3.0:1790773165.780199:0:13740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:3.0:1790773165.780276:0:13740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:3.0:1790773165.780294:0:13740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:3.0:1790773165.780310:0:13740:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1790773165.780335:0:13740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93d1434ad800/0xabf1cc0bc7841bea lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773165.780355:0:13740:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d1434ac600/0xabf1cc0bc7841be3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7841bdc expref: 20 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773165.780365:0:13740:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93d1434ad800/0xabf1cc0bc7841bea lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773165.780432:0:13740:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d1434ac600/0xabf1cc0bc7841be3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc7841bdc expref: 20 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773165.780451:0:13740:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d1434ac600/0xabf1cc0bc7841be3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc7841bdc expref: 20 pid: 6472 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773165.780465:0:13740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9c8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13740:1877761496033024:0@lo:104: 00000100:00100000:3.0:1790773165.780528:0:13740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773165.780566:0:13740:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2496369c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790773165.781059:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496032896 00000100:00100000:2.0:1790773165.781071:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496032896 00000100:00100000:2.0:1790773165.781143:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1790773165.781155:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:6475:x1877761496032896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790773165.781334:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:6475:x1877761496032896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 181us (2194us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773165.781344:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1790773165.781505:0:6461:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496033024 00000100:00100000:0.0:1790773165.781511:0:6461:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496033024 00000100:00100000:0.0:1790773165.781554:0:6461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790773165.781562:0:6461:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce0675b4-b0c5-48e7-b182-565e22fed04c+3:13740:x1877761496033024:12345-0@lo:104: 00010000:00010000:0.0:1790773165.781578:0:6461:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d27b12b600/0xabf1cc0bc7841bdc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7841be3 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773165.781986:0:6461:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790773165.781994:0:6461:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce0675b4-b0c5-48e7-b182-565e22fed04c+3:13740:x1877761496033024:12345-0@lo:104: Request processed in 433us (1466us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773165.782001:0:6461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00010000:0.0:1790773165.782026:0:6466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790773165.782033:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d27b12b600/0xabf1cc0bc7841bdc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7841be3 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773165.782043:0:6466:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff93d27b12b600 is referenced, will be cancelled later 00010000:00010000:0.0:1790773165.782046:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d27b12b600/0xabf1cc0bc7841bdc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc7841be3 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773165.782053:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773165.782055:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773165.782056:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773165.782462:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f987800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761496032896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790773165.782553:0:13740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9c8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13740:1877761496033024:0@lo:104: 00010000:00010000:3.0:1790773165.783107:0:13740:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93d1434ad800/0xabf1cc0bc7841bea lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773165.783934:0:13742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9c8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:13742:1877761496033152:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790773165.785526:0:13742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773165.785605:0:13742:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d249636d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790773165.786046:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496033152 00000100:00100000:3.0:1790773165.786059:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496033152 00000100:00100000:3.0:1790773165.786193:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1790773165.786246:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:13742:x1877761496033152:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790773165.786467:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:13742:x1877761496033152:12345-0@lo:502:llog_process_th.0 Request processed in 262us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773165.786476:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1790773165.786608:0:13742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9c8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:13742:1877761496033152:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790773165.786664:0:13742:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790773165.786677:0:13742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773165.786680:0:13742:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790773165.786690:0:13742:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93d141fee800 00000020:00000080:0.0:1790773165.786694:0:13742:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790773165.786776:0:13742:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790773165.786779:0:13742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773165.786781:0:13742:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790773165.786784:0:13742:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790773165.786786:0:13742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773165.786794:0:13742:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1790773165.786798:0:13742:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93d141fee800 00000020:00000080:0.0:1790773165.786811:0:13742:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1790773165.786873:0:13742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:13742:1877761496033280:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790773165.786925:0:13742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773165.795053:0:13742:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d246b25840 going to sleep for 11 seconds 00000100:00100000:2.0:1790773165.797589:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496033280 00000100:00100000:2.0:1790773165.797616:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496033280 00000100:00100000:2.0:1790773165.799777:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1790773165.799875:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:13742:x1877761496033280:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790773165.800180:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:13742:x1877761496033280:12345-0@lo:502:llog_process_th.0 Request processed in 385us (13252us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773165.800190:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1790773165.801537:0:13742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:13742:1877761496033280:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790773165.801615:0:13742:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790773165.801626:0:13742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773165.801629:0:13742:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1790773165.801635:0:13742:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1790773165.802974:0:6475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1790773165.803022:0:6475:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790773165.803037:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12b600/0xabf1cc0bc7841bdc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11400400000000 nid: local remote: 0xabf1cc0bc7841be3 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773165.803061:0:6475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffff93d27b12b600/0xabf1cc0bc7841bdc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11400400000000 nid: local remote: 0xabf1cc0bc7841be3 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773165.803091:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:01000000:3.0:1790773165.803103:0:6475:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790773165.803106:0:6475:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d26ff80800 from 7 10000000:01000000:3.0:1790773165.803109:0:6475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790773165.803161:0:6475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d1434ac400/0xabf1cc0bc7841bf1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773165.803171:0:6475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d1434ac400/0xabf1cc0bc7841bf1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773165.803185:0:6475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d1434ac400/0xabf1cc0bc7841bf1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773165.803233:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761496033408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790773165.803330:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773165.803379:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d249636a80 going to sleep for 11 seconds 00010000:00010000:2.0:1790773165.803787:0:8409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790773165.803797:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d27b12b600/0xabf1cc0bc7841bdc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc7841be3 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773165.803908:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496033408 00000100:00100000:1.0:1790773165.803919:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496033408 00000100:00100000:1.0:1790773165.804001:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1790773165.804013:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c696050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:6475:x1877761496033408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790773165.804032:0:6471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773165.804049:0:6471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d27b12a600/0xabf1cc0bc7841bf8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7841bf1 expref: -99 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773165.804079:0:6471:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d1434ad800/0xabf1cc0bc7841bea lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773165.804091:0:6471:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93d27b12a600/0xabf1cc0bc7841bf8 lrc: 4/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7841bf1 expref: 22 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773165.804120:0:6471:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: MGS lock: ffff93d1434ad800/0xabf1cc0bc7841bea lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773165.804136:0:6471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d27b12a600/0xabf1cc0bc7841bf8 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7841bf1 expref: 22 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773165.804146:0:6471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12a600, rc 0) 00000100:00100000:1.0:1790773165.804231:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c696050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+22:6475:x1877761496033408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 220us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773165.804240:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00010000:00010000:2.0:1790773165.804334:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12b600 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:2.0:1790773165.804339:0:8409:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d27b12b600/0xabf1cc0bc7841bdc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc7841be3 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773165.804349:0:8409:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d27b12b600/0xabf1cc0bc7841bdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc7841be3 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790773165.804356:0:8409:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d27b12b600/0xabf1cc0bc7841bdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc7841be3 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790773165.804363:0:8409:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1790773165.804542:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761496033408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790773165.804560:0:6475:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGC192.168.202.119@tcp lock: ffff93d1434ac400/0xabf1cc0bc7841bf1 lrc: 4/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841bf8 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773165.804570:0:6475:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGC192.168.202.119@tcp lock: ffff93d1434ac400/0xabf1cc0bc7841bf1 lrc: 4/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7841bf8 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773165.804632:0:8409:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d27b12b600/0xabf1cc0bc7841bdc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841be3 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773165.804641:0:8409:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790773165.805574:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d27b12b600/0xabf1cc0bc7841bdc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841be3 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773165.805586:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d27b12b600/0xabf1cc0bc7841bdc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7841be3 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773165.805612:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773165.805615:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773165.805634:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773165.806498:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790773165.806535:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce0675b4-b0c5-48e7-b182-565e22fed04c:3604:1877761496033536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790773165.806640:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773165.807307:0:8410:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496033536 00000100:00100000:3.0:1790773165.807320:0:8410:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496033536 00010000:00010000:3.0:1790773165.807386:0:8410:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d1434ac600/0xabf1cc0bc7841be3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7841bdc expref: 22 pid: 6472 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773165.811265:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790773165.811292:0:8410:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512cb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ce0675b4-b0c5-48e7-b182-565e22fed04c+22:3604:x1877761496033536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790773165.811323:0:8410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773165.811333:0:8410:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d1434ac600/0xabf1cc0bc7841be3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7841bdc expref: 22 pid: 6472 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773165.811348:0:8410:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d1434ac600/0xabf1cc0bc7841be3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc7841bdc expref: 22 pid: 6472 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773165.811374:0:8410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d1434ac600/0xabf1cc0bc7841be3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc7841bdc expref: 22 pid: 6472 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773165.812550:0:8410:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93d1434ad800/0xabf1cc0bc7841bea lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773165.812574:0:8410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d1434ad800/0xabf1cc0bc7841bea lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773165.812607:0:8410:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d1434ad800/0xabf1cc0bc7841bea lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773165.812616:0:8410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d1434ad800/0xabf1cc0bc7841bea lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773165.812624:0:8410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93d1434ad800/0xabf1cc0bc7841bea lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773165.812632:0:8410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93d1434ad800/0xabf1cc0bc7841bea lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773165.813895:0:8410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ad800 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:3.0:1790773165.813902:0:8410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93d1434ad800/0xabf1cc0bc7841bea lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773165.813913:0:8410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93d1434ad800/0xabf1cc0bc7841bea lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000020 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773165.813961:0:8410:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93d27b12a600/0xabf1cc0bc7841bf8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 0@lo remote: 0xabf1cc0bc7841bf1 expref: 21 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773165.813972:0:8410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d27b12a600/0xabf1cc0bc7841bf8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 0@lo remote: 0xabf1cc0bc7841bf1 expref: 21 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773165.814028:0:8410:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: MGS lock: ffff93d27b12a600/0xabf1cc0bc7841bf8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7841bf1 expref: 21 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773165.814049:0:8410:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9c8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:MGS:8410:1877761496033664:0@lo:105: 00000100:00100000:3.0:1790773165.814149:0:8410:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773165.814242:0:8410:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d249636d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790773165.814521:0:9484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496033664 00000100:00100000:1.0:1790773165.814533:0:9484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496033664 00000100:00100000:1.0:1790773165.814605:0:9484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790773165.814619:0:9484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+3:8410:x1877761496033664:12345-0@lo:105: 00010000:00010000:1.0:1790773165.814633:0:9484:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: MGC192.168.202.119@tcp lock: ffff93d1434ac400/0xabf1cc0bc7841bf1 lrc: 5/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7841bf8 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773165.814656:0:9484:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: MGC192.168.202.119@tcp lock: ffff93d1434ac400/0xabf1cc0bc7841bf1 lrc: 5/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7841bf8 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773165.814667:0:9484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGC192.168.202.119@tcp lock: ffff93d1434ac400/0xabf1cc0bc7841bf1 lrc: 5/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11080000000000 nid: local remote: 0xabf1cc0bc7841bf8 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773165.814674:0:9484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d1434ac400/0xabf1cc0bc7841bf1 lrc: 6/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11080000000000 nid: local remote: 0xabf1cc0bc7841bf8 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773165.814682:0:9484:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: MGC192.168.202.119@tcp lock: ffff93d1434ac400/0xabf1cc0bc7841bf1 lrc: 6/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1080000000000 nid: local remote: 0xabf1cc0bc7841bf8 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773165.814713:0:9484:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff93d1434ac400) 00000100:00100000:1.0:1790773165.814773:0:9484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+3:8410:x1877761496033664:12345-0@lo:105: Request processed in 157us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773165.814782:0:9484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790773165.814850:0:8410:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9c8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:MGS:8410:1877761496033664:0@lo:105: 00010000:00010000:1.0:1790773165.814875:0:8410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93d1434ad800/0xabf1cc0bc7841bea lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773165.814887:0:8410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790773165.814922:0:8410:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512cb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:3604:x1877761496033536:12345-0@lo:103:ldlm_bl.0 Request processed in 3646us (8282us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773165.814931:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00010000:2.0:1790773165.815547:0:13740:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93d1434ad800/0xabf1cc0bc7841bea lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773165.815560:0:13740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93d1434ad800/0xabf1cc0bc7841bea lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773165.815568:0:13740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d1434ad800/0xabf1cc0bc7841bea lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773165.818365:0:6475:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGC192.168.202.119@tcp lock: ffff93d1434ac400/0xabf1cc0bc7841bf1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7841bf8 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773165.818458:0:6475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d1434ac400/0xabf1cc0bc7841bf1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7841bf8 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773165.819518:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761496033792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790773165.819626:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773165.819792:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d249636a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790773165.820621:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce0675b4-b0c5-48e7-b182-565e22fed04c:3604:1877761496033536:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790773165.827739:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496033792 00000100:00100000:1.0:1790773165.827763:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496033792 00000100:00100000:1.0:1790773165.827848:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1790773165.827860:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c696850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:6475:x1877761496033792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790773165.828114:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c696850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:6475:x1877761496033792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 255us (8487us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773165.828123:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1790773165.832727:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761496033792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790773165.832839:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761496033920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790773165.832968:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773165.833038:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d249636a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790773165.846993:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496033920 00000100:00100000:2.0:1790773165.847018:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496033920 00000100:00100000:2.0:1790773165.847094:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1790773165.847105:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c694c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:6475:x1877761496033920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790773165.847354:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c694c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:6475:x1877761496033920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 250us (14386us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773165.847364:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1790773165.857593:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761496033920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790773165.862597:0:13746:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:13746:1877761496034048:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790773165.862743:0:13746:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773165.862830:0:13746:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d246b25540 going to sleep for 11 seconds 00000100:00100000:3.0:1790773165.863132:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496034048 00000100:00100000:3.0:1790773165.863143:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496034048 00000100:00100000:3.0:1790773165.863239:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1790773165.863252:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c695450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:13746:x1877761496034048:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790773165.863432:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c695450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:13746:x1877761496034048:12345-0@lo:502:llog_process_th.0 Request processed in 182us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773165.863441:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1790773165.863516:0:13746:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:13746:1877761496034048:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790773165.863556:0:13746:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790773165.863570:0:13746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773165.863573:0:13746:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790773165.863581:0:13746:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93d26ff80800 00000020:00000080:3.0:1790773165.863583:0:13746:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790773165.863786:0:13746:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790773165.863791:0:13746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773165.863793:0:13746:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790773165.863796:0:13746:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790773165.863798:0:13746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773165.863810:0:13746:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1790773165.863814:0:13746:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93d26ff80800 00000020:00000080:3.0:1790773165.863824:0:13746:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790773165.863871:0:13746:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9ca300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:13746:1877761496034176:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790773165.863920:0:13746:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773165.863947:0:13746:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d249636d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790773165.864071:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496034176 00000100:00100000:0.0:1790773165.864077:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496034176 00000100:00100000:0.0:1790773165.864119:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1790773165.864128:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c697850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:13746:x1877761496034176:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790773165.864246:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c697850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:13746:x1877761496034176:12345-0@lo:502:llog_process_th.0 Request processed in 119us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773165.864254:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1790773165.865029:0:13746:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9ca300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:13746:1877761496034176:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790773165.865071:0:13746:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790773165.865081:0:13746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773165.865084:0:13746:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1790773165.865089:0:13746:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1790773165.871171:0:6475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1790773165.871240:0:6475:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790773165.871256:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d1434ac400/0xabf1cc0bc7841bf1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841bf8 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773165.871271:0:6475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d1434ac400/0xabf1cc0bc7841bf1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841bf8 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790773165.871285:0:6475:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790773165.871289:0:6475:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d26ed89000 from 7 10000000:01000000:0.0:1790773165.871292:0:6475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790773165.871346:0:6475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d25074ba00/0xabf1cc0bc7841bff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773165.871369:0:6475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d25074ba00/0xabf1cc0bc7841bff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773165.871385:0:6475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d25074ba00/0xabf1cc0bc7841bff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773165.871416:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761496034304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790773165.871518:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773165.871569:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d246b25b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790773165.871727:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496034304 00000100:00100000:0.0:1790773165.871736:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496034304 00000100:00100000:0.0:1790773165.871792:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1790773165.871879:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c696c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:6475:x1877761496034304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790773165.871898:0:6473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773165.871915:0:6473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d25074a200/0xabf1cc0bc7841c06 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7841bff expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773165.871947:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d25074a200/0xabf1cc0bc7841c06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7841bff expref: 22 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773165.871977:0:6473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d25074a200/0xabf1cc0bc7841c06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7841bff expref: 22 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773165.871987:0:6473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074a200, rc 0) 00000100:00100000:0.0:1790773165.872036:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c696c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+22:6475:x1877761496034304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 235us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773165.872044:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1790773165.872110:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761496034304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790773165.872127:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d25074ba00/0xabf1cc0bc7841bff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841c06 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773165.872136:0:6475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d25074ba00/0xabf1cc0bc7841bff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7841c06 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773165.872237:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761496034432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790773165.872269:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773165.872300:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d246b25b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790773165.873178:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496034432 00000100:00100000:3.0:1790773165.873189:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496034432 00000100:00100000:3.0:1790773165.875058:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1790773165.875077:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c694850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+22:6475:x1877761496034432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790773165.875317:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c694850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+22:6475:x1877761496034432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 245us (3046us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773165.875325:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1790773165.876230:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761496034432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790773165.876317:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761496034560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790773165.876394:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773165.876438:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2496369c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790773165.876533:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496034560 00000100:00100000:2.0:1790773165.876543:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496034560 00000100:00100000:2.0:1790773165.876595:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1790773165.876606:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c694050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+22:6475:x1877761496034560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790773165.876724:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c694050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+22:6475:x1877761496034560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 120us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773165.876733:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1790773165.877512:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761496034560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790773165.879089:0:13748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:13748:1877761496034688:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790773165.879186:0:13748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773165.879268:0:13748:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d246b25a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790773165.880315:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496034688 00000100:00100000:3.0:1790773165.880331:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496034688 00000100:00100000:3.0:1790773165.880418:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1790773165.880430:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c696450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+22:13748:x1877761496034688:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790773165.880632:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c696450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+22:13748:x1877761496034688:12345-0@lo:502:llog_process_th.0 Request processed in 203us (1446us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773165.880642:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1790773165.880726:0:13748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:13748:1877761496034688:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790773165.880776:0:13748:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790773165.880790:0:13748:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773165.880793:0:13748:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790773165.881291:0:13748:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93d26ed89000 00000020:00000080:3.0:1790773165.881295:0:13748:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790773165.881424:0:13748:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790773165.881430:0:13748:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773165.881432:0:13748:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790773165.881435:0:13748:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790773165.881438:0:13748:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773165.881440:0:13748:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1790773165.881444:0:13748:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93d26ed89000 00000020:00000080:3.0:1790773165.881446:0:13748:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000040:00080000:1.0:1790773165.883095:0:13749:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1790773165.885433:0:13748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9ca300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:13748:1877761496034816:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790773165.885552:0:13748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773165.885611:0:13748:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2496369c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790773165.885925:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496034816 00000100:00100000:0.0:1790773165.885936:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496034816 00000100:00100000:0.0:1790773165.886062:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1790773165.886075:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c695c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+22:13748:x1877761496034816:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790773165.886278:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c695c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+22:13748:x1877761496034816:12345-0@lo:502:llog_process_th.0 Request processed in 205us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773165.886286:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1790773165.887702:0:13748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9ca300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:13748:1877761496034816:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790773165.887762:0:13748:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790773165.887774:0:13748:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773165.887776:0:13748:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1790773165.887782:0:13748:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1790773165.887946:0:6475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1790773165.887984:0:6475:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790773165.888000:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d25074ba00/0xabf1cc0bc7841bff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841c06 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773165.888024:0:6475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d25074ba00/0xabf1cc0bc7841bff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841c06 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773165.888036:0:6475:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790773165.888039:0:6475:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d25268e800 from 7 10000000:01000000:3.0:1790773165.888042:0:6475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790773165.888085:0:6475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d1434ac600/0xabf1cc0bc7841c0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773165.888094:0:6475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d1434ac600/0xabf1cc0bc7841c0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773165.888105:0:6475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d1434ac600/0xabf1cc0bc7841c0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773165.888130:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761496034944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790773165.888199:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773165.888255:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496034944 00000100:00100000:3.0:1790773165.888259:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279eda600 going to sleep for 11 seconds 00000100:00100000:1.0:1790773165.888262:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496034944 00000100:00100000:1.0:1790773165.888310:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1790773165.888321:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c695050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+22:6475:x1877761496034944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790773165.888617:0:6472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773165.888635:0:6472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d27b12b800/0xabf1cc0bc7841c14 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7841c0d expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773165.888675:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d27b12b800/0xabf1cc0bc7841c14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7841c0d expref: 23 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773165.888689:0:6472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d27b12b800/0xabf1cc0bc7841c14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7841c0d expref: 23 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773165.888699:0:6472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12b800, rc 0) 00000100:00100000:1.0:1790773165.888743:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c695050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+23:6475:x1877761496034944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 424us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773165.888750:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1790773165.889105:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761496034944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790773165.889122:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d1434ac600/0xabf1cc0bc7841c0d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841c14 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773165.889133:0:6475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d1434ac600/0xabf1cc0bc7841c0d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7841c14 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773165.889236:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761496035072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790773165.889268:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773165.889302:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279eda600 going to sleep for 11 seconds 00000100:00100000:2.0:1790773165.889386:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496035072 00000100:00100000:2.0:1790773165.889397:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496035072 00000100:00100000:2.0:1790773165.889437:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1790773165.889445:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c697c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+23:6475:x1877761496035072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790773165.889571:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c697c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+23:6475:x1877761496035072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 128us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773165.889579:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1790773165.889645:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761496035072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790773165.889675:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761496035200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790773165.889717:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773165.889745:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279eda600 going to sleep for 11 seconds 00000100:00100000:2.0:1790773165.889908:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496035200 00000100:00100000:2.0:1790773165.889913:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496035200 00000100:00100000:2.0:1790773165.889941:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1790773165.889948:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c697050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+23:6475:x1877761496035200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790773165.890041:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c697050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+23:6475:x1877761496035200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773165.890048:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1790773165.890127:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761496035200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790773165.892253:0:13750:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9e4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:13750:1877761496035328:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790773165.892361:0:13750:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773165.892409:0:13750:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d143e37e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790773165.892493:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496035328 00000100:00100000:3.0:1790773165.892501:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496035328 00000100:00100000:3.0:1790773165.892566:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1790773165.892575:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c697450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+23:13750:x1877761496035328:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790773165.892705:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c697450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+23:13750:x1877761496035328:12345-0@lo:502:llog_process_th.0 Request processed in 131us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773165.892713:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1790773165.892990:0:13750:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9e4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:13750:1877761496035328:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790773165.893032:0:13750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790773165.893045:0:13750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773165.893048:0:13750:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790773165.893058:0:13750:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93d25268e800 00000020:00000080:2.0:1790773165.893061:0:13750:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790773165.893120:0:13750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790773165.893335:0:13750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773165.893337:0:13750:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790773165.893342:0:13750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790773165.893346:0:13750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773165.893354:0:13750:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1790773165.893359:0:13750:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93d25268e800 00000020:00000080:2.0:1790773165.893362:0:13750:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1790773165.893536:0:13750:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9e4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:13750:1877761496035456:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790773165.893588:0:13750:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773165.895587:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496035456 00000100:00100000:3.0:1790773165.895604:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496035456 00000100:00100000:3.0:1790773165.895702:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1790773165.895713:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c695850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+23:13750:x1877761496035456:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790773165.895914:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c695850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+23:13750:x1877761496035456:12345-0@lo:502:llog_process_th.0 Request processed in 202us (2324us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773165.895923:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1790773165.896036:0:13750:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d143e37e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790773165.896066:0:13750:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9e4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce0675b4-b0c5-48e7-b182-565e22fed04c:13750:1877761496035456:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790773165.896109:0:13750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790773165.896118:0:13750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773165.896121:0:13750:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1790773165.896126:0:13750:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1790773165.896480:0:6475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1790773165.896506:0:6475:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790773165.896518:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d1434ac600/0xabf1cc0bc7841c0d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841c14 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773165.896531:0:6475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d1434ac600/0xabf1cc0bc7841c0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841c14 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773165.904531:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790773165.919785:0:13753:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1790773166.318293:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773166.318666:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484416768 00000100:00100000:0.0:1790773166.318681:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484416768 00000100:00100000:0.0:1790773166.318776:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 357 00000100:00100000:0.0:1790773166.318789:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c694450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+11:6170:x1877761484416768:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790773166.318824:0:6471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773166.318868:0:6471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d25074ac00/0xabf1cc0bc7841c1b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bb93 expref: -99 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773166.319157:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d25074ac00/0xabf1cc0bc7841c1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb93 expref: 12 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773166.319177:0:6471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d25074ac00/0xabf1cc0bc7841c1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb93 expref: 12 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773166.319190:0:6471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074ac00, rc 0) 00000100:00100000:0.0:1790773166.319323:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c694450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+12:6170:x1877761484416768:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 Request processed in 536us (1117us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773166.319332:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 357 00000100:00100000:3.0:1790773166.323341:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773166.323566:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484416896 00000100:00100000:2.0:1790773166.323578:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484416896 00000100:00100000:2.0:1790773166.323638:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 358 00000100:00100000:2.0:1790773166.323658:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+12:6170:x1877761484416896:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790773166.323818:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+12:6170:x1877761484416896:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 Request processed in 162us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773166.323827:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 358 00000100:00100000:1.0:1790773166.329833:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773166.329902:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484417024 00000100:00100000:2.0:1790773166.329921:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484417024 00000100:00100000:2.0:1790773166.334300:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 359 00000100:00100000:2.0:1790773166.334323:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+12:6170:x1877761484417024:12345-192.168.202.19@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790773166.334484:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+12:6170:x1877761484417024:12345-192.168.202.19@tcp:503:ll_cfg_requeue.0 Request processed in 171us (4667us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773166.334493:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 359 00000100:00100000:1.0:1790773166.344532:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773166.347442:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484417152 00000100:00100000:3.0:1790773166.347462:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484417152 00000100:00100000:3.0:1790773166.347537:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 360 00000100:00100000:3.0:1790773166.347547:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+12:10752:x1877761484417152:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790773166.347966:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+12:10752:x1877761484417152:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 419us (3443us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773166.347974:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 360 00000100:00100000:1.0:1790773166.360119:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773166.360246:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484417280 00000100:00100000:3.0:1790773166.360258:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484417280 00000100:00100000:3.0:1790773166.360321:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 361 00000100:00100000:3.0:1790773166.360331:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+12:10752:x1877761484417280:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790773166.360498:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+12:10752:x1877761484417280:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 168us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773166.360507:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 361 00000100:00100000:1.0:1790773166.363578:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773166.363711:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484417408 00000100:00100000:3.0:1790773166.363721:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484417408 00000100:00100000:3.0:1790773166.363789:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 362 00000100:00100000:3.0:1790773166.363800:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+12:6170:x1877761484417408:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790773166.363818:0:6472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773166.363838:0:6472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d1434aca00/0xabf1cc0bc7841c22 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bb9a expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773166.363871:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d1434aca00/0xabf1cc0bc7841c22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb9a expref: 13 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773166.363901:0:6472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d1434aca00/0xabf1cc0bc7841c22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb9a expref: 13 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773166.363912:0:6472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d1434aca00, rc 0) 00000100:00100000:3.0:1790773166.363994:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:6170:x1877761484417408:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 Request processed in 195us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773166.364001:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 362 00000100:00100000:1.0:1790773166.376576:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773166.376687:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484417536 00000100:00100000:2.0:1790773166.376713:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484417536 00000100:00100000:2.0:1790773166.376775:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 363 00000100:00100000:2.0:1790773166.376786:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:6170:x1877761484417536:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790773166.376959:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:6170:x1877761484417536:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 Request processed in 165us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773166.376967:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 363 00000100:00100000:1.0:1790773166.389578:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773166.389847:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484417664 00000100:00100000:2.0:1790773166.389859:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484417664 00000100:00100000:2.0:1790773166.389922:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 364 00000100:00100000:2.0:1790773166.389932:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:6170:x1877761484417664:12345-192.168.202.19@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790773166.390096:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:6170:x1877761484417664:12345-192.168.202.19@tcp:503:ll_cfg_requeue.0 Request processed in 163us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773166.390109:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 364 00000100:00100000:1.0:1790773166.402666:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773166.403275:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484417792 00000100:00100000:3.0:1790773166.403290:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484417792 00000100:00100000:2.0:1790773166.403757:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 365 00000100:00100000:2.0:1790773166.403774:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:10755:x1877761484417792:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790773166.404620:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:10755:x1877761484417792:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 848us (1962us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773166.404630:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 365 00000100:00100000:3.0:1790773166.407859:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773166.408259:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484417920 00000100:00100000:2.0:1790773166.408272:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484417920 00000100:00100000:2.0:1790773166.408339:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 366 00000100:00100000:2.0:1790773166.408350:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:10755:x1877761484417920:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790773166.408552:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:10755:x1877761484417920:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 203us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773166.408572:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 366 00000040:00080000:1.0:1790773166.926532:0:13749:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790773166.927616:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790773166.931415:0:13753:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790773167.151658:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773167.151700:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773167.151730:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773167.151760:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773167.151790:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773167.151821:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484418048 00000100:00100000:1.0:1790773167.151832:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484418048 00000100:00100000:0.0:1790773167.151917:0:8394:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484418304 00000100:00100000:0.0:1790773167.151923:0:8394:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484418304 00000100:00100000:1.0:1790773167.151925:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484418560 00000100:00100000:1.0:1790773167.151930:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484418560 00000100:00100000:1.0:1790773167.151968:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484418176 00000100:00100000:1.0:1790773167.151971:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484418176 00000100:00100000:0.0:1790773167.151984:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 83 00000100:00100000:1.0:1790773167.151989:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484418432 00000100:00100000:1.0:1790773167.151993:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484418432 00000100:00100000:0.0:1790773167.152001:0:8394:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f984000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:110130ab-04fa-4d7c-984e-562032df4432+5:2397:x1877761484418304:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773167.152012:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 211 00000100:00100000:1.0:1790773167.152021:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f986300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+5:2397:x1877761484418048:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1790773167.152086:0:8394:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f984000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:110130ab-04fa-4d7c-984e-562032df4432+5:2397:x1877761484418304:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 90us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773167.152095:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 83 00000100:00100000:2.0:1790773167.152110:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 212 00000100:00100000:2.0:1790773167.152122:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f987800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2397:x1877761484418560:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1790773167.152139:0:6480:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1790773167.152148:0:6480:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1790773167.152194:0:8697:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1790773167.152240:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 213 00000100:00100000:3.0:1790773167.152248:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26beea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+5:2397:x1877761484418176:12345-192.168.202.19@tcp:400:kworker.0 00000100:00080000:0.0:1790773167.152581:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790773167.152588:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790773167.152590:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790773167.156740:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f986300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+5:2397:x1877761484418048:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 4706us (5079us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773167.156758:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 211 00000100:00100000:1.0:1790773167.156799:0:6479:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1790773167.156811:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 214 00000100:00100000:1.0:1790773167.156824:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26bee8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2397:x1877761484418432:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773167.156901:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26bee8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2397:x1877761484418432:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 81us (5110us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773167.156908:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 214 00000100:00100000:2.0:1790773167.163446:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f987800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2397:x1877761484418560:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 11313us (11701us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773167.163463:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 212 00000100:00100000:3.0:1790773167.168815:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26beea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+5:2397:x1877761484418176:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 16552us (17038us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773167.168833:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 213 00000100:00100000:1.0:1790773167.437511:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496035712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790773167.437575:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496035840:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790773167.437655:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773167.437733:0:6484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496035840 00000100:00100000:3.0:1790773167.437743:0:6484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496035840 00000100:00100000:3.0:1790773167.437793:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1790773167.437803:0:6484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496035840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790773167.437840:0:6484:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1790773167.437890:0:6484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496035840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773167.437950:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1790773167.437973:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773167.438021:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496035840:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790773167.438070:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26beead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496035584:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790773167.438103:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773167.438167:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496035712 00000100:00100000:3.0:1790773167.438171:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496035712 00000100:00100000:3.0:1790773167.438232:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496035584 00000100:00100000:3.0:1790773167.438235:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496035584 00000100:00100000:3.0:1790773167.438252:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1790773167.438259:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26bee9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3607:x1877761496035712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790773167.438282:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790773167.438755:0:11145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1790773167.438765:0:11145:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496035584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790773167.438778:0:11145:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790773167.438811:0:11145:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496035584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773167.438817:0:11145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1790773167.438848:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce0675b4-b0c5-48e7-b182-565e22fed04c:3605:1877761496035968:0@lo:400:kworker.0 00000100:00100000:2.0:1790773167.438883:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773167.438909:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496036224:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790773167.438955:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773167.439015:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26bee9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3607:x1877761496035712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 756us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773167.439021:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1790773167.439055:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496035712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790773167.439072:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790773167.439078:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3607:1877761496036096:0@lo:400:kworker.0 00000100:00100000:1.0:1790773167.439106:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773167.439141:0:7666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496036224 00000100:00100000:1.0:1790773167.439156:0:7666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496036224 00000100:00100000:1.0:1790773167.439347:0:7666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1790773167.439356:0:7666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26beea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496036224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790773167.439381:0:7666:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1790773167.439427:0:7666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26beea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496036224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773167.439429:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14378c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3606:1877761496036608:0@lo:400:kworker.0 00000100:00100000:1.0:1790773167.439441:0:7666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1790773167.439466:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496036096 00000100:00100000:0.0:1790773167.439471:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773167.439472:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496036096 00000100:00100000:1.0:1790773167.439500:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1790773167.439506:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26bee8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1877761496036096:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1790773167.439578:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790773167.439591:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3604:1877761496036352:0@lo:400:kworker.0 00000100:00100000:3.0:1790773167.439638:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14378ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496036736:0@lo:400:kworker.0 00000100:00100000:3.0:1790773167.439665:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773167.439698:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496036224:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790773167.439719:0:8392:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496036736 00000100:00100000:3.0:1790773167.439723:0:8392:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496036736 00000100:00100000:3.0:1790773167.439756:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1790773167.439763:0:8392:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496036736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773167.439803:0:8392:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496036736:12345-0@lo:400:kworker.0 Request processed in 39us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773167.439817:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1790773167.439835:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790773167.439856:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d14378ea00 x1877761496036736/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773167.439866:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14378ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496036736:0@lo:400:kworker.0 00000100:00100000:3.0:1790773167.440126:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496035968 00000100:00100000:3.0:1790773167.440131:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496035968 00000100:00100000:3.0:1790773167.440160:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1790773167.440167:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+23:3605:x1877761496035968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773167.440200:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26bee8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1877761496036096:12345-0@lo:400:kworker.0 Request processed in 692us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773167.440227:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1790773167.440232:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+23:3605:x1877761496035968:12345-0@lo:400:kworker.0 Request processed in 63us (1345us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773167.440240:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1790773167.440245:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496036608 00000100:00100000:1.0:1790773167.440250:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496036608 00000100:00100000:3.0:1790773167.440282:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3607:1877761496036096:0@lo:400:kworker.0 00000100:00100000:3.0:1790773167.440342:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773167.440364:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14378df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496036864:0@lo:400:kworker.0 00000100:00100000:3.0:1790773167.440387:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773167.440409:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1790773167.440411:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496036352 00000100:00100000:1.0:1790773167.440416:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496036352 00000100:00100000:3.0:1790773167.440419:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3604:1877761496036480:0@lo:400:kworker.0 00000100:00100000:1.0:1790773167.440439:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1790773167.440448:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773167.440451:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1877761496036608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773167.440471:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3604:1877761496036992:0@lo:400:kworker.0 00000100:00100000:1.0:1790773167.440490:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1877761496036608:12345-0@lo:400:kworker.0 Request processed in 43us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773167.440496:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1790773167.440509:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496036480 00000100:00100000:3.0:1790773167.440515:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773167.440524:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496036480 00000100:00100000:3.0:1790773167.440539:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496036992 00000100:00100000:3.0:1790773167.440544:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496036992 00000100:00100000:3.0:1790773167.440569:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1790773167.440575:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3604:x1877761496036352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773167.440621:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3604:x1877761496036352:12345-0@lo:400:kworker.0 Request processed in 46us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773167.440628:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1790773167.440641:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1790773167.440647:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14378ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3604:x1877761496036480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773167.440672:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14378ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3604:x1877761496036480:12345-0@lo:400:kworker.0 Request processed in 26us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773167.440678:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1790773167.440688:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1790773167.440694:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3604:x1877761496036992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773167.440722:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3604:x1877761496036992:12345-0@lo:400:kworker.0 Request processed in 29us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773167.440728:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1790773167.440757:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3604:1877761496036480:0@lo:400:kworker.0 00000100:00100000:3.0:1790773167.440766:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3604:1877761496036992:0@lo:400:kworker.0 00000100:00100000:3.0:1790773167.440774:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3604:1877761496036352:0@lo:400:kworker.0 00000100:00100000:3.0:1790773167.440814:0:8393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496036864 00000100:00100000:3.0:1790773167.440817:0:8393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496036864 00000100:00100000:3.0:1790773167.440842:0:8393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1790773167.440849:0:8393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496036864:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1790773167.440898:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790773167.440904:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790773167.440907:0:8393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496036864:12345-0@lo:400:kworker.0 Request processed in 43us (504us total) trans 0 rc 0/0 00000100:00080000:1.0:1790773167.440907:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790773167.440917:0:8393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:3.0:1790773167.440960:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d14378df80 x1877761496036864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773167.440978:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14378df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496036864:0@lo:400:kworker.0 00010000:00080000:0.0:1790773167.441280:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d14378c700 x1877761496036608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773167.441394:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce0675b4-b0c5-48e7-b182-565e22fed04c:3605:1877761496035968:0@lo:400:kworker.0 00000100:00100000:0.0:1790773167.441435:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14378c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3606:1877761496036608:0@lo:400:kworker.0 00000100:00100000:0.0:1790773167.441445:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3606:1877761496037120:0@lo:400:kworker.0 00000100:00100000:0.0:1790773167.441533:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773167.441577:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26beead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496035584:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790773167.441646:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496037120 00000100:00100000:3.0:1790773167.441650:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496037120 00000100:00100000:3.0:1790773167.441699:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1790773167.441705:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f974380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3606:x1877761496037120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773167.441751:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f974380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3606:x1877761496037120:12345-0@lo:400:kworker.0 Request processed in 46us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773167.441757:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00080000:1.0:1790773167.441843:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1790773167.442014:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143ce3b80 x1877761496037120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773167.442025:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3606:1877761496037120:0@lo:400:kworker.0 10000000:01000000:3.0:1790773167.693391:0:6475:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790773167.693399:0:6475:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d141fee800 from 13 10000000:01000000:3.0:1790773167.693406:0:6475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790773167.693597:0:6475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d1434adc00/0xabf1cc0bc7841c29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773167.693610:0:6475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d1434adc00/0xabf1cc0bc7841c29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773167.693623:0:6475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d1434adc00/0xabf1cc0bc7841c29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773167.693649:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14378c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761496037248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790773167.693794:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773167.693854:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279eda3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790773167.695611:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496037248 00000100:00100000:0.0:1790773167.695625:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496037248 00000100:00100000:0.0:1790773167.695759:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1790773167.695770:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+23:6475:x1877761496037248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790773167.695788:0:6472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773167.695805:0:6472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d25074a000/0xabf1cc0bc7841c30 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7841c29 expref: -99 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773167.695834:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d25074a000/0xabf1cc0bc7841c30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7841c29 expref: 24 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773167.695845:0:6472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d25074a000/0xabf1cc0bc7841c30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7841c29 expref: 24 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773167.695854:0:6472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074a000, rc 0) 00000100:00100000:0.0:1790773167.696387:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:6475:x1877761496037248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 615us (2589us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773167.696395:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1790773167.696632:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14378c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761496037248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790773167.696718:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d1434adc00/0xabf1cc0bc7841c29 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841c30 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773167.696730:0:6475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d1434adc00/0xabf1cc0bc7841c29 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7841c30 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773167.696826:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26bee9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761496037376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790773167.696868:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773167.697002:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27b29cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1790773167.699522:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496037376 00000100:00100000:2.0:1790773167.699603:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496037376 00000100:00100000:2.0:1790773167.699787:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1790773167.699797:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:6475:x1877761496037376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790773167.700123:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:6475:x1877761496037376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 326us (3253us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773167.700150:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1790773167.700782:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26bee9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761496037376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790773167.700839:0:6475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26bee9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761496037504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790773167.700902:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773167.700952:0:6475:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27b29cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1790773167.701038:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496037504 00000100:00100000:0.0:1790773167.701044:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496037504 00000100:00100000:0.0:1790773167.701081:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1790773167.701094:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:6475:x1877761496037504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790773167.701192:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:6475:x1877761496037504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773167.701199:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1790773167.701649:0:6475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26bee9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce0675b4-b0c5-48e7-b182-565e22fed04c:6475:1877761496037504:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790773167.703269:0:13769:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1790773167.703687:0:6475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1790773167.703727:0:6475:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790773167.703738:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d1434adc00/0xabf1cc0bc7841c29 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841c30 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773167.703751:0:6475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d1434adc00/0xabf1cc0bc7841c29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841c30 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773167.952874:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773168.973793:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773169.997370:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773170.509455:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790773170.509479:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496037760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790773170.509550:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773170.509638:0:11145:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496037760 00000100:00100000:0.0:1790773170.509646:0:11145:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496037760 00000100:00100000:0.0:1790773170.509699:0:11145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1790773170.509710:0:11145:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f975f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496037760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790773170.509739:0:11145:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790773170.509782:0:11145:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f975f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496037760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773170.509789:0:11145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:0.0:1790773170.509810:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790773170.509836:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f976a00 x1877761496037760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773186 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773170.509853:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496037760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790773170.510127:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14378df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496037632:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790773170.510187:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773170.514430:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496037632 00000100:00100000:3.0:1790773170.514448:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496037632 00000100:00100000:3.0:1790773170.514548:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1790773170.514558:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26bee9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496037632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790773170.514711:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790773170.514815:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26bee9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496037632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 258us (4626us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773170.514823:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:3.0:1790773170.514895:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d14378df80 x1877761496037632/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773186 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773170.514930:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14378df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496037632:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1790773170.515047:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790773171.022945:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1790773171.027654:0:9475:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00010000:00010000:0.0:1790773172.045891:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773172.272187:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773172.272308:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773172.272342:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773172.272373:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773172.272397:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773172.272481:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773172.273974:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484418688 00000100:00100000:3.0:1790773172.274998:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484418688 00000100:00100000:3.0:1790773172.275083:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 371 00000100:00100000:3.0:1790773172.275095:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:2399:x1877761484418688:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1790773172.275182:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:2399:x1877761484418688:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 90us (3006us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773172.275190:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 371 00000100:00100000:3.0:1790773172.275380:0:8907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484419072 00000100:00100000:3.0:1790773172.275384:0:8907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484419072 00000100:00100000:3.0:1790773172.275421:0:8907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 86 00000100:00100000:3.0:1790773172.275427:0:8907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26bee9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:110130ab-04fa-4d7c-984e-562032df4432+5:2400:x1877761484419072:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1790773172.275461:0:8907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26bee9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:110130ab-04fa-4d7c-984e-562032df4432+5:2400:x1877761484419072:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 34us (3063us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773172.275468:0:8907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 86 00000100:00080000:3.0:1790773172.275484:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790773172.285394:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484418944 00000100:00100000:2.0:1790773172.285412:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484418944 00000100:00100000:2.0:1790773172.285491:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484418816 00000100:00100000:2.0:1790773172.285495:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484418816 00000100:00100000:2.0:1790773172.285508:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484419200 00000100:00100000:2.0:1790773172.285511:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484419200 00000100:00100000:2.0:1790773172.285524:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484419328 00000100:00100000:2.0:1790773172.285527:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484419328 00000100:00100000:2.0:1790773172.285546:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 221 00000100:00100000:2.0:1790773172.285556:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26beeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+5:2399:x1877761484418944:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1790773172.285650:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26beeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+5:2399:x1877761484418944:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 95us (13342us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773172.285659:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 221 00000100:00100000:2.0:1790773172.285678:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 222 00000100:00100000:2.0:1790773172.285684:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26bee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+5:2400:x1877761484418816:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1790773172.285711:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26bee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+5:2400:x1877761484418816:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 27us (13368us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773172.285717:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 222 00000100:00100000:2.0:1790773172.285729:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 223 00000100:00100000:2.0:1790773172.285736:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26bee8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2399:x1877761484419200:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1790773172.285773:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26bee8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2399:x1877761484419200:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 37us (13399us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773172.285779:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 223 00000100:00100000:2.0:1790773172.285805:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 224 00000100:00100000:2.0:1790773172.285811:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26beead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2400:x1877761484419328:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1790773172.285836:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26beead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2400:x1877761484419328:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 26us (13356us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773172.285841:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 224 00000100:00080000:2.0:1790773172.285869:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790773172.285873:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790773172.557419:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790773172.557443:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496037888:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790773172.557516:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773172.557615:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496037888 00000100:00100000:0.0:1790773172.557625:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496037888 00000100:00100000:0.0:1790773172.557695:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1790773172.557706:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496037888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790773172.557754:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790773172.557802:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496037888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773172.557810:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1790773172.557829:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496038016:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1790773172.557844:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790773172.557953:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14378df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496038144:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790773172.557997:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496037888:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790773172.558137:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3605:1877761496038400:0@lo:400:kworker.0 00000100:00100000:0.0:1790773172.558249:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce0675b4-b0c5-48e7-b182-565e22fed04c:3604:1877761496038272:0@lo:400:kworker.0 00000100:00100000:3.0:1790773172.563797:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773172.563913:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496038656:0@lo:400:kworker.0 00000100:00100000:3.0:1790773172.563956:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773172.563975:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143caf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496039168:0@lo:400:kworker.0 00000100:00100000:3.0:1790773172.563999:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773172.564000:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773172.564016:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496039680:0@lo:400:kworker.0 00000100:00100000:2.0:1790773172.564030:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496038528:0@lo:400:kworker.0 00000100:00100000:3.0:1790773172.564039:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773172.564050:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773172.564070:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3606:1877761496039040:0@lo:400:kworker.0 00000100:00100000:3.0:1790773172.564080:0:6484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496038144 00000100:00100000:3.0:1790773172.564087:0:6484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496038144 00000100:00100000:2.0:1790773172.564092:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773172.564108:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3606:1877761496039552:0@lo:400:kworker.0 00000100:00100000:2.0:1790773172.564126:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773172.564128:0:6484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496038656 00000100:00100000:3.0:1790773172.564131:0:6484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496038656 00000100:00100000:3.0:1790773172.564143:0:6484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496038528 00000100:00100000:3.0:1790773172.564145:0:6484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496038528 00000100:00100000:2.0:1790773172.564156:0:7666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1790773172.564162:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1790773172.564165:0:7666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14378c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3607:x1877761496038144:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790773172.564167:0:6484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496038656:12345-0@lo:400:kworker.0 00000004:00000024:2.0:1790773172.564216:0:7666:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1790773172.564247:0:6484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496038656:12345-0@lo:400:kworker.0 Request processed in 78us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773172.564248:0:7666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14378c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3607:x1877761496038144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773172.564254:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1790773172.567141:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773172.567141:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773172.567198:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3605:1877761496038912:0@lo:400:kworker.0 00000100:00100000:0.0:1790773172.567227:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3604:1877761496038784:0@lo:400:kworker.0 00000100:00100000:2.0:1790773172.567243:0:7666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1790773172.567260:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773172.567287:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496038272 00000100:00100000:2.0:1790773172.567294:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496038272 00000100:00100000:3.0:1790773172.567308:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1790773172.567320:0:6484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496038528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773172.567333:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1790773172.567338:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3604:x1877761496038272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773172.567542:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496039040 00000100:00100000:0.0:1790773172.567547:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496039040 00000100:00100000:0.0:1790773172.567586:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496039552 00000100:00100000:0.0:1790773172.567589:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496039552 00000100:00100000:0.0:1790773172.567600:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496038400 00000100:00100000:0.0:1790773172.567602:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496038400 00000100:00100000:0.0:1790773172.567611:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496038912 00000100:00100000:0.0:1790773172.567613:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496038912 00000100:00100000:0.0:1790773172.567627:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1790773172.567632:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1877761496039040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773172.567972:0:6484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496038528:12345-0@lo:400:kworker.0 Request processed in 652us (3917us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773172.567980:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1790773172.568010:0:8906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496039168 00000100:00100000:3.0:1790773172.568015:0:8906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496039168 00000100:00100000:3.0:1790773172.568047:0:8906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496039680 00000100:00100000:3.0:1790773172.568050:0:8906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496039680 00000100:00100000:3.0:1790773172.568075:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1790773172.568081:0:8906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496039168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773172.568124:0:8906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496039168:12345-0@lo:400:kworker.0 Request processed in 43us (4125us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773172.568131:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1790773172.568141:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1790773172.568147:0:8906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d280b78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496039680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773172.568175:0:8906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d280b78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496039680:12345-0@lo:400:kworker.0 Request processed in 29us (4135us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773172.568181:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1790773172.568270:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3604:x1877761496038272:12345-0@lo:400:kworker.0 Request processed in 930us (1138us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773172.568277:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1790773172.568307:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1790773172.568314:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3606:x1877761496039552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773172.568340:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3606:x1877761496039552:12345-0@lo:400:kworker.0 Request processed in 28us (4214us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773172.568346:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1790773172.568359:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1790773172.568364:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3605:x1877761496038400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773172.568392:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3605:x1877761496038400:12345-0@lo:400:kworker.0 Request processed in 28us (1263us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773172.568396:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1790773172.568399:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1790773172.568402:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3605:x1877761496038912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773172.568433:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3605:x1877761496038912:12345-0@lo:400:kworker.0 Request processed in 31us (1172us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773172.568439:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1790773172.568482:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496038528:0@lo:400:kworker.0 00010000:00080000:3.0:1790773172.568496:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143cadc00 x1877761496039552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773172.568507:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3606:1877761496039552:0@lo:400:kworker.0 00000100:00100000:2.0:1790773172.568523:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496038656:0@lo:400:kworker.0 00010000:00080000:2.0:1790773172.568534:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143caf480 x1877761496039168/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773172.568543:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143caf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496039168:0@lo:400:kworker.0 00000100:00100000:2.0:1790773172.568553:0:3607:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000100:00080000:3.0:1790773172.568554:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790773172.568558:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1790773172.568559:0:3607:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93d27f986680, transno 4294967301 00000100:00080000:3.0:1790773172.568560:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790773172.568562:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790773172.568569:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496039680:0@lo:400:kworker.0 00000100:00100000:2.0:1790773172.568587:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14378df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496038144:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790773172.568623:0:8397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496038016 00000100:00100000:2.0:1790773172.568640:0:8397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496038016 00000100:00100000:2.0:1790773172.568674:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1790773172.568680:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496038016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790773172.568693:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790773172.568731:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496038016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (4730us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773172.568738:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1790773172.570823:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773172.570904:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496039296:0@lo:400:kworker.0 00000100:00100000:3.0:1790773172.570967:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773172.570987:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496039808:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790773172.571026:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773172.571071:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce0675b4-b0c5-48e7-b182-565e22fed04c:3604:1877761496038272:0@lo:400:kworker.0 00000100:00100000:3.0:1790773172.571110:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496038784 00000100:00100000:3.0:1790773172.571115:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496038784 00000100:00100000:3.0:1790773172.571160:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1790773172.571167:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3604:x1877761496038784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773172.571229:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3604:x1877761496038784:12345-0@lo:400:kworker.0 Request processed in 61us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773172.571236:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1790773172.571257:0:6484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496039808 00000100:00100000:3.0:1790773172.571260:0:6484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496039808 00000100:00100000:3.0:1790773172.571281:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1790773172.571287:0:6484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496039808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790773172.571310:0:6484:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1790773172.571340:0:6484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496039808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 54us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773172.571345:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1790773172.571362:0:8392:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496039296 00000100:00100000:3.0:1790773172.571365:0:8392:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496039296 00000100:00100000:3.0:1790773172.571393:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1790773172.571399:0:8392:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496039296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773172.571427:0:8392:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496039296:12345-0@lo:400:kworker.0 Request processed in 28us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773172.571432:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:3.0:1790773172.571447:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790773172.571481:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496038016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790773172.571518:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3604:1877761496038784:0@lo:400:kworker.0 00010000:00080000:3.0:1790773172.571532:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143cae680 x1877761496039296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773172.571541:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496039296:0@lo:400:kworker.0 00000100:00100000:3.0:1790773172.571551:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496039808:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790773172.577112:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3605:1877761496038912:0@lo:400:kworker.0 00000100:00100000:1.0:1790773172.577128:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3605:1877761496039424:0@lo:400:kworker.0 00000100:00100000:1.0:1790773172.577186:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773172.577254:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3605:1877761496038400:0@lo:400:kworker.0 00000100:00100000:3.0:1790773172.577718:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496039424 00000100:00100000:3.0:1790773172.577726:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496039424 00000100:00100000:3.0:1790773172.577854:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1790773172.577863:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3605:x1877761496039424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773172.577930:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3605:x1877761496039424:12345-0@lo:400:kworker.0 Request processed in 69us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773172.577938:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00080000:1.0:1790773172.578042:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790773172.578065:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3605:1877761496039424:0@lo:400:kworker.0 00000100:00100000:0.0:1790773172.578775:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1877761496039040:12345-0@lo:400:kworker.0 Request processed in 11139us (14678us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773172.578786:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00010000:00080000:3.0:1790773172.578854:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143cac700 x1877761496039040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773172.578942:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3606:1877761496039040:0@lo:400:kworker.0 00010000:00010000:1.0:1790773173.072680:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773174.094700:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773175.117768:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773175.630918:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496039936:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790773175.630994:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773175.631171:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496040064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790773175.631222:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773175.632422:0:8397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496039936 00000100:00100000:2.0:1790773175.632434:0:8397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496039936 00000100:00080000:1.0:1790773175.632511:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790773175.634749:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496040064 00000100:00100000:3.0:1790773175.634763:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496040064 00000100:00080000:1.0:1790773175.634869:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790773175.639267:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1790773175.639294:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496039936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790773175.639335:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790773175.639432:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496039936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 152us (8439us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773175.639440:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00080000:1.0:1790773175.639538:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27c3a8380 x1877761496039936/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773191 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773175.639559:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496039936:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790773175.641787:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1790773175.641809:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f977b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496040064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790773175.641836:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790773175.642946:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f977b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496040064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1142us (11716us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773175.642958:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:1.0:1790773175.646524:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f9e6680 x1877761496040064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773191 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773175.646556:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496040064:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1790773176.142234:0:13749:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1790773176.143388:0:13753:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790773176.143535:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773177.166952:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773177.389708:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773177.389753:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773177.389787:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773177.389818:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484419712 00000100:00100000:2.0:1790773177.389829:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484419712 00000100:00100000:3.0:1790773177.389851:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773177.389884:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773177.389903:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484419968 00000100:00100000:2.0:1790773177.389909:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484419968 00000100:00100000:3.0:1790773177.389919:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773177.389967:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484419456 00000100:00100000:0.0:1790773177.389972:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484419456 00000100:00100000:0.0:1790773177.390056:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 373 00000100:00100000:0.0:1790773177.390086:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c6a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:2398:x1877761484419456:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1790773177.390165:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c6a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:2398:x1877761484419456:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 101us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773177.390172:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 373 00000100:00100000:2.0:1790773177.390485:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484419584 00000100:00100000:2.0:1790773177.390491:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484419584 00000100:00100000:2.0:1790773177.390511:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484420096 00000100:00100000:2.0:1790773177.390514:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484420096 00000100:00100000:2.0:1790773177.390528:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 231 00000100:00100000:2.0:1790773177.390535:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+5:2398:x1877761484419712:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1790773177.390572:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+5:2398:x1877761484419712:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 37us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773177.390586:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 231 00000100:00100000:2.0:1790773177.390601:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 232 00000100:00100000:2.0:1790773177.390608:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2398:x1877761484419968:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1790773177.390633:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2398:x1877761484419968:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 26us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773177.390639:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 232 00000100:00100000:2.0:1790773177.390651:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 233 00000100:00100000:2.0:1790773177.390657:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+5:2398:x1877761484419584:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1790773177.390680:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+5:2398:x1877761484419584:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 23us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773177.390686:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 233 00000100:00100000:2.0:1790773177.390696:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 234 00000100:00100000:2.0:1790773177.390702:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2398:x1877761484420096:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1790773177.390724:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2398:x1877761484420096:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 22us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773177.390731:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 234 00000100:00100000:2.0:1790773177.390926:0:8394:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484419840 00000100:00100000:2.0:1790773177.390930:0:8394:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484419840 00000100:00100000:2.0:1790773177.390958:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 90 00000100:00100000:2.0:1790773177.390964:0:8394:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:110130ab-04fa-4d7c-984e-562032df4432+5:2398:x1877761484419840:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1790773177.390993:0:8394:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:110130ab-04fa-4d7c-984e-562032df4432+5:2398:x1877761484419840:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 30us (1109us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773177.390999:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 90 00000100:00080000:2.0:1790773177.391059:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790773177.391064:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790773177.391066:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790773177.679318:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496040192:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790773177.679379:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773177.679441:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790773177.679448:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496040448:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790773177.679473:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773177.679512:0:7666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496040192 00000100:00100000:2.0:1790773177.679521:0:7666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496040192 00000100:00100000:2.0:1790773177.679618:0:7666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496040448 00000100:00100000:2.0:1790773177.679622:0:7666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496040448 00000100:00100000:0.0:1790773177.679714:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1790773177.679724:0:6484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f976d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496040192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790773177.679869:0:6484:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1790773177.679920:0:6484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f976d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496040192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 197us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773177.679926:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1790773177.679945:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1790773177.679951:0:6484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496040448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790773177.679967:0:6484:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1790773177.679980:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496040320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790773177.680009:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773177.680010:0:6484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496040448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773177.680016:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1790773177.680033:0:11145:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496040320 00000100:00100000:0.0:1790773177.680037:0:11145:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496040320 00000100:00100000:1.0:1790773177.680063:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496040576:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790773177.680071:0:11145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1790773177.680078:0:11145:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496040320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790773177.680096:0:11145:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790773177.680097:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773177.680123:0:8397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496040576 00000100:00100000:1.0:1790773177.680127:0:8397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496040576 00000100:00100000:0.0:1790773177.680137:0:11145:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496040320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773177.680144:0:11145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1790773177.680147:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1790773177.680152:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496040576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790773177.680161:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790773177.680184:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496040448:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790773177.680198:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496040192:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790773177.680200:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496040576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773177.680222:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1790773177.680250:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496040320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790773177.680262:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce0675b4-b0c5-48e7-b182-565e22fed04c:3607:1877761496040704:0@lo:400:kworker.0 00000100:00100000:1.0:1790773177.680296:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773177.680313:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3604:1877761496040832:0@lo:400:kworker.0 00000100:00100000:1.0:1790773177.680319:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3607:1877761496041216:0@lo:400:kworker.0 00000100:00100000:1.0:1790773177.680337:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773177.680347:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3605:1877761496040960:0@lo:400:kworker.0 00000100:00100000:1.0:1790773177.680354:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1434bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3607:1877761496041728:0@lo:400:kworker.0 00000100:00100000:0.0:1790773177.680368:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773177.680375:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496040704 00000100:00100000:1.0:1790773177.680379:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496040704 00000100:00100000:0.0:1790773177.680387:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496041472:0@lo:400:kworker.0 00000100:00100000:1.0:1790773177.680402:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1790773177.680408:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d252ea1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3607:x1877761496040704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773177.680408:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773177.680435:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3606:1877761496041088:0@lo:400:kworker.0 00000100:00100000:1.0:1790773177.680436:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d252ea1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3607:x1877761496040704:12345-0@lo:400:kworker.0 Request processed in 29us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773177.680442:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1790773177.680455:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773177.680470:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773177.680472:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1434bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3606:1877761496041600:0@lo:400:kworker.0 00000100:00100000:1.0:1790773177.680488:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce0675b4-b0c5-48e7-b182-565e22fed04c:3607:1877761496040704:0@lo:400:kworker.0 00000100:00100000:0.0:1790773177.680491:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773177.680505:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773177.680513:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496040576:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790773177.680516:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496041344:0@lo:400:kworker.0 00000100:00100000:0.0:1790773177.680531:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496041216 00000100:00100000:1.0:1790773177.680534:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773177.680534:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496041216 00000100:00100000:0.0:1790773177.680555:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496040960 00000100:00100000:1.0:1790773177.680556:0:8392:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496041472 00000100:00100000:0.0:1790773177.680558:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496040960 00000100:00100000:1.0:1790773177.680559:0:8392:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496041472 00000100:00100000:0.0:1790773177.680568:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496041088 00000100:00100000:0.0:1790773177.680570:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496041088 00000100:00100000:1.0:1790773177.680578:0:8392:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496041344 00000100:00100000:1.0:1790773177.680581:0:8392:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496041344 00000100:00100000:0.0:1790773177.680581:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496041728 00000100:00100000:0.0:1790773177.680582:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496041728 00000100:00100000:0.0:1790773177.680591:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496041600 00000100:00100000:0.0:1790773177.680593:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496041600 00000100:00100000:1.0:1790773177.680597:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1790773177.680602:0:8392:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1434b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496041472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773177.680603:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496040832 00000100:00100000:0.0:1790773177.680610:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496040832 00000100:00100000:0.0:1790773177.680627:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1790773177.680634:0:8392:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1434b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496041472:12345-0@lo:400:kworker.0 Request processed in 32us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773177.680640:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1790773177.680651:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1790773177.680663:0:8392:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496041344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773177.680695:0:8392:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496041344:12345-0@lo:400:kworker.0 Request processed in 32us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773177.680700:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1790773177.680707:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1877761496041216:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1790773177.680730:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f977100 x1877761496041472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773177.680741:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496041472:0@lo:400:kworker.0 00000100:00100000:0.0:1790773177.680743:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1877761496041216:12345-0@lo:400:kworker.0 Request processed in 111us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773177.680749:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00010000:00080000:1.0:1790773177.680761:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f976a00 x1877761496041216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773177.680761:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1790773177.680767:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1434b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3605:x1877761496040960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773177.680770:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3607:1877761496041216:0@lo:400:kworker.0 00010000:00080000:1.0:1790773177.680788:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f974a80 x1877761496041344/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773177.680795:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1434b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3605:x1877761496040960:12345-0@lo:400:kworker.0 Request processed in 29us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773177.680796:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496041344:0@lo:400:kworker.0 00000100:00100000:0.0:1790773177.680801:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1790773177.680813:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3605:1877761496040960:0@lo:400:kworker.0 00000100:00100000:0.0:1790773177.680813:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1790773177.680819:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1434b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1877761496041088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773177.680828:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1790773177.680835:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1877761496041728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773177.680863:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1434b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1877761496041088:12345-0@lo:400:kworker.0 Request processed in 44us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773177.680869:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1790773177.680880:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1790773177.680886:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1434baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3606:x1877761496041600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773177.680914:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1434baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3606:x1877761496041600:12345-0@lo:400:kworker.0 Request processed in 28us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773177.680920:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1790773177.680931:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1790773177.680936:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3604:x1877761496040832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773177.680969:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3604:x1877761496040832:12345-0@lo:400:kworker.0 Request processed in 32us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773177.680973:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1877761496041728:12345-0@lo:400:kworker.0 Request processed in 139us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773177.680981:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00080000:3.0:1790773177.680983:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790773177.680985:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00080000:3.0:1790773177.680990:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790773177.680994:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790773177.680998:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1790773177.681010:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1434bb800 x1877761496041728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773177.681010:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3606:1877761496041088:0@lo:400:kworker.0 00000100:00100000:1.0:1790773177.681019:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1434bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3607:1877761496041728:0@lo:400:kworker.0 00000100:00100000:0.0:1790773177.681020:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1434bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3606:1877761496041600:0@lo:400:kworker.0 00000100:00100000:1.0:1790773177.681045:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3604:1877761496040832:0@lo:400:kworker.0 00010000:00010000:1.0:1790773178.189531:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773179.215117:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773180.237810:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773180.749496:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496041856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790773180.749570:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773180.749686:0:11145:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496041856 00000100:00100000:0.0:1790773180.749695:0:11145:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496041856 00000100:00100000:0.0:1790773180.749784:0:11145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1790773180.749795:0:11145:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496041856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790773180.749841:0:11145:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1790773180.749927:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790773180.749947:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496041984:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790773180.749977:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773180.750018:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496041984 00000100:00100000:2.0:1790773180.750022:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496041984 00000100:00100000:2.0:1790773180.750049:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1790773180.750055:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496041984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790773180.750067:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790773180.750098:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496041984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773180.750106:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:2.0:1790773180.750126:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790773180.750151:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27c3a8e00 x1877761496041984/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773196 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773180.750170:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496041984:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790773180.758175:0:11145:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496041856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8373us (8594us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773180.758192:0:11145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00080000:1.0:1790773180.760516:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f9e7480 x1877761496041856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773196 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773180.760545:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496041856:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790773181.263991:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773182.285918:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773182.510337:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773182.510388:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773182.510437:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773182.512920:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484420480 00000100:00100000:1.0:1790773182.512942:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484420480 00000100:00100000:1.0:1790773182.513028:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484420352 00000100:00100000:1.0:1790773182.513032:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484420352 00000100:00100000:1.0:1790773182.513065:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 241 00000100:00100000:1.0:1790773182.513077:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+5:2398:x1877761484420480:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773182.513162:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+5:2398:x1877761484420480:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 88us (2773us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773182.513170:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 241 00000100:00100000:1.0:1790773182.513188:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 242 00000100:00100000:1.0:1790773182.513194:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14378df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+5:2398:x1877761484420352:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773182.513259:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14378df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+5:2398:x1877761484420352:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 65us (2821us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773182.513265:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 242 00000100:00080000:3.0:1790773182.513583:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790773182.513589:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790773182.513652:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484420224 00000100:00100000:2.0:1790773182.513658:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484420224 00000100:00100000:2.0:1790773182.513697:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 375 00000100:00100000:2.0:1790773182.513706:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d252ea0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:2398:x1877761484420224:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1790773182.513751:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d252ea0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:2398:x1877761484420224:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 47us (3427us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773182.513776:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 375 00000100:00100000:3.0:1790773182.518725:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773182.519699:0:8393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484420608 00000100:00100000:2.0:1790773182.519713:0:8393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484420608 00000100:00100000:2.0:1790773182.519814:0:8393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 27 00000100:00100000:2.0:1790773182.519826:0:8393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14378c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:110130ab-04fa-4d7c-984e-562032df4432+5:2396:x1877761484420608:12345-192.168.202.19@tcp:9:kworker.0 00000020:00000080:2.0:1790773182.519859:0:8393:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7841b49 00000100:00080000:2.0:1790773182.519868:0:8393:0:(import.c:65:import_set_state_nolock()) ffff93d143c81000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790773182.519938:0:8393:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:2.0:1790773182.520130:0:8393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14378c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:110130ab-04fa-4d7c-984e-562032df4432+2:2396:x1877761484420608:12345-192.168.202.19@tcp:9:kworker.0 Request processed in 306us (1417us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773182.520138:0:8393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 27 00010000:00010000:0.0:1790773182.520647:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790773182.521225:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790773182.522159:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773182.522200:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773182.523856:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484420736 00000100:00100000:1.0:1790773182.523868:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484420736 00000100:00100000:1.0:1790773182.524013:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484420864 00000100:00100000:1.0:1790773182.524018:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484420864 00000100:00100000:3.0:1790773182.524068:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 243 00000100:00100000:3.0:1790773182.524079:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2397:x1877761484420736:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1790773182.524164:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2397:x1877761484420736:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 86us (2009us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773182.524172:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 243 00000100:00100000:1.0:1790773182.529243:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 244 00000100:00100000:1.0:1790773182.529259:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2397:x1877761484420864:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773182.529693:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2397:x1877761484420864:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 437us (7491us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773182.529702:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 244 00000100:00080000:2.0:1790773182.529897:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790773182.529902:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790773182.800173:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790773182.800195:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496042112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790773182.800278:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773182.800404:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496042112 00000100:00100000:2.0:1790773182.800412:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496042112 00000100:00100000:2.0:1790773182.800472:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1790773182.800482:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496042112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790773182.800511:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790773182.800562:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496042112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773182.800569:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1790773182.800610:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496042112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790773182.800863:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790773182.800873:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1434bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496042240:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790773182.800906:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773182.800932:0:6484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496042240 00000100:00100000:0.0:1790773182.800936:0:6484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496042240 00000100:00100000:0.0:1790773182.800963:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1790773182.800969:0:6484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1434b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496042240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790773182.800994:0:6484:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1790773182.801026:0:6484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1434b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496042240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 58us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773182.801031:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1790773182.801057:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1434bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496042240:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790773182.801151:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790773182.801160:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496042368:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790773182.801186:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773182.801382:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce0675b4-b0c5-48e7-b182-565e22fed04c:3605:1877761496042496:0@lo:400:kworker.0 00000100:00100000:1.0:1790773182.801425:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773182.801451:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3605:1877761496043008:0@lo:400:kworker.0 00000100:00100000:1.0:1790773182.801474:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773182.801490:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3605:1877761496043520:0@lo:400:kworker.0 00000100:00100000:1.0:1790773182.801507:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773182.801520:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1790773182.801524:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3605:1877761496042880:0@lo:400:kworker.0 00000100:00100000:1.0:1790773182.801541:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773182.801553:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496043392:0@lo:400:kworker.0 00000100:00100000:1.0:1790773182.801571:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773182.801593:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496043008 00000100:00100000:1.0:1790773182.801610:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496043008 00000100:00100000:1.0:1790773182.801639:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496043520 00000100:00100000:1.0:1790773182.801642:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496043520 00000100:00100000:1.0:1790773182.801655:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496042880 00000100:00100000:1.0:1790773182.801657:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496042880 00000100:00100000:1.0:1790773182.801668:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1790773182.801673:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f975c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3605:x1877761496043008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773182.801710:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f975c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3605:x1877761496043008:12345-0@lo:400:kworker.0 Request processed in 36us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773182.801716:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1790773182.801728:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1790773182.801733:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f974a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3605:x1877761496043520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773182.801756:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f974a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3605:x1877761496043520:12345-0@lo:400:kworker.0 Request processed in 24us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773182.801762:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1790773182.801771:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1790773182.801776:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3605:x1877761496042880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773182.801815:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3605:x1877761496042880:12345-0@lo:400:kworker.0 Request processed in 39us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773182.801820:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1790773182.801840:0:8906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496043392 00000100:00100000:1.0:1790773182.801844:0:8906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496043392 00000100:00100000:1.0:1790773182.801867:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1790773182.801874:0:8906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f977100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496043392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773182.801902:0:8906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f977100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496043392:12345-0@lo:400:kworker.0 Request processed in 28us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773182.801907:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1790773182.801945:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3605:1877761496042880:0@lo:400:kworker.0 00010000:00080000:1.0:1790773182.801957:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1437ddc00 x1877761496043392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773182.801967:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496043392:0@lo:400:kworker.0 00000100:00100000:1.0:1790773182.801975:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3605:1877761496043008:0@lo:400:kworker.0 00000100:00100000:1.0:1790773182.801982:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3605:1877761496043520:0@lo:400:kworker.0 00000100:00100000:2.0:1790773182.802136:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496042496 00000100:00100000:2.0:1790773182.802142:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496042496 00000100:00100000:2.0:1790773182.802181:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1790773182.802188:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d252ea3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3605:x1877761496042496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773182.802247:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d252ea3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3605:x1877761496042496:12345-0@lo:400:kworker.0 Request processed in 60us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773182.802253:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1790773182.802332:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3606:1877761496042624:0@lo:400:kworker.0 00000100:00100000:0.0:1790773182.802365:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773182.802403:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3606:1877761496043136:0@lo:400:kworker.0 00000100:00100000:0.0:1790773182.802423:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773182.802440:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3606:1877761496043648:0@lo:400:kworker.0 00000100:00100000:0.0:1790773182.802460:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773182.802477:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1790773182.802483:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496042752:0@lo:400:kworker.0 00000100:00100000:0.0:1790773182.802505:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773182.802521:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496043264:0@lo:400:kworker.0 00000100:00100000:0.0:1790773182.802539:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773182.802561:0:7666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496042752 00000100:00100000:0.0:1790773182.802564:0:7666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496042752 00000100:00100000:0.0:1790773182.802586:0:7666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1790773182.802592:0:7666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1434bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496042752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773182.802625:0:7666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1434bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496042752:12345-0@lo:400:kworker.0 Request processed in 33us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773182.802632:0:7666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1790773182.802648:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496042624 00000100:00100000:0.0:1790773182.802652:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496042624 00000100:00100000:0.0:1790773182.802670:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496043136 00000100:00100000:0.0:1790773182.802673:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496043136 00000100:00100000:0.0:1790773182.802685:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496043648 00000100:00100000:0.0:1790773182.802688:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496043648 00000100:00100000:0.0:1790773182.802701:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1790773182.802706:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1434bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1877761496042624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773182.802734:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1434bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1877761496042624:12345-0@lo:400:kworker.0 Request processed in 28us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773182.802749:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1790773182.802760:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1790773182.802765:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1434bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1877761496043136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773182.802809:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1434bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1877761496043136:12345-0@lo:400:kworker.0 Request processed in 44us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773182.802815:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1790773182.802825:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1790773182.802831:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1434b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3606:x1877761496043648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773182.802855:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1434b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3606:x1877761496043648:12345-0@lo:400:kworker.0 Request processed in 25us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773182.802860:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1790773182.802879:0:11145:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496042368 00000100:00100000:0.0:1790773182.802883:0:11145:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496042368 00000100:00100000:0.0:1790773182.802908:0:11145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1790773182.802914:0:11145:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f975180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496042368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790773182.802930:0:11145:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790773182.802960:0:11145:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f975180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496042368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (1773us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773182.802965:0:11145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1790773182.802996:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496042752:0@lo:400:kworker.0 00000100:00100000:0.0:1790773182.803006:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3606:1877761496042624:0@lo:400:kworker.0 00010000:00080000:0.0:1790773182.803016:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1437df100 x1877761496043136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773182.803025:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3606:1877761496043136:0@lo:400:kworker.0 00010000:00080000:0.0:1790773182.803041:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1437dca80 x1877761496043648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773182.803049:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3606:1877761496043648:0@lo:400:kworker.0 00000100:00100000:1.0:1790773182.803821:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce0675b4-b0c5-48e7-b182-565e22fed04c:3605:1877761496042496:0@lo:400:kworker.0 00000100:00100000:1.0:1790773182.803842:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496042368:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790773182.803995:0:8394:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496043264 00000100:00100000:3.0:1790773182.804001:0:8394:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496043264 00000100:00100000:3.0:1790773182.804043:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1790773182.804052:0:8394:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1434bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496043264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773182.804100:0:8394:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1434bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496043264:12345-0@lo:400:kworker.0 Request processed in 49us (1559us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773182.804116:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:3.0:1790773182.804137:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790773182.804141:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790773182.804143:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790773182.804145:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1790773182.804279:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1437dd880 x1877761496043264/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773182.804291:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496043264:0@lo:400:kworker.0 00000100:00100000:1.0:1790773182.804303:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790773182.804311:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496043776:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790773182.804340:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773182.804425:0:6484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496043776 00000100:00100000:2.0:1790773182.804430:0:6484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496043776 00000100:00100000:2.0:1790773182.804465:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1790773182.804472:0:6484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496043776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790773182.804498:0:6484:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1790773182.804546:0:6484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496043776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773182.804552:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1790773182.804719:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496043776:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1790773183.309863:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773184.333555:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773185.357606:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773185.871086:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790773185.871111:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496043904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790773185.871190:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773185.871410:0:8397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496043904 00000100:00100000:2.0:1790773185.871420:0:8397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496043904 00000100:00100000:2.0:1790773185.871538:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1790773185.871550:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f975880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496043904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790773185.871583:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790773185.871639:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f975880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496043904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773185.871646:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:0.0:1790773185.872431:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790773185.872442:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790773185.872454:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496044032:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790773185.872496:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1790773185.884048:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1437de300 x1877761496043904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773201 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773185.884077:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496043904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790773185.892855:0:11145:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496044032 00000100:00100000:1.0:1790773185.892872:0:11145:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496044032 00000100:00100000:1.0:1790773185.892954:0:11145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1790773185.892964:0:11145:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496044032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790773185.892991:0:11145:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790773185.893086:0:11145:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496044032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 123us (20589us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773185.893094:0:11145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:0.0:1790773185.893220:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790773185.893259:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143cac700 x1877761496044032/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773201 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773185.893280:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496044032:0@lo:13:osp-pre-0-1.0 00000040:00080000:1.0:1790773186.382981:0:13753:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790773186.383112:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790773186.385107:0:13749:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790773187.406335:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773187.631001:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773187.631041:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773187.631070:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773187.631092:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773187.631116:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773187.631144:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484420992 00000100:00100000:2.0:1790773187.631162:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484420992 00000100:00100000:2.0:1790773187.631231:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 377 00000100:00100000:2.0:1790773187.631242:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d279eaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:2400:x1877761484420992:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1790773187.631312:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d279eaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:2400:x1877761484420992:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 71us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773187.631319:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 377 00000100:00100000:2.0:1790773187.631352:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484421120 00000100:00100000:2.0:1790773187.631356:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484421120 00000100:00100000:2.0:1790773187.631387:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484421376 00000100:00100000:2.0:1790773187.631390:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484421376 00000100:00100000:2.0:1790773187.631403:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484421248 00000100:00100000:2.0:1790773187.631405:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484421248 00000100:00100000:2.0:1790773187.631416:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484421504 00000100:00100000:2.0:1790773187.631418:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484421504 00000100:00100000:2.0:1790773187.631431:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 251 00000100:00100000:2.0:1790773187.631444:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+5:2400:x1877761484421120:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1790773187.631476:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+5:2400:x1877761484421120:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 38us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773187.631482:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 251 00000100:00100000:2.0:1790773187.631496:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 252 00000100:00100000:2.0:1790773187.631502:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2400:x1877761484421376:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1790773187.631526:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2400:x1877761484421376:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 24us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773187.631531:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 252 00000100:00100000:2.0:1790773187.631541:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 253 00000100:00100000:2.0:1790773187.631548:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+5:2400:x1877761484421248:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1790773187.631733:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 254 00000100:00100000:3.0:1790773187.631742:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2400:x1877761484421504:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1790773187.631783:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2400:x1877761484421504:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 43us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773187.631789:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 254 00000100:00080000:0.0:1790773187.632117:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790773187.632123:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790773187.632790:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+5:2400:x1877761484421248:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 1240us (1694us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773187.632799:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 253 00000100:00100000:0.0:1790773187.917510:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496044160:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790773187.917527:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496044416:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790773187.917638:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496044288:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790773187.917731:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773187.917874:0:12789:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496044416 00000100:00100000:1.0:1790773187.917883:0:12789:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496044416 00000100:00100000:1.0:1790773187.917934:0:12789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1790773187.917942:0:12789:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496044416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790773187.917978:0:12789:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1790773187.918026:0:12789:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496044416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773187.918034:0:12789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1790773187.918272:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773187.918314:0:6483:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496044160 00000100:00100000:1.0:1790773187.918320:0:6483:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496044160 00000100:00100000:1.0:1790773187.918588:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1790773187.918597:0:6483:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496044160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790773187.918617:0:6483:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1790773187.918658:0:6483:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496044160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 63us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773187.918664:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1790773187.918710:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496044416:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790773187.918880:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496044160:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790773187.918896:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790773187.918903:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3607:1877761496044672:0@lo:400:kworker.0 00000100:00100000:0.0:1790773187.918940:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773187.918971:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496044672 00000100:00100000:0.0:1790773187.918975:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496044672 00000100:00100000:0.0:1790773187.919004:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1790773187.919011:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1877761496044672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773187.919066:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1877761496044672:12345-0@lo:400:kworker.0 Request processed in 55us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773187.919073:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1790773187.919104:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3607:1877761496044672:0@lo:400:kworker.0 00000100:00100000:2.0:1790773187.929088:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773187.932956:0:11145:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496044288 00000100:00100000:0.0:1790773187.932978:0:11145:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496044288 00000100:00100000:0.0:1790773187.933065:0:11145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1790773187.933080:0:11145:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496044288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790773187.933120:0:11145:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790773187.933383:0:11145:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496044288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 308us (4303us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773187.933391:0:11145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:0.0:1790773187.933417:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790773187.934147:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790773187.934167:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce0675b4-b0c5-48e7-b182-565e22fed04c:3604:1877761496044544:0@lo:400:kworker.0 00000100:00100000:1.0:1790773187.934263:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773187.934315:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496044544 00000100:00100000:1.0:1790773187.934321:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496044544 00000100:00100000:1.0:1790773187.934356:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1790773187.934363:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d279eaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3604:x1877761496044544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773187.934405:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d279eaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3604:x1877761496044544:12345-0@lo:400:kworker.0 Request processed in 42us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773187.934412:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1790773187.934457:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce0675b4-b0c5-48e7-b182-565e22fed04c:3604:1877761496044544:0@lo:400:kworker.0 00000100:00100000:1.0:1790773187.934513:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3604:1877761496044928:0@lo:400:kworker.0 00000100:00100000:1.0:1790773187.934542:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773187.934576:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790773187.934581:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143dece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3604:1877761496045056:0@lo:400:kworker.0 00000100:00100000:1.0:1790773187.934601:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773187.934648:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143dedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3604:1877761496045440:0@lo:400:kworker.0 00000100:00100000:1.0:1790773187.934669:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773187.934702:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790773187.934706:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3604:1877761496045568:0@lo:400:kworker.0 00000100:00100000:1.0:1790773187.934727:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773187.937888:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496044928 00000100:00100000:0.0:1790773187.937908:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496044928 00000100:00100000:0.0:1790773187.937996:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496045056 00000100:00100000:0.0:1790773187.938000:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496045056 00000100:00100000:0.0:1790773187.938015:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496045440 00000100:00100000:0.0:1790773187.938017:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496045440 00000100:00100000:0.0:1790773187.938031:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496045568 00000100:00100000:0.0:1790773187.938034:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496045568 00000100:00100000:0.0:1790773187.938052:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1790773187.938061:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143deca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3604:x1877761496044928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773187.938156:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143deca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3604:x1877761496044928:12345-0@lo:400:kworker.0 Request processed in 95us (3612us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773187.938163:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1790773187.938180:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1790773187.938186:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143deed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3604:x1877761496045056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773187.938265:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143deed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3604:x1877761496045056:12345-0@lo:400:kworker.0 Request processed in 78us (3662us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773187.938271:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1790773187.938283:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1790773187.938290:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3604:x1877761496045440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773187.938320:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3604:x1877761496045440:12345-0@lo:400:kworker.0 Request processed in 30us (3649us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773187.938325:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1790773187.938350:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1790773187.938358:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3604:x1877761496045568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773187.938416:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3604:x1877761496045568:12345-0@lo:400:kworker.0 Request processed in 59us (3687us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773187.938422:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1790773187.938471:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877761496044800:0@lo:400:kworker.0 00000100:00100000:0.0:1790773187.938510:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773187.938537:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143dec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496045312:0@lo:400:kworker.0 00000100:00100000:0.0:1790773187.938565:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773187.938589:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1790773187.938596:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496045184:0@lo:400:kworker.0 00000100:00100000:0.0:1790773187.938618:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773187.938638:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496045696:0@lo:400:kworker.0 00000100:00100000:0.0:1790773187.938663:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773187.938695:0:8392:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496045312 00000100:00100000:0.0:1790773187.938701:0:8392:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496045312 00000100:00100000:3.0:1790773187.938716:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496044800 00000100:00100000:3.0:1790773187.938722:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496044800 00000100:00100000:0.0:1790773187.938737:0:8392:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496045184 00000100:00100000:0.0:1790773187.938761:0:8392:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496045184 00000100:00100000:3.0:1790773187.938766:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1790773187.938775:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877761496044800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773187.938794:0:8392:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496045696 00000100:00100000:0.0:1790773187.938798:0:8392:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496045696 00000100:00100000:3.0:1790773187.938821:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877761496044800:12345-0@lo:400:kworker.0 Request processed in 47us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773187.938822:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1790773187.938832:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1790773187.938835:0:8392:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496045312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773187.938876:0:8907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1790773187.938878:0:8392:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496045312:12345-0@lo:400:kworker.0 Request processed in 46us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773187.938889:0:8907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496045184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773187.938889:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1790773187.938905:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1790773187.938913:0:8392:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496045696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773187.938934:0:8907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496045184:12345-0@lo:400:kworker.0 Request processed in 49us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773187.938949:0:8907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1790773187.938955:0:8392:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496045696:12345-0@lo:400:kworker.0 Request processed in 41us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773187.938964:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1790773187.938998:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496045824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790773187.939024:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1790773187.939062:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143defb80 x1877761496045184/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773187.939077:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496045184:0@lo:400:kworker.0 00000100:00100000:0.0:1790773187.939088:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496045696:0@lo:400:kworker.0 00000100:00100000:0.0:1790773187.939096:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877761496044800:0@lo:400:kworker.0 00010000:00080000:0.0:1790773187.939104:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143dec700 x1877761496045312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773187.939113:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143dec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496045312:0@lo:400:kworker.0 00000100:00100000:0.0:1790773187.939147:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496045824 00000100:00100000:0.0:1790773187.939156:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496045824 00000100:00100000:0.0:1790773187.939196:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1790773187.939222:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496045824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790773187.939238:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790773187.939277:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496045824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773187.939283:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:1.0:1790773187.939300:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790773187.939305:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790773187.939307:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790773187.939309:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790773187.939314:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496045824:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1790773187.939330:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d2447dd500 x1877761496045568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773187.939341:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3604:1877761496045568:0@lo:400:kworker.0 00000100:00100000:1.0:1790773187.939376:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143dedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3604:1877761496045440:0@lo:400:kworker.0 00010000:00080000:1.0:1790773187.939390:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143dece00 x1877761496045056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773187.939398:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143dece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3604:1877761496045056:0@lo:400:kworker.0 00000100:00100000:1.0:1790773187.939409:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3604:1877761496044928:0@lo:400:kworker.0 00000100:00100000:2.0:1790773187.939523:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496044288:0@lo:13:osp-pre-1-1.0 00000001:00100000:3.0:1790773187.955134:0:9475:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 110130ab-04fa-4d7c-984e-562032df4432 00000020:00000080:3.0:1790773187.955146:0:9475:0:(genops.c:885:class_export_put()) final put ffff93d143c84800/110130ab-04fa-4d7c-984e-562032df4432 00000020:00000080:1.0:1790773187.955233:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93d143c84800/110130ab-04fa-4d7c-984e-562032df4432 for lustre-OST0001 00000020:00000080:1.0:1790773187.955289:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d143c81000 for lustre-OST0001 00010000:00010000:0.0:1790773188.429702:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773189.453943:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790773190.416767:0:14023:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 08:59:49 (1790773189) 00010000:00010000:1.0:1790773190.479520:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773190.989524:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496045952:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790773190.989600:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773190.989739:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496046080:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790773190.989762:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773190.989799:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496045952 00000100:00100000:3.0:1790773190.989807:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496045952 00000100:00100000:3.0:1790773190.989850:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496046080 00000100:00100000:3.0:1790773190.989853:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496046080 00000100:00100000:3.0:1790773190.989867:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1790773190.989872:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496045952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790773190.989896:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790773190.989957:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1790773190.989964:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496046080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790773190.989972:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790773190.989996:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496046080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 34us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773190.990001:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:0.0:1790773190.990035:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790773190.990172:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1437dd180 x1877761496046080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773206 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773190.990192:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496046080:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790773190.990324:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496045952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 449us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773190.990330:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00080000:1.0:1790773190.990654:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143cae680 x1877761496045952/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773206 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773190.990664:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496045952:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1790773191.501815:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773191.855010:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773191.855189:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484421632 00000100:00100000:0.0:1790773191.855201:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484421632 00000100:00100000:0.0:1790773191.855317:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 40 00000100:00100000:0.0:1790773191.855328:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143caf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+5:11046:x1877761484421632:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790773191.855350:0:8697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773191.855372:0:8697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7841c37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bba1 expref: -99 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773191.855437:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc7841c3e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773191.855477:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc7841c3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773191.855634:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc7841c3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790773191.855689:0:8697:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1790773191.855693:0:8697:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790773191.855743:0:8697:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc7841c3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773191.855770:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7841c37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bba1 expref: 7 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773191.855789:0:8697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc7841c3e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bba1 expref: 6 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773191.855798:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d26ede0c00) 00010000:00010000:0.0:1790773191.855802:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790773191.855806:0:8697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074b400, rc 0) 00000100:00100000:0.0:1790773191.855879:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143caf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+6:11046:x1877761484421632:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 553us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773191.855886:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 40 00000100:00080000:1.0:1790773191.864263:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790773191.881022:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773191.882335:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484421760 00000100:00100000:3.0:1790773191.882355:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484421760 00000100:00100000:3.0:1790773191.882476:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 41 00000100:00100000:3.0:1790773191.882487:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+6:11047:x1877761484421760:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790773191.882526:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773191.882552:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc7841c45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bba8 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773191.882652:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc7841c4c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773191.882694:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc7841c4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773191.882747:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc7841c4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773191.882766:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7841c53 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773191.882774:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7841c53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773191.882783:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7841c53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773191.882871:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad800/0xabf1cc0bc7841c5a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773191.882879:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad800/0xabf1cc0bc7841c5a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773191.882885:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad800/0xabf1cc0bc7841c5a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790773191.882935:0:6480:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1790773191.882939:0:6480:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790773191.882967:0:6480:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad800/0xabf1cc0bc7841c5a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773191.882986:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc7841c4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773191.883004:0:6480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc7841c4c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773191.883012:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc7841c4c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773191.883018:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ad400 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773191.883023:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc7841c4c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773191.883031:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc7841c4c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773191.883045:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d26ede0c00) 00010000:00010000:3.0:1790773191.883049:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790773191.883053:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc7841c4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773191.883060:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc7841c4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773191.883082:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7841c53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773191.883088:0:6480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7841c53 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773191.883093:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7841c53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773191.883099:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ad000 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773191.883106:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7841c53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773191.883112:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7841c53 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773191.883119:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff93d280936d00) 00010000:00010000:3.0:1790773191.883122:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790773191.883125:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7841c53 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773191.883130:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7841c53 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773191.883696:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc7841c45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bba8 expref: 8 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773191.883729:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad800/0xabf1cc0bc7841c5a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bba8 expref: 7 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773191.883743:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93d280936b00) 00010000:00010000:3.0:1790773191.883746:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790773191.883748:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d1434ad800, rc 0) 00000100:00100000:3.0:1790773191.883852:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+7:11047:x1877761484421760:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 1366us (2846us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773191.883861:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 41 00000100:00100000:2.0:1790773191.888827:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773191.888908:0:6489:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484421888 00000100:00100000:0.0:1790773191.888921:0:6489:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484421888 00000100:00100000:0.0:1790773191.888986:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:0.0:1790773191.888996:0:6489:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:110130ab-04fa-4d7c-984e-562032df4432+7:11047:x1877761484421888:12345-192.168.202.19@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1790773191.889104:0:6489:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:110130ab-04fa-4d7c-984e-562032df4432+7:11047:x1877761484421888:12345-192.168.202.19@tcp:900:lhsmtool_posix.0 Request processed in 108us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773191.889127:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:1.0:1790773191.899687:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773191.900699:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484422144 00000100:00100000:0.0:1790773191.900726:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484422144 00000100:00100000:0.0:1790773191.900826:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 42 00000100:00100000:0.0:1790773191.900840:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+7:11047:x1877761484422144:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790773191.900868:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773191.900892:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7841c61 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bbaf expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773191.900973:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7841c68 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773191.900990:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7841c68 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773191.901006:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7841c68 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773191.901073:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7841c6f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773191.901080:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7841c6f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773191.901087:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7841c6f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773191.901283:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b600/0xabf1cc0bc7841c76 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773191.901319:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b600/0xabf1cc0bc7841c76 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773191.901326:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b600/0xabf1cc0bc7841c76 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790773191.901337:0:6478:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1790773191.901756:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7841c68 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773191.901765:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7841c68 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773191.901771:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7841c68 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773191.901776:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074b000 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773191.901781:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7841c68 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773191.901788:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7841c68 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773191.901801:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93d280936b00) 00010000:00010000:0.0:1790773191.901804:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773191.901809:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7841c68 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773191.901814:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7841c68 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773191.901826:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7841c6f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773191.901838:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7841c6f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773191.901843:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7841c6f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773191.901848:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074b200 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773191.901850:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7841c6f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773191.901855:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7841c6f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773191.901860:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff93d26ede0100) 00010000:00010000:0.0:1790773191.901862:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773191.901864:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7841c6f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773191.901869:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7841c6f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773191.902166:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7841c61 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbaf expref: 10 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773191.902180:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b600/0xabf1cc0bc7841c76 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbaf expref: 9 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773191.902187:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93d26ede0500) 00010000:00010000:0.0:1790773191.902190:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773191.902197:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074b600, rc 0) 00000100:00100000:0.0:1790773191.903062:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+9:11047:x1877761484422144:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 2222us (3387us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1790773191.903072:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 42 00000100:00100000:1.0:1790773191.915411:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773191.915496:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484422272 00000100:00100000:3.0:1790773191.915509:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484422272 00000100:00100000:3.0:1790773191.915576:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 43 00000100:00100000:3.0:1790773191.915588:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+9:11047:x1877761484422272:12345-192.168.202.19@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1790773191.915785:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+9:11047:x1877761484422272:12345-192.168.202.19@tcp:59:lhsmtool_posix.0 Request processed in 198us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773191.915795:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 43 00000100:00100000:2.0:1790773191.920724:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773191.920848:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484422400 00000100:00100000:0.0:1790773191.920867:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484422400 00000100:00100000:0.0:1790773191.920970:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 44 00000100:00100000:0.0:1790773191.920982:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+5:11047:x1877761484422400:12345-192.168.202.19@tcp:59:lhsmtool_posix.0 00000100:00080000:1.0:1790773191.921118:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1790773191.929773:0:13768:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 8735us 00000100:00100000:1.0:1790773191.960059:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+5:11047:x1877761484422400:12345-192.168.202.19@tcp:59:lhsmtool_posix.0 Request processed in 39070us (39351us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773191.960073:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 44 00000040:00080000:0.0:1790773192.527116:0:13753:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1790773192.532046:0:13749:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790773192.536510:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773192.757418:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773192.757468:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773192.757493:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773192.757532:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773192.757565:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773192.757595:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484422784 00000100:00100000:1.0:1790773192.757607:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484422784 00000100:00100000:3.0:1790773192.757635:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484422528 00000100:00100000:3.0:1790773192.757643:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484422528 00000100:00100000:1.0:1790773192.757665:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484423040 00000100:00100000:1.0:1790773192.757670:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484423040 00000100:00100000:3.0:1790773192.757691:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 379 00000100:00100000:1.0:1790773192.757713:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484422656 00000100:00100000:3.0:1790773192.757717:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d251208850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:2397:x1877761484422528:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773192.757719:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484422656 00000100:00100000:1.0:1790773192.757736:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484422912 00000100:00100000:1.0:1790773192.757740:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484422912 00000100:00100000:1.0:1790773192.757756:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 261 00000100:00100000:1.0:1790773192.757764:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+5:2397:x1877761484422784:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1790773192.757804:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d251208850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:2397:x1877761484422528:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 90us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773192.757806:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+5:2397:x1877761484422784:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 42us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773192.757818:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 379 00000100:00100000:1.0:1790773192.757822:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 261 00000100:00100000:1.0:1790773192.757841:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 262 00000100:00100000:1.0:1790773192.757849:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2397:x1877761484423040:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773192.757877:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2397:x1877761484423040:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 29us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773192.757883:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 262 00000100:00100000:1.0:1790773192.757898:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 263 00000100:00100000:1.0:1790773192.757906:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+9:2397:x1877761484422656:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773192.757937:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+9:2397:x1877761484422656:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 33us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773192.757943:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 263 00000100:00100000:1.0:1790773192.757958:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 264 00000100:00100000:1.0:1790773192.757974:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ec60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2397:x1877761484422912:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773192.758009:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ec60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2397:x1877761484422912:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 38us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773192.758016:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 264 00000100:00080000:1.0:1790773192.758043:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790773192.758047:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790773193.038014:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790773193.038041:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496046208:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790773193.038125:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773193.038199:0:12789:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496046208 00000100:00100000:0.0:1790773193.038223:0:12789:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496046208 00000100:00100000:0.0:1790773193.038268:0:12789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1790773193.038276:0:12789:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496046208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790773193.038315:0:12789:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1790773193.038363:0:12789:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496046208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773193.038370:0:12789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1790773193.038419:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496046208:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790773193.038710:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790773193.038722:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496046336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790773193.038767:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773193.038799:0:8397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496046336 00000100:00100000:2.0:1790773193.038803:0:8397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496046336 00000100:00100000:2.0:1790773193.038846:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1790773193.038853:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496046336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790773193.038876:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790773193.038909:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496046336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773193.038916:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:2.0:1790773193.038951:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790773193.038979:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496046336:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790773193.039141:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790773193.039152:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496046464:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790773193.039185:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773193.039248:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496046464 00000100:00100000:3.0:1790773193.039252:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496046464 00000100:00100000:3.0:1790773193.039283:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1790773193.039290:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496046464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790773193.039300:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790773193.039331:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496046464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773193.039337:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:3.0:1790773193.039362:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790773193.039396:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496046464:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790773193.039772:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496046848:0@lo:400:kworker.0 00000100:00100000:0.0:1790773193.039801:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773193.039819:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496047360:0@lo:400:kworker.0 00000100:00100000:0.0:1790773193.039848:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773193.039863:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1790773193.039867:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3607:1877761496046720:0@lo:400:kworker.0 00000100:00100000:0.0:1790773193.039888:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773193.039905:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143dec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3607:1877761496047232:0@lo:400:kworker.0 00000100:00100000:0.0:1790773193.039926:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773193.039941:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ca6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3607:1877761496047744:0@lo:400:kworker.0 00000100:00100000:0.0:1790773193.039960:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773193.039986:0:6483:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496046848 00000100:00100000:0.0:1790773193.039990:0:6483:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496046848 00000100:00100000:0.0:1790773193.040014:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1790773193.040021:0:6483:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496046848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773193.040060:0:6483:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496046848:12345-0@lo:400:kworker.0 Request processed in 39us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773193.040067:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1790773193.040086:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496046720 00000100:00100000:0.0:1790773193.040089:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496046720 00000100:00100000:0.0:1790773193.040112:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496047232 00000100:00100000:0.0:1790773193.040115:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496047232 00000100:00100000:0.0:1790773193.040136:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496047744 00000100:00100000:0.0:1790773193.040138:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496047744 00000100:00100000:0.0:1790773193.040152:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1790773193.040157:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ed6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1877761496046720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773193.040187:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ed6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1877761496046720:12345-0@lo:400:kworker.0 Request processed in 30us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773193.040193:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1790773193.040226:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1790773193.040239:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f968700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1877761496047232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773193.040269:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f968700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1877761496047232:12345-0@lo:400:kworker.0 Request processed in 31us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773193.040275:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1790773193.040286:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1790773193.040292:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f986680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1877761496047744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773193.040317:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f986680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1877761496047744:12345-0@lo:400:kworker.0 Request processed in 25us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773193.040323:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1790773193.040365:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3607:1877761496046720:0@lo:400:kworker.0 00010000:00080000:0.0:1790773193.040379:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143dec700 x1877761496047232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773193.040404:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143dec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3607:1877761496047232:0@lo:400:kworker.0 00010000:00080000:0.0:1790773193.040414:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143ca6d80 x1877761496047744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773193.040422:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ca6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3607:1877761496047744:0@lo:400:kworker.0 00000100:00100000:0.0:1790773193.040431:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496046848:0@lo:400:kworker.0 00000100:00100000:1.0:1790773193.040612:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce0675b4-b0c5-48e7-b182-565e22fed04c:3605:1877761496046592:0@lo:400:kworker.0 00000100:00100000:1.0:1790773193.040648:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773193.040686:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143dedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3605:1877761496047104:0@lo:400:kworker.0 00000100:00100000:1.0:1790773193.040750:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773193.040765:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ca4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3605:1877761496047616:0@lo:400:kworker.0 00000100:00100000:1.0:1790773193.040785:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773193.040801:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1790773193.040806:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143dece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3605:1877761496046976:0@lo:400:kworker.0 00000100:00100000:1.0:1790773193.040826:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773193.040838:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ca6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496047488:0@lo:400:kworker.0 00000100:00100000:1.0:1790773193.040859:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773193.040977:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496046592 00000100:00100000:0.0:1790773193.040982:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496046592 00000100:00100000:0.0:1790773193.041020:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1790773193.041028:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25120b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3605:x1877761496046592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773193.041063:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25120b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3605:x1877761496046592:12345-0@lo:400:kworker.0 Request processed in 36us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773193.041081:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1790773193.041110:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496047104 00000100:00100000:0.0:1790773193.041113:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496047104 00000100:00100000:0.0:1790773193.041135:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496047616 00000100:00100000:0.0:1790773193.041138:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496047616 00000100:00100000:0.0:1790773193.041154:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496046976 00000100:00100000:0.0:1790773193.041156:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496046976 00000100:00100000:0.0:1790773193.041169:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1790773193.041174:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ec61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3605:x1877761496047104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773193.041229:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ec61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3605:x1877761496047104:12345-0@lo:400:kworker.0 Request processed in 29us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773193.041235:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1790773193.041246:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1790773193.041251:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26bee9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3605:x1877761496047616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773193.041278:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26bee9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3605:x1877761496047616:12345-0@lo:400:kworker.0 Request processed in 27us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773193.041284:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1790773193.041294:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1790773193.041298:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3605:x1877761496046976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773193.041324:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3605:x1877761496046976:12345-0@lo:400:kworker.0 Request processed in 25us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773193.041330:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1790773193.041454:0:8907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496047360 00000100:00100000:3.0:1790773193.041458:0:8907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496047360 00000100:00100000:3.0:1790773193.041493:0:8907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496047488 00000100:00100000:3.0:1790773193.041496:0:8907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496047488 00000100:00100000:3.0:1790773193.041512:0:8907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1790773193.041518:0:8907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496047360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773193.041549:0:8907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496047360:12345-0@lo:400:kworker.0 Request processed in 31us (1700us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773193.041554:0:8907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1790773193.041564:0:8907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1790773193.041569:0:8907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496047488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773193.041594:0:8907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496047488:12345-0@lo:400:kworker.0 Request processed in 25us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773193.041599:0:8907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:3.0:1790773193.041622:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790773193.041626:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790773193.041628:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790773193.041768:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790773193.041778:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496047872:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790773193.041809:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773193.041929:0:12789:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496047872 00000100:00100000:3.0:1790773193.041934:0:12789:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496047872 00000100:00100000:3.0:1790773193.041965:0:12789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1790773193.041971:0:12789:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496047872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790773193.041995:0:12789:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1790773193.042030:0:12789:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496047872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773193.042036:0:12789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1790773193.042117:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496047872:0@lo:41:osp-pre-0-1.0 00010000:00080000:0.0:1790773193.042898:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143defb80 x1877761496047360/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773193.042912:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496047360:0@lo:400:kworker.0 00000100:00100000:1.0:1790773193.043514:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143dece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3605:1877761496046976:0@lo:400:kworker.0 00010000:00080000:1.0:1790773193.043530:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143ca6300 x1877761496047488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773193.043539:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ca6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496047488:0@lo:400:kworker.0 00000100:00100000:1.0:1790773193.043549:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce0675b4-b0c5-48e7-b182-565e22fed04c:3605:1877761496046592:0@lo:400:kworker.0 00000100:00100000:1.0:1790773193.043559:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143dedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3605:1877761496047104:0@lo:400:kworker.0 00000100:00100000:1.0:1790773193.043586:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ca4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3605:1877761496047616:0@lo:400:kworker.0 00010000:00010000:0.0:1790773193.550467:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773194.222904:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773194.223292:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484423168 00000100:00100000:0.0:1790773194.223302:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484423168 00000100:00080000:1.0:1790773194.223361:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790773194.223386:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 45 00000100:00100000:0.0:1790773194.223504:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+9:11090:x1877761484423168:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:0.0:1790773194.223525:0:8697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773194.223544:0:8697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc7841c84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bbb6 expref: -99 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.223605:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc7841c8b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.223620:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc7841c8b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.223633:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc7841c8b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.223649:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b800/0xabf1cc0bc7841c92 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.223656:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b800/0xabf1cc0bc7841c92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.223661:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b800/0xabf1cc0bc7841c92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.223709:0:8697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc7841c8b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.223725:0:8697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc7841c8b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.223744:0:8697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc7841c8b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.223750:0:8697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074a800 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773194.223754:0:8697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc7841c8b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.223761:0:8697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc7841c8b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.223773:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d26ede0c00) 00010000:00010000:0.0:1790773194.223776:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773194.223781:0:8697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc7841c8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.223786:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc7841c8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.223797:0:8697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b800/0xabf1cc0bc7841c92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.223804:0:8697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b800/0xabf1cc0bc7841c92 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.223810:0:8697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b800/0xabf1cc0bc7841c92 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.223815:0:8697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074b800 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773194.223818:0:8697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b800/0xabf1cc0bc7841c92 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.223833:0:8697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b800/0xabf1cc0bc7841c92 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.223841:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff93d26ede0f00) 00010000:00010000:0.0:1790773194.223844:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773194.223846:0:8697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b800/0xabf1cc0bc7841c92 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.223852:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b800/0xabf1cc0bc7841c92 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.223883:0:8697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc7841c84 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbb6 expref: 10 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.223893:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d26ede0c00) 00010000:00010000:0.0:1790773194.223896:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773194.223899:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc7841c84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbb6 expref: 10 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.223908:0:8697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074be00, rc 0) 00000100:00100000:0.0:1790773194.223977:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+9:11090:x1877761484423168:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 583us (1081us total) trans 0 rc 301/301 00000100:00100000:0.0:1790773194.223985:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 45 00000100:00100000:1.0:1790773194.227700:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773194.227745:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484423424 00000100:00100000:1.0:1790773194.227755:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484423424 00000100:00100000:1.0:1790773194.227809:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 46 00000100:00100000:1.0:1790773194.227819:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+9:11090:x1877761484423424:12345-192.168.202.19@tcp:36:lfs.0 00010000:00010000:1.0:1790773194.227875:0:13768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790773194.227902:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc7841c3e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bba1 expref: 9 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.227919:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d26ede0c00) 00010000:00010000:1.0:1790773194.227930:0:13768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790773194.227995:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7841c99 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.228010:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7841c99 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.228020:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7841c99 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.228032:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b400/0xabf1cc0bc7841ca0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.228039:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b400/0xabf1cc0bc7841ca0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.228055:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b400/0xabf1cc0bc7841ca0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.228744:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc7841ca7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.228756:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc7841ca7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.228763:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc7841ca7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790773194.228778:0:13768:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000016a48d49 reply state 0000000000d8ae9e transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc7841ca7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.228789:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc7841ca7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.228796:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93d14363d100) 00010000:00010000:1.0:1790773194.228799:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790773194.228801:0:13768:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1790773194.228807:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1790773194.228813:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7841c99 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.228820:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7841c99 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.228826:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7841c99 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.228833:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12bc00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773194.228843:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7841c99 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.228852:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7841c99 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.228861:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d14363d300) 00010000:00010000:1.0:1790773194.228863:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790773194.228867:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7841c99 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.228873:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7841c99 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790773194.228885:0:13768:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000016a48d49 reply state 0000000000d8ae9e transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b400/0xabf1cc0bc7841ca0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.228892:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b400/0xabf1cc0bc7841ca0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.228898:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff93d14363d600) 00010000:00010000:1.0:1790773194.228900:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790773194.228902:0:13768:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1790773194.229008:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+10:11090:x1877761484423424:12345-192.168.202.19@tcp:36:lfs.0 Request processed in 1188us (1328us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1790773194.229017:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 46 00000100:00100000:3.0:1790773194.300602:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773194.300734:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484423552 00000100:00100000:0.0:1790773194.300746:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484423552 00000100:00100000:0.0:1790773194.300850:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 47 00000100:00100000:0.0:1790773194.300861:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+10:11098:x1877761484423552:12345-192.168.202.19@tcp:101:lctl.0 00010000:00010000:0.0:1790773194.300901:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773194.300923:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc7841cae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bbbd expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.300986:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b800/0xabf1cc0bc7841cb5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.301002:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b800/0xabf1cc0bc7841cb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.301015:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b800/0xabf1cc0bc7841cb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790773194.301056:0:6480:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1790773194.301060:0:6480:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790773194.301096:0:6480:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b800/0xabf1cc0bc7841cb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.301119:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc7841cae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbbd expref: 12 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.301135:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b800/0xabf1cc0bc7841cb5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbbd expref: 11 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.301144:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d26ede0f00) 00010000:00010000:0.0:1790773194.301147:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790773194.301150:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074b800, rc 0) 00000100:00100000:0.0:1790773194.301429:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+11:11098:x1877761484423552:12345-192.168.202.19@tcp:101:lctl.0 Request processed in 569us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773194.301437:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 47 00000100:00100000:3.0:1790773194.334107:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773194.334166:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484423680 00000100:00100000:0.0:1790773194.334177:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484423680 00000100:00100000:2.0:1790773194.334622:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 48 00000100:00100000:2.0:1790773194.334632:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+11:11104:x1877761484423680:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:2.0:1790773194.334649:0:8697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773194.334665:0:8697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7841cbc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bbc4 expref: -99 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773194.334729:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc7841cc3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773194.334743:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc7841cc3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773194.334754:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc7841cc3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773194.334767:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7841cca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773194.334772:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7841cca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773194.334777:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7841cca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773194.334851:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5400/0xabf1cc0bc7841cd1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773194.334857:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5400/0xabf1cc0bc7841cd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773194.334861:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5400/0xabf1cc0bc7841cd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790773194.334886:0:8697:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1790773194.334888:0:8697:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790773194.334918:0:8697:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5400/0xabf1cc0bc7841cd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773194.334926:0:8697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc7841cc3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773194.334931:0:8697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc7841cc3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773194.334936:0:8697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc7841cc3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773194.334939:0:8697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc5c00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:2.0:1790773194.334942:0:8697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc7841cc3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773194.334947:0:8697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc7841cc3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773194.334955:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d26ede0f00) 00010000:00010000:2.0:1790773194.334960:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790773194.334964:0:8697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc7841cc3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773194.334968:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc7841cc3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773194.334978:0:8697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7841cca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773194.334982:0:8697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7841cca lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773194.334985:0:8697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7841cca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773194.334988:0:8697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc5200 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:2.0:1790773194.334990:0:8697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7841cca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773194.334993:0:8697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7841cca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773194.334996:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff93d14363d600) 00010000:00010000:2.0:1790773194.334998:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790773194.334999:0:8697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7841cca lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773194.335002:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7841cca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773194.335019:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7841cbc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbc4 expref: 13 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773194.335034:0:8697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5400/0xabf1cc0bc7841cd1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbc4 expref: 12 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773194.335039:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93d14363d100) 00010000:00010000:2.0:1790773194.335041:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1790773194.335042:0:8697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26efc5400, rc 0) 00000100:00100000:2.0:1790773194.335093:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+12:11104:x1877761484423680:12345-192.168.202.19@tcp:101:bash.0 Request processed in 464us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773194.335100:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 48 00000100:00100000:3.0:1790773194.337568:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773194.337706:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484423936 00000100:00100000:1.0:1790773194.337724:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484423936 00000100:00100000:1.0:1790773194.337781:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 49 00000100:00100000:1.0:1790773194.337790:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+12:11104:x1877761484423936:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:1.0:1790773194.337810:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773194.337841:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7841cd8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bbcb expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.337935:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7841cdf lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.337949:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7841cdf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.337960:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7841cdf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.338017:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc7841ce6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.338025:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc7841ce6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.338032:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc7841ce6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790773194.338354:0:13768:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:1.0:1790773194.338634:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7841ced lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.338644:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7841ced lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.338652:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7841ced lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.338694:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7841cdf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.338724:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7841cdf lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.338731:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7841cdf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.338737:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12b600 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773194.338742:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7841cdf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.338750:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7841cdf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.338761:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93d14363d100) 00010000:00010000:1.0:1790773194.338764:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790773194.338768:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7841cdf lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.338774:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7841cdf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790773194.338786:0:13768:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000099603756 reply state 0000000095d0597b transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc7841ce6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.338797:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc7841ce6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.338803:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93d14363d300) 00010000:00010000:1.0:1790773194.338805:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790773194.338808:0:13768:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790773194.338835:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7841cd8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbcb expref: 15 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.338854:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7841ced lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbcb expref: 14 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.338862:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d14363d800) 00010000:00010000:1.0:1790773194.338864:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790773194.338866:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12be00, rc 0) 00000100:00100000:1.0:1790773194.338930:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+15:11104:x1877761484423936:12345-192.168.202.19@tcp:101:bash.0 Request processed in 1141us (1371us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1790773194.338938:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 49 00000100:00100000:3.0:1790773194.342341:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773194.342409:0:8393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484424064 00000100:00100000:0.0:1790773194.342419:0:8393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484424064 00000100:00100000:0.0:1790773194.342474:0:8393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 28 00000100:00100000:0.0:1790773194.342482:0:8393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2396:x1877761484424064:12345-192.168.202.19@tcp:8:bash.0 00010000:00080000:0.0:1790773194.342520:0:8393:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 110130ab-04fa-4d7c-984e-562032df4432@192.168.202.19@tcp t0 exp 0000000000000000 cur 337 last 0 00000020:00000080:0.0:1790773194.342551:0:8393:0:(genops.c:1384:class_connect()) connect: client 110130ab-04fa-4d7c-984e-562032df4432, cookie 0xabf1cc0bc7841cfb 00002000:00100000:0.0:1790773194.342565:0:8393:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 110130ab-04fa-4d7c-984e-562032df4432/ffff93d143f84000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b04 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790773194.342586:0:8393:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790773194.342674:0:8393:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790773194.342716:0:8393:0:(import.c:65:import_set_state_nolock()) ffff93d143f87800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790773194.342789:0:8393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:110130ab-04fa-4d7c-984e-562032df4432+6:2396:x1877761484424064:12345-192.168.202.19@tcp:8:bash.0 Request processed in 306us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773194.342797:0:8393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 28 00000100:00100000:3.0:1790773194.344912:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773194.345228:0:8906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484424192 00000100:00100000:0.0:1790773194.345238:0:8906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484424192 00000100:00080000:1.0:1790773194.345276:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790773194.345312:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 29 00000100:00100000:0.0:1790773194.345321:0:8906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:110130ab-04fa-4d7c-984e-562032df4432+6:0:x1877761484424192:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:0.0:1790773194.345338:0:8906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773194.345365:0:8906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031737337/0xabf1cc0bc7841d02 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bbd2 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790773194.345389:0:8906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790773194.345407:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=337s v=(0 0) 00010000:00010000:0.0:1790773194.345411:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790773194.345435:0:8906:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031737337/0xabf1cc0bc7841d02 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbd2 expref: 7 pid: 8906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.345451:0:8906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000031737337/0xabf1cc0bc7841d02 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbd2 expref: 7 pid: 8906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.345467:0:8906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074be00, rc 0) 00000100:00100000:0.0:1790773194.345510:0:8906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:110130ab-04fa-4d7c-984e-562032df4432+7:0:x1877761484424192:12345-192.168.202.19@tcp:101:bash.0 Request processed in 190us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773194.345517:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 29 00000100:00100000:3.0:1790773194.347757:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773194.348776:0:8394:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484424320 00000100:00100000:0.0:1790773194.348788:0:8394:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484424320 00000100:00100000:0.0:1790773194.348850:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 30 00000100:00100000:0.0:1790773194.348860:0:8394:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:110130ab-04fa-4d7c-984e-562032df4432+7:11104:x1877761484424320:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:0.0:1790773194.348877:0:8394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773194.348895:0:8394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009aacc60b/0xabf1cc0bc7841d09 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bbd9 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.348924:0:8394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000031737337/0xabf1cc0bc7841d02 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbd2 expref: 8 pid: 8906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.348933:0:8394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790773194.348937:0:8394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790773194.348942:0:8394:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009aacc60b/0xabf1cc0bc7841d09 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbd9 expref: 8 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.348977:0:8394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000031737337/0xabf1cc0bc7841d02 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbd2 expref: 8 pid: 8906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.349009:0:8394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000031737337/0xabf1cc0bc7841d02 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbd2 expref: 8 pid: 8906 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773194.349024:0:8394:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f984000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8394:1877761496048000:192.168.202.19@tcp:104: 00000100:00100000:0.0:1790773194.349110:0:8394:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2465e0240 going to sleep for 11 seconds 00000100:00100000:3.0:1790773194.351475:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773194.351580:0:6463:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484424448 00000100:00100000:1.0:1790773194.351592:0:6463:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484424448 00010000:00010000:1.0:1790773194.351631:0:6463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000031737337/0xabf1cc0bc7841d02 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbd2 expref: 9 pid: 8906 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773194.351673:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 53 00000100:00100000:1.0:1790773194.351691:0:6463:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:110130ab-04fa-4d7c-984e-562032df4432+9:2398:x1877761484424448:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790773194.351705:0:6463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790773194.351739:0:6463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000031737337/0xabf1cc0bc7841d02 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbd2 expref: 9 pid: 8906 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.351753:0:6463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000031737337/0xabf1cc0bc7841d02 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbd2 expref: 9 pid: 8906 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.351779:0:6463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790773194.351795:0:6463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790773194.351803:0:6463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009aacc60b/0xabf1cc0bc7841d09 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbd9 expref: 9 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.351814:0:6463:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009aacc60b/0xabf1cc0bc7841d09 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbd9 expref: 9 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.351850:0:6463:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009aacc60b/0xabf1cc0bc7841d09 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbd9 expref: 9 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773194.351864:0:6463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6463:1877761496048128:192.168.202.19@tcp:105: 00000100:00100000:1.0:1790773194.351948:0:6463:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d252f7d9c0 going to sleep for 11 seconds 00010000:00010000:0.0:1790773194.352296:0:8394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031737337/0xabf1cc0bc7841d02 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbd2 expref: 9 pid: 8906 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773194.352312:0:8394:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f984000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8394:1877761496048000:192.168.202.19@tcp:104: 00010000:00010000:0.0:1790773194.352336:0:8394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009aacc60b/0xabf1cc0bc7841d09 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbd9 expref: 8 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.352347:0:8394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074a800, rc 0) 00000100:00100000:0.0:1790773194.352384:0:8394:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:110130ab-04fa-4d7c-984e-562032df4432+8:11104:x1877761484424320:12345-192.168.202.19@tcp:101:bash.0 Request processed in 3525us (4635us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773194.352391:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 30 00000100:00100000:1.0:1790773194.355342:0:6463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6463:1877761496048128:192.168.202.19@tcp:105: 00010000:00010000:1.0:1790773194.355367:0:6463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790773194.355462:0:6463:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:110130ab-04fa-4d7c-984e-562032df4432+7:2398:x1877761484424448:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 3780us (3997us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773194.355474:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 53 00000100:00100000:2.0:1790773194.358940:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773194.359009:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484424704 00000100:00100000:3.0:1790773194.359017:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484424704 00000100:00100000:3.0:1790773194.359069:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:3.0:1790773194.359078:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:110130ab-04fa-4d7c-984e-562032df4432+15:11104:x1877761484424704:12345-192.168.202.19@tcp:35:bash.0 00000100:00100000:3.0:1790773194.359397:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:110130ab-04fa-4d7c-984e-562032df4432+16:11104:x1877761484424704:12345-192.168.202.19@tcp:35:bash.0 Request processed in 319us (465us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1790773194.359404:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:3.0:1790773194.453903:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773194.454009:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484424960 00000100:00100000:0.0:1790773194.454020:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484424960 00000100:00100000:0.0:1790773194.454087:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 50 00000100:00100000:0.0:1790773194.454097:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+16:11114:x1877761484424960:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:0.0:1790773194.454124:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773194.454144:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc7841d10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bbe0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790773194.454312:0:6480:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1790773194.454534:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc7841d10 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbe0 expref: 18 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.454549:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d26ede0f00) 00010000:00010000:0.0:1790773194.454553:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790773194.454558:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc7841d10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbe0 expref: 18 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.454573:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074be00, rc 0) 00000100:00100000:0.0:1790773194.454635:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+17:11114:x1877761484424960:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 539us (740us total) trans 4294967315 rc 301/301 00000100:00100000:0.0:1790773194.454642:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 50 00000100:00100000:1.0:1790773194.459695:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773194.459797:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484425216 00000100:00100000:3.0:1790773194.459806:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484425216 00000100:00100000:3.0:1790773194.459861:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:3.0:1790773194.459871:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:110130ab-04fa-4d7c-984e-562032df4432+17:11114:x1877761484425216:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:3.0:1790773194.465006:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:110130ab-04fa-4d7c-984e-562032df4432+18:11114:x1877761484425216:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 5123us (5315us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1790773194.465021:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:2.0:1790773194.563316:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773194.563497:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484425344 00000100:00100000:0.0:1790773194.563508:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484425344 00000100:00100000:0.0:1790773194.563570:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 51 00000100:00100000:0.0:1790773194.563580:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+18:11120:x1877761484425344:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:0.0:1790773194.563794:0:8697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773194.563816:0:8697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc7841d1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bbe7 expref: -99 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.563887:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7841d25 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.563903:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7841d25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.563933:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7841d25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790773194.563977:0:8697:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1790773194.563981:0:8697:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790773194.563999:0:8697:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7841d25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.564024:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc7841d1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbe7 expref: 20 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.564041:0:8697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7841d25 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbe7 expref: 19 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.564050:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93d14363d100) 00010000:00010000:0.0:1790773194.564053:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790773194.564056:0:8697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074b200, rc 0) 00000100:00100000:0.0:1790773194.564158:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+19:11120:x1877761484425344:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 578us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773194.564166:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 51 00010000:00010000:3.0:1790773194.573381:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773194.577005:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773194.578536:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484425600 00000100:00100000:1.0:1790773194.578552:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484425600 00000100:00100000:1.0:1790773194.578621:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 52 00000100:00100000:1.0:1790773194.578632:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+19:11120:x1877761484425600:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1790773194.578654:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773194.578676:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc7841d2c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bbee expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.578819:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7841d33 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.578835:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7841d33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.578847:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7841d33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790773194.578858:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1790773194.578964:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc7841d2c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbee expref: 22 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.578983:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7841d33 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbee expref: 21 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.578993:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d14363d800) 00010000:00010000:1.0:1790773194.578996:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790773194.578999:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12a400, rc 0) 00000100:00100000:1.0:1790773194.579072:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+21:11120:x1877761484425600:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 443us (2078us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1790773194.579080:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 52 00000100:00100000:1.0:1790773194.587884:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773194.587926:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773194.588046:0:6464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484425984 00000100:00100000:2.0:1790773194.588057:0:6464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484425984 00000100:00100000:2.0:1790773194.588124:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 3 00000100:00100000:2.0:1790773194.588134:0:6464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:110130ab-04fa-4d7c-984e-562032df4432+21:2398:x1877761484425984:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790773194.588150:0:6464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790773194.588176:0:6464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7841d33 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbee expref: 21 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773194.588194:0:6464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d14363d800) 00010000:00010000:2.0:1790773194.588199:0:6464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790773194.588274:0:6464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:110130ab-04fa-4d7c-984e-562032df4432+20:2398:x1877761484425984:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 141us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773194.588282:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 3 00000100:00100000:0.0:1790773194.588641:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484425856 00000100:00100000:0.0:1790773194.588647:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484425856 00000100:00100000:0.0:1790773194.588690:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 53 00000100:00100000:0.0:1790773194.588698:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+20:11120:x1877761484425856:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:0.0:1790773194.588723:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773194.588738:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc7841d41 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bbf5 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.588873:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7841d48 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.588888:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7841d48 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.588899:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7841d48 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790773194.588911:0:6480:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1790773194.589015:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc7841d41 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbf5 expref: 23 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.589031:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7841d48 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbf5 expref: 22 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.589040:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d14363d800) 00010000:00010000:0.0:1790773194.589043:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1790773194.589046:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074ae00, rc 0) 00000100:00100000:0.0:1790773194.589093:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+22:11120:x1877761484425856:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 396us (1221us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1790773194.589101:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 53 00000100:00100000:1.0:1790773194.600137:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773194.600242:0:8907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484426112 00000100:00100000:2.0:1790773194.600269:0:8907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484426112 00000100:00100000:2.0:1790773194.600365:0:8907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 31 00000100:00100000:2.0:1790773194.600387:0:8907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:110130ab-04fa-4d7c-984e-562032df4432+7:2399:x1877761484426112:12345-192.168.202.19@tcp:1:lfs.0 00010000:00010000:2.0:1790773194.600436:0:8907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cceac74/0xabf1cc0bc7841d56 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773194.600456:0:8907:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009aacc60b/0xabf1cc0bc7841d09 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbd9 expref: 7 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773194.600465:0:8907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790773194.600470:0:8907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790773194.600474:0:8907:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006cceac74/0xabf1cc0bc7841d56 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773194.600512:0:8907:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009aacc60b/0xabf1cc0bc7841d09 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbd9 expref: 7 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773194.600527:0:8907:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009aacc60b/0xabf1cc0bc7841d09 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbd9 expref: 7 pid: 8394 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773194.600541:0:8907:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:8907:1877761496048256:192.168.202.19@tcp:104: 00000100:00100000:2.0:1790773194.600632:0:8907:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c380240 going to sleep for 11 seconds 00000100:00100000:2.0:1790773194.605993:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773194.606095:0:8398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484426240 00000100:00100000:0.0:1790773194.606106:0:8398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484426240 00002000:00100000:0.0:1790773194.606155:0:8398:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff93d281b9df80 x1877761484426240/t0(0) o4->110130ab-04fa-4d7c-984e-562032df4432@192.168.202.19@tcp:30/0 lens 504/0 e 0 to 0 dl 1790773205 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790773194.606167:0:8398:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93d281b9df80 with x1877761484426240 ext(0->12) 00010000:00010000:0.0:1790773194.606194:0:8398:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009aacc60b/0xabf1cc0bc7841d09 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbd9 expref: 8 pid: 8394 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.606253:0:8398:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009aacc60b/0xabf1cc0bc7841d09 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbd9 expref: 8 pid: 8394 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790773194.606262:0:8398:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93d281b9df80 00000100:00100000:0.0:1790773194.606296:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:0.0:1790773194.606306:0:8398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:110130ab-04fa-4d7c-984e-562032df4432+8:2398:x1877761484426240:12345-192.168.202.19@tcp:4:lfs.0 00000100:00100000:3.0:1790773194.607037:0:8907:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:8907:1877761496048256:192.168.202.19@tcp:104: 00010000:00010000:3.0:1790773194.607070:0:8907:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006cceac74/0xabf1cc0bc7841d56 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1790773194.615559:0:8388:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 110130ab-04fa-4d7c-984e-562032df4432 00000100:00100000:0.0:1790773194.616488:0:8398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:110130ab-04fa-4d7c-984e-562032df4432+9:2398:x1877761484426240:12345-192.168.202.19@tcp:4:lfs.0 Request processed in 10175us (10498us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1790773194.616503:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 0 00002000:00100000:0.0:1790773194.616517:0:8398:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff93d281b9df80 x1877761484426240/t4294967300(0) o4->110130ab-04fa-4d7c-984e-562032df4432@192.168.202.19@tcp:30/0 lens 504/448 e 0 to 0 dl 1790773205 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790773194.616527:0:8398:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93d281b9df80 with x1877761484426240 ext(0->12) 00010000:00010000:0.0:1790773194.616538:0:8398:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009aacc60b/0xabf1cc0bc7841d09 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbd9 expref: 9 pid: 8394 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.616557:0:8398:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009aacc60b/0xabf1cc0bc7841d09 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbd9 expref: 9 pid: 8394 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790773194.616565:0:8398:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93d281b9df80 00000100:00100000:0.0:1790773194.619124:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773194.619250:0:6465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484426368 00000100:00100000:1.0:1790773194.619261:0:6465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484426368 00010000:00010000:1.0:1790773194.619303:0:6465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009aacc60b/0xabf1cc0bc7841d09 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbd9 expref: 9 pid: 8394 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773194.619364:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 54 00000100:00100000:1.0:1790773194.619434:0:6465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:110130ab-04fa-4d7c-984e-562032df4432+9:2398:x1877761484426368:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790773194.619452:0:6465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1790773194.619471:0:6465:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1790773194.619473:0:6465:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1790773194 00002000:00010000:1.0:1790773194.619476:0:6465:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1790773194 00002000:00010000:1.0:1790773194.619478:0:6465:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1790773194 00002000:00010000:1.0:1790773194.619480:0:6465:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1790773194.619486:0:6465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009aacc60b/0xabf1cc0bc7841d09 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbd9 expref: 9 pid: 8394 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.619500:0:6465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009aacc60b/0xabf1cc0bc7841d09 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbd9 expref: 9 pid: 8394 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.619526:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009aacc60b/0xabf1cc0bc7841d09 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbd9 expref: 9 pid: 8394 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.619546:0:6465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790773194.619550:0:6465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790773194.619556:0:6465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006cceac74/0xabf1cc0bc7841d56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.619566:0:6465:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006cceac74/0xabf1cc0bc7841d56 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.619742:0:6465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790773194.619807:0:6465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:110130ab-04fa-4d7c-984e-562032df4432+8:2398:x1877761484426368:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 435us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773194.619816:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 54 00010000:00010000:2.0:1790773194.625327:0:8907:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006cceac74/0xabf1cc0bc7841d56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773194.625347:0:8907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006cceac74/0xabf1cc0bc7841d56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773194.625412:0:8907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cceac74/0xabf1cc0bc7841d56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773194.625420:0:8907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006cceac74/0xabf1cc0bc7841d56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773194.625429:0:8907:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006cceac74/0xabf1cc0bc7841d56 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773194.625435:0:8907:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc4600 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:2.0:1790773194.625440:0:8907:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006cceac74/0xabf1cc0bc7841d56 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773194.625448:0:8907:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006cceac74/0xabf1cc0bc7841d56 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773194.625470:0:8907:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006cceac74/0xabf1cc0bc7841d56 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773194.625477:0:8907:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006cceac74/0xabf1cc0bc7841d56 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773194.625630:0:8907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:110130ab-04fa-4d7c-984e-562032df4432+7:2399:x1877761484426112:12345-192.168.202.19@tcp:1:lfs.0 Request processed in 25250us (25500us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773194.625639:0:8907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 31 00000100:00100000:0.0:1790773194.637914:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773194.637984:0:6482:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484426624 00000100:00100000:2.0:1790773194.637994:0:6482:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484426624 00000100:00100000:2.0:1790773194.638047:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 8 00000100:00100000:2.0:1790773194.638056:0:6482:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ca4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+22:11120:x1877761484426624:12345-192.168.202.19@tcp:35:lfs.0 00000004:00010000:2.0:1790773194.638118:0:6482:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7841d48 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbf5 expref: 22 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790773194.638387:0:6482:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:2.0:1790773194.638434:0:6482:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1790773194.638762:0:6482:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:2.0:1790773194.638801:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7841d5d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773194.638815:0:6482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7841ced lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbcb expref: 26 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773194.638824:0:6482:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7841d5d lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773194.638859:0:6482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7841ced lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbcb expref: 26 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773194.638873:0:6482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7841ced lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbcb expref: 26 pid: 13768 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773194.638888:0:6482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6482:1877761496048384:192.168.202.19@tcp:104: 00000100:00100000:2.0:1790773194.638985:0:6482:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c380240 going to sleep for 11 seconds 00000100:00100000:2.0:1790773194.642952:0:6482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6482:1877761496048384:192.168.202.19@tcp:104: 00010000:00010000:2.0:1790773194.643003:0:6482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7841d5d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773194.643498:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773194.643573:0:6463:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484426752 00000100:00100000:1.0:1790773194.643582:0:6463:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484426752 00010000:00010000:1.0:1790773194.643623:0:6463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7841ced lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbcb expref: 27 pid: 13768 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773194.643658:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 55 00000100:00100000:1.0:1790773194.643668:0:6463:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ca6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:110130ab-04fa-4d7c-984e-562032df4432+27:2398:x1877761484426752:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790773194.643690:0:6463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790773194.643698:0:6463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7841ced lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbcb expref: 27 pid: 13768 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.643710:0:6463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7841ced lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbcb expref: 27 pid: 13768 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.643749:0:6463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7841ced lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbcb expref: 27 pid: 13768 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.643767:0:6463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d14363d800) 00010000:00010000:1.0:1790773194.643772:0:6463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7841d5d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.643783:0:6463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7841d5d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.643800:0:6463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7841d5d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.643833:0:6463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790773194.643889:0:6463:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ca6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:110130ab-04fa-4d7c-984e-562032df4432+26:2398:x1877761484426752:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 222us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773194.643896:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 55 00010000:00010000:0.0:1790773194.643953:0:6482:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7841d5d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.643966:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7841d5d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790773194.644080:0:6482:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:0.0:1790773194.644191:0:6482:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:0.0:1790773194.644317:0:6482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ca6d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6482:1877761496048512:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790773194.644370:0:6482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773194.644402:0:6482:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2465e0300 going to sleep for 11 seconds 00000100:00100000:1.0:1790773194.644461:0:6483:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496048512 00000100:00100000:1.0:1790773194.644467:0:6483:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496048512 00000100:00100000:1.0:1790773194.644506:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1790773194.644514:0:6483:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143dedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6482:x1877761496048512:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1790773194.644587:0:6483:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143dedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6482:x1877761496048512:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 74us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773194.644594:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1790773194.645251:0:6482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ca6d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6482:1877761496048512:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1790773194.645425:0:6482:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:0.0:1790773194.645479:0:6482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143dece00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6482:1877761496048640:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790773194.645517:0:6482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773194.645533:0:6482:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2465e0840 going to sleep for 11 seconds 00000100:00100000:3.0:1790773194.646424:0:12789:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496048640 00000100:00100000:3.0:1790773194.646434:0:12789:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496048640 00000100:00100000:3.0:1790773194.646490:0:12789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1790773194.646513:0:12789:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143defb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:6482:x1877761496048640:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1790773194.646686:0:12789:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143defb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:6482:x1877761496048640:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 165us (1158us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1790773194.646694:0:12789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1790773194.647034:0:6482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143dece00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6482:1877761496048640:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1790773194.647095:0:6482:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:0.0:1790773194.647143:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7841d5d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.647154:0:6482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7841d5d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.647162:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7841d5d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.647167:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc5000 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773194.647171:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7841d5d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.647192:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7841d5d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.647231:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d14363d800) 00010000:00010000:0.0:1790773194.647234:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1790773194.647240:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7841d5d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.647247:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7841d5d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790773194.647353:0:6482:0:(mdd_object.c:4189:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1790773194.651117:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1790773194.651144:0:6482:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 337452937710ns, next at 338452932663ns, rc = 0 00000001:00080000:0.0:1790773194.651160:0:6482:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:0.0:1790773194.651257:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d14363d800) 00010000:00010000:0.0:1790773194.651262:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1790773194.651274:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7841d48 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbf5 expref: 30 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773194.651428:0:6482:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ca4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+29:11120:x1877761484426624:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 13371us (13522us total) trans 4294967327 rc 0/0 00000100:00100000:0.0:1790773194.651437:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 8 00000020:00080000:0.0:1790773194.651444:0:6482:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1790773194.654861:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773194.654972:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484426880 00000100:00100000:2.0:1790773194.654983:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484426880 00000100:00100000:2.0:1790773194.655044:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 54 00000100:00100000:2.0:1790773194.655055:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143dec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+29:11120:x1877761484426880:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1790773194.655080:0:8697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773194.655103:0:8697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4600/0xabf1cc0bc7841d64 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bbfc expref: -99 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773194.655160:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4600/0xabf1cc0bc7841d64 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbfc expref: 30 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773194.655174:0:8697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4600/0xabf1cc0bc7841d64 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbfc expref: 30 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773194.655194:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d28095bf00) 00010000:00010000:2.0:1790773194.655197:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790773194.655201:0:8697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26efc4600, rc 0) 00000100:00100000:2.0:1790773194.655296:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143dec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+30:11120:x1877761484426880:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 242us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773194.655303:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 54 00000100:00100000:1.0:1790773194.663340:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773194.663483:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484427136 00000100:00100000:3.0:1790773194.663494:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484427136 00000100:00100000:3.0:1790773194.663541:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:3.0:1790773194.663551:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d279dba050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:110130ab-04fa-4d7c-984e-562032df4432+30:11120:x1877761484427136:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:3.0:1790773194.663962:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d279dba050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:110130ab-04fa-4d7c-984e-562032df4432+31:11120:x1877761484427136:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 411us (630us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1790773194.663971:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:3.0:1790773194.735489:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773194.735568:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484427392 00000100:00100000:1.0:1790773194.735577:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484427392 00000100:00100000:1.0:1790773194.735639:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 55 00000100:00100000:1.0:1790773194.735649:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+31:11130:x1877761484427392:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1790773194.735673:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773194.735706:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc7841d6b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bc03 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790773194.735823:0:6479:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1790773194.735929:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc7841d6b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc03 expref: 33 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.735963:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d26ede0f00) 00010000:00010000:1.0:1790773194.735966:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790773194.735972:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc7841d6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc03 expref: 33 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.735987:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12b200, rc 0) 00000100:00100000:1.0:1790773194.736059:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+32:11130:x1877761484427392:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 411us (581us total) trans 4294967329 rc 301/301 00000100:00100000:1.0:1790773194.736067:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 55 00000100:00100000:1.0:1790773194.737710:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773194.737777:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484427520 00000100:00100000:0.0:1790773194.737786:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484427520 00000100:00100000:0.0:1790773194.737848:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 56 00000100:00100000:0.0:1790773194.737858:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+32:11130:x1877761484427520:12345-192.168.202.19@tcp:34:lfs.0 00010000:00010000:0.0:1790773194.737934:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7841d79 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.737952:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7841d79 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.737964:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7841d79 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.737976:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc7841d80 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.737982:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc7841d80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.737988:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc7841d80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.738058:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc7841d87 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.738066:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc7841d87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.738073:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc7841d87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790773194.738115:0:6478:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc7841d87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.738129:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7841d79 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.738145:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7841d79 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.738152:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7841d79 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.738158:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074ae00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773194.738162:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7841d79 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.738170:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7841d79 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.738179:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93d14363d100) 00010000:00010000:0.0:1790773194.738183:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773194.738188:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7841d79 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.738194:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7841d79 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.738238:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc7841d80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.738245:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc7841d80 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.738251:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc7841d80 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.738257:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074bc00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773194.738266:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc7841d80 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.738272:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc7841d80 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.738280:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93d14363d300) 00010000:00010000:0.0:1790773194.738283:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773194.738286:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc7841d80 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.738291:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc7841d80 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.738302:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc7841d87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.738308:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc7841d87 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.738313:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc7841d87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.738319:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074a800 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773194.738322:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc7841d87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.738328:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc7841d87 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.738335:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d28095bf00) 00010000:00010000:0.0:1790773194.738337:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773194.738346:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc7841d87 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.738352:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc7841d87 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773194.738417:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+32:11130:x1877761484427520:12345-192.168.202.19@tcp:34:lfs.0 Request processed in 561us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773194.738426:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 56 00000100:00100000:3.0:1790773194.739935:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773194.740316:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484427776 00000100:00100000:0.0:1790773194.740326:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484427776 00000100:00100000:0.0:1790773194.740427:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:0.0:1790773194.740435:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:110130ab-04fa-4d7c-984e-562032df4432+32:11130:x1877761484427776:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:0.0:1790773194.740652:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:110130ab-04fa-4d7c-984e-562032df4432+33:11130:x1877761484427776:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 218us (723us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1790773194.740658:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:3.0:1790773194.779851:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773194.780430:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484428032 00000100:00100000:1.0:1790773194.780441:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484428032 00000100:00100000:1.0:1790773194.780504:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 57 00000100:00100000:1.0:1790773194.780513:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2412ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+33:11133:x1877761484428032:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1790773194.780537:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773194.780557:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc7841d8e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bc0a expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.780632:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7841d95 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.780646:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7841d95 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.780656:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7841d95 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.780691:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc7841d9c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.780699:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc7841d9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.780706:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc7841d9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.780934:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc7841da3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.780942:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc7841da3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.780950:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc7841da3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790773194.780959:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1790773194.781296:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7841d95 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.781305:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7841d95 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.781311:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7841d95 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.781317:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12bc00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773194.781320:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7841d95 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.781337:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7841d95 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.781349:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93d14363d100) 00010000:00010000:1.0:1790773194.781351:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790773194.781355:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7841d95 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.781361:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7841d95 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.781436:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc7841d9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.781443:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc7841d9c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.781449:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc7841d9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.781454:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12a800 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773194.781457:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc7841d9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.781462:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc7841d9c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.781469:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93d14363d300) 00010000:00010000:1.0:1790773194.781471:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790773194.781474:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc7841d9c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.781489:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc7841d9c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.781624:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc7841d8e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc0a expref: 36 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.781640:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc7841da3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc0a expref: 35 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773194.781647:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d28095bf00) 00010000:00010000:1.0:1790773194.781649:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790773194.781651:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12ac00, rc 0) 00000100:00100000:1.0:1790773194.781830:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2412ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+35:11133:x1877761484428032:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 1316us (1989us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1790773194.781838:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 57 00000100:00100000:1.0:1790773194.785474:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773194.785567:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484428160 00000100:00100000:0.0:1790773194.785579:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484428160 00000100:00100000:0.0:1790773194.785657:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 58 00000100:00100000:0.0:1790773194.785667:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+35:11133:x1877761484428160:12345-192.168.202.19@tcp:54:lfs.0 00010000:00010000:0.0:1790773194.785755:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc7841db1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.785773:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc7841db1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.785786:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc7841db1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.785819:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc7841db1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.785831:0:6480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc7841db1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.785838:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc7841db1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.785844:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074a800 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773194.785848:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc7841db1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.785856:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc7841db1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.785866:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d28095bf00) 00010000:00010000:0.0:1790773194.785869:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790773194.785873:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc7841db1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773194.785879:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc7841db1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773194.785945:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+35:11133:x1877761484428160:12345-192.168.202.19@tcp:54:lfs.0 Request processed in 280us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773194.785953:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 58 00000100:00100000:3.0:1790773194.790483:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773194.790588:0:6482:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484428416 00000100:00100000:2.0:1790773194.790598:0:6482:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484428416 00000100:00100000:2.0:1790773194.790651:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00100000:2.0:1790773194.790660:0:6482:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2412ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+35:11133:x1877761484428416:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:2.0:1790773194.790996:0:6482:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2412ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+36:11133:x1877761484428416:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 336us (523us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1790773194.791004:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00100000:3.0:1790773194.979698:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773194.979809:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484428672 00000100:00100000:2.0:1790773194.979821:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484428672 00000100:00100000:2.0:1790773194.980031:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 59 00000100:00100000:2.0:1790773194.980052:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2412adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+36:11164:x1877761484428672:12345-192.168.202.19@tcp:101:cat.0 00010000:00010000:2.0:1790773194.980078:0:8697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773194.980099:0:8697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc7841db8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bc11 expref: -99 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773194.980200:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc7841dbf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773194.980266:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc7841dbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773194.980278:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc7841dbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790773194.980290:0:8697:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1790773194.980413:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc7841db8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc11 expref: 39 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773194.980433:0:8697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc7841dbf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc11 expref: 38 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773194.980443:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d28095bf00) 00010000:00010000:2.0:1790773194.980729:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790773194.980734:0:8697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26efc4c00, rc 0) 00000100:00100000:2.0:1790773194.980808:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2412adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+38:11164:x1877761484428672:12345-192.168.202.19@tcp:101:cat.0 Request processed in 758us (1134us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1790773194.980817:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 59 00000100:00100000:1.0:1790773194.984493:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773194.984579:0:8410:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484428800 00000100:00100000:3.0:1790773194.984589:0:8410:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484428800 00000100:00100000:3.0:1790773194.984660:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00100000:3.0:1790773194.984670:0:8410:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:110130ab-04fa-4d7c-984e-562032df4432+38:2400:x1877761484428800:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790773194.984717:0:8410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773194.984743:0:8410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc7841dbf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc11 expref: 38 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773194.984763:0:8410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d28095bf00) 00010000:00010000:3.0:1790773194.984768:0:8410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790773194.984847:0:8410:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:110130ab-04fa-4d7c-984e-562032df4432+37:2400:x1877761484428800:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 179us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773194.984856:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00100000:3.0:1790773194.985420:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773194.985606:0:6482:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484429056 00000100:00100000:2.0:1790773194.985614:0:6482:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484429056 00000100:00100000:2.0:1790773194.985704:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00100000:2.0:1790773194.985713:0:6482:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2412ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+37:11164:x1877761484429056:12345-192.168.202.19@tcp:35:cat.0 00000100:00100000:2.0:1790773194.985929:0:6482:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2412ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+38:11164:x1877761484429056:12345-192.168.202.19@tcp:35:cat.0 Request processed in 217us (511us total) trans 4294967334 rc 0/0 00000100:00100000:2.0:1790773194.985937:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00100000:1.0:1790773195.050320:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773195.050477:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484429312 00000100:00100000:0.0:1790773195.050487:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484429312 00000100:00100000:0.0:1790773195.050540:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 60 00000100:00100000:0.0:1790773195.050549:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+38:11170:x1877761484429312:12345-192.168.202.19@tcp:101:dd.0 00010000:00010000:0.0:1790773195.050571:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773195.050585:0:13768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790773195.050609:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7841d25 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbe7 expref: 38 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.050632:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93d14363d100) 00010000:00010000:0.0:1790773195.050637:0:13768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790773195.050650:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc7841dcd lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bc18 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.050770:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc7841dd4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.050786:0:13768:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc7841da3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc0a expref: 38 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.050794:0:13768:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc7841dd4 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.050829:0:13768:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc7841da3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc0a expref: 38 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.050842:0:13768:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc7841da3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc0a expref: 38 pid: 13768 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773195.050854:0:13768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ca4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13768:1877761496048768:192.168.202.19@tcp:104: 00000100:00100000:0.0:1790773195.050935:0:13768:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d241359840 going to sleep for 11 seconds 00000100:00100000:1.0:1790773195.054054:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773195.054331:0:6465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484429440 00000100:00100000:2.0:1790773195.054341:0:6465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484429440 00010000:00010000:2.0:1790773195.054395:0:6465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc7841da3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc0a expref: 39 pid: 13768 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773195.054436:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 56 00000100:00100000:2.0:1790773195.054456:0:6465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:110130ab-04fa-4d7c-984e-562032df4432+39:2398:x1877761484429440:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790773195.054471:0:6465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790773195.054478:0:6465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc7841da3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc0a expref: 39 pid: 13768 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.054492:0:6465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc7841da3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc0a expref: 39 pid: 13768 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.054515:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d28095bf00) 00010000:00010000:2.0:1790773195.054533:0:6465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc7841dd4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.054542:0:6465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc7841dd4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.054550:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc7841dd4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.054570:0:6465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790773195.054631:0:6465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:110130ab-04fa-4d7c-984e-562032df4432+39:2398:x1877761484429440:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 186us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773195.054639:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 56 00010000:00010000:0.0:1790773195.055713:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc7841da3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc0a expref: 38 pid: 13768 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773195.055752:0:13768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ca4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13768:1877761496048768:192.168.202.19@tcp:104: 00010000:00010000:0.0:1790773195.055774:0:13768:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc7841dd4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.055784:0:13768:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc7841dd4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.055791:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc7841dd4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790773195.055810:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1790773195.055971:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc7841dcd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc18 expref: 39 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.055987:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc7841dd4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc18 expref: 38 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.055994:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d28095bf00) 00010000:00010000:0.0:1790773195.055997:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790773195.056000:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074bc00, rc 0) 00000100:00100000:0.0:1790773195.056161:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+38:11170:x1877761484429312:12345-192.168.202.19@tcp:101:dd.0 Request processed in 5612us (5852us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1790773195.056169:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 60 00000100:00100000:1.0:1790773195.059412:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773195.059602:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484429568 00000100:00100000:0.0:1790773195.059613:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484429568 00000100:00100000:0.0:1790773195.059667:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 61 00000100:00100000:0.0:1790773195.059687:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+38:11170:x1877761484429568:12345-192.168.202.19@tcp:101:dd.0 00010000:00010000:0.0:1790773195.059785:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773195.059808:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7841de2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bc1f expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.059843:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc7841de9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.059859:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc7841de9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.059871:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc7841de9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.059981:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7841de2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc1f expref: 40 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.060000:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc7841de9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc1f expref: 39 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.060009:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d28095bf00) 00010000:00010000:0.0:1790773195.060013:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790773195.060016:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074be00, rc 0) 00000100:00100000:0.0:1790773195.060346:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+39:11170:x1877761484429568:12345-192.168.202.19@tcp:101:dd.0 Request processed in 670us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773195.060354:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 61 00000100:00100000:3.0:1790773195.064979:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773195.065062:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484429824 00000100:00100000:2.0:1790773195.065073:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484429824 00000100:00100000:2.0:1790773195.065135:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 62 00000100:00100000:2.0:1790773195.065145:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2412aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+39:11170:x1877761484429824:12345-192.168.202.19@tcp:36:dd.0 00010000:00010000:2.0:1790773195.065410:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc7841df0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.065431:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc7841df0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.065443:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc7841df0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790773195.065499:0:8697:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:2.0:1790773195.065519:0:8697:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000000cc7a71c reply state 000000001dcd081d transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc7841df0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.065531:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc7841df0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.065551:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d28095bf00) 00010000:00010000:2.0:1790773195.065554:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790773195.065557:0:8697:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790773195.066157:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2412aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+42:11170:x1877761484429824:12345-192.168.202.19@tcp:36:dd.0 Request processed in 1010us (1186us total) trans 4294967337 rc 0/0 00000100:00100000:2.0:1790773195.066166:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 62 00000020:00080000:2.0:1790773195.066172:0:8697:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1790773195.454576:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773195.454729:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484429952 00000100:00100000:0.0:1790773195.454742:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484429952 00000100:00100000:0.0:1790773195.454814:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 63 00000100:00100000:0.0:1790773195.454825:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2412adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+42:11184:x1877761484429952:12345-192.168.202.19@tcp:101:stat.0 00010000:00010000:0.0:1790773195.454871:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773195.454890:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7841df7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bc26 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.454966:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc7841dfe lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.454980:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc7841dfe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.454993:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc7841dfe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.455003:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7841e05 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.455009:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7841e05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.455016:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7841e05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.455079:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7841e0c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.455088:0:13768:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc7841dd4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc18 expref: 43 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.455096:0:13768:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7841e0c lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.455128:0:13768:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc7841dd4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc18 expref: 43 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.455147:0:13768:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc7841dd4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc18 expref: 43 pid: 13768 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773195.455164:0:13768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ca4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13768:1877761496048896:192.168.202.19@tcp:104: 00000100:00100000:0.0:1790773195.455499:0:13768:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d241359840 going to sleep for 11 seconds 00000100:00100000:1.0:1790773195.465116:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773195.465126:0:13768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ca4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13768:1877761496048896:192.168.202.19@tcp:104: 00010000:00010000:0.0:1790773195.465154:0:13768:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7841e0c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773195.465330:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484430208 00000100:00100000:3.0:1790773195.465336:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484430208 00000100:00100000:3.0:1790773195.465387:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 13 00000100:00100000:3.0:1790773195.465396:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:110130ab-04fa-4d7c-984e-562032df4432+44:6167:x1877761484430208:12345-192.168.202.19@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1790773195.465681:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:110130ab-04fa-4d7c-984e-562032df4432+45:6167:x1877761484430208:12345-192.168.202.19@tcp:35:ldlm_bl.0 Request processed in 275us (564us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1790773195.465690:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 13 00000100:00100000:1.0:1790773195.477729:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773195.477824:0:6464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484430336 00000100:00100000:2.0:1790773195.477834:0:6464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484430336 00010000:00010000:2.0:1790773195.477881:0:6464:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc7841dd4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc18 expref: 45 pid: 13768 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773195.477929:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 57 00000100:00100000:2.0:1790773195.477940:0:6464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512c8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:110130ab-04fa-4d7c-984e-562032df4432+45:2398:x1877761484430336:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790773195.477961:0:6464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790773195.477969:0:6464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc7841dd4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc18 expref: 45 pid: 13768 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.477982:0:6464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc7841dd4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc18 expref: 45 pid: 13768 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.478015:0:6464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc7841dd4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc18 expref: 45 pid: 13768 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.478032:0:6464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d28095bf00) 00010000:00010000:2.0:1790773195.478038:0:6464:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7841e0c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.478069:0:6464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7841e0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.478077:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7841e0c lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.478119:0:6464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790773195.478180:0:6464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512c8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:110130ab-04fa-4d7c-984e-562032df4432+44:2398:x1877761484430336:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 242us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773195.478195:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 57 00010000:00010000:0.0:1790773195.478479:0:13768:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7841e0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.478488:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7841e0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790773195.478549:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1790773195.478554:0:13768:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790773195.478614:0:13768:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7841e0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.478628:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7841e0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.478638:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc7841dfe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.478645:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc7841dfe lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.478661:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc7841dfe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.478666:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074a800 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773195.478682:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc7841dfe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.478690:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc7841dfe lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.478699:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93d14363d100) 00010000:00010000:0.0:1790773195.478702:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773195.480600:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc7841dfe lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.480616:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc7841dfe lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.480636:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7841e05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.480642:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7841e05 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.480648:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7841e05 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.480653:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074b200 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773195.480657:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7841e05 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.480691:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7841e05 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.480715:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93d14363d300) 00010000:00010000:0.0:1790773195.480719:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773195.480724:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7841e05 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.480730:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7841e05 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.480793:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7841df7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc26 expref: 44 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.480820:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7841e0c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc26 expref: 43 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.480826:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d28095bf00) 00010000:00010000:0.0:1790773195.480828:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790773195.480831:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074b000, rc 0) 00000100:00100000:0.0:1790773195.480919:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2412adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+43:11184:x1877761484429952:12345-192.168.202.19@tcp:101:stat.0 Request processed in 26095us (26351us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773195.480930:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 63 00010000:00010000:0.0:1790773195.597570:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773195.601985:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773195.602081:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484430592 00000100:00100000:0.0:1790773195.602091:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484430592 00000100:00100000:0.0:1790773195.602151:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 64 00000100:00100000:0.0:1790773195.602162:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+43:11190:x1877761484430592:12345-192.168.202.19@tcp:36:truncate.0 00010000:00010000:0.0:1790773195.602258:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773195.602285:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7841e0c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc26 expref: 43 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.602303:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d28095bf00) 00010000:00010000:0.0:1790773195.602307:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790773195.602478:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7841e13 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.602492:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7841e13 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.602503:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7841e13 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790773195.602541:0:6480:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:0.0:1790773195.602559:0:6480:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000006003d3ad reply state 00000000cd9fdb84 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7841e13 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.602570:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7841e13 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.602577:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d28095bf00) 00010000:00010000:0.0:1790773195.602579:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790773195.602582:0:6480:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790773195.602701:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+45:11190:x1877761484430592:12345-192.168.202.19@tcp:36:truncate.0 Request processed in 540us (727us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1790773195.602709:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 64 00000020:00080000:0.0:1790773195.602715:0:6480:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1790773195.763307:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773195.763506:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484430720 00000100:00100000:2.0:1790773195.763517:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484430720 00000100:00100000:2.0:1790773195.763589:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 65 00000100:00100000:2.0:1790773195.763600:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2412ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+45:11204:x1877761484430720:12345-192.168.202.19@tcp:101:stat.0 00010000:00010000:2.0:1790773195.763627:0:8697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773195.763649:0:8697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7841e1a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bc2d expref: -99 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.763739:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc7841e21 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.763757:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc7841e21 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.763769:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc7841e21 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.763781:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc7841e28 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.763811:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc7841e28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.763818:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc7841e28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.763904:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc7841e2f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.763914:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc7841e2f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.763921:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc7841e2f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790773195.763979:0:8697:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1790773195.763984:0:8697:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790773195.764008:0:8697:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc7841e2f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.764020:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc7841e2f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.764030:0:8697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc7841e21 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.764037:0:8697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc7841e21 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.764045:0:8697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc7841e21 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.764061:0:8697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc4e00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:2.0:1790773195.764067:0:8697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc7841e21 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.764076:0:8697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc7841e21 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.764090:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93d14363d100) 00010000:00010000:2.0:1790773195.764093:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790773195.764098:0:8697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc7841e21 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.764105:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc7841e21 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.764119:0:8697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc7841e28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.764125:0:8697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc7841e28 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.764130:0:8697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc7841e28 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.764134:0:8697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc4200 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:2.0:1790773195.764137:0:8697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc7841e28 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.764143:0:8697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc7841e28 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.764162:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93d14363d300) 00010000:00010000:2.0:1790773195.764164:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790773195.764167:0:8697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc7841e28 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.764173:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc7841e28 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.764623:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7841e1a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc2d expref: 47 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.764646:0:8697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc7841e2f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc2d expref: 46 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.764654:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d28095bf00) 00010000:00010000:2.0:1790773195.764656:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790773195.764659:0:8697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26efc4c00, rc 0) 00000100:00100000:2.0:1790773195.764747:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2412ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+46:11204:x1877761484430720:12345-192.168.202.19@tcp:101:stat.0 Request processed in 1149us (1449us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773195.764756:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 65 00000100:00100000:3.0:1790773195.869005:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773195.869921:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484430976 00000100:00100000:0.0:1790773195.869953:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484430976 00000100:00100000:0.0:1790773195.870049:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 66 00000100:00100000:0.0:1790773195.870068:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2412ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+46:11214:x1877761484430976:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:0.0:1790773195.870096:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773195.870118:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7841e36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bc34 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790773195.870296:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1790773195.870401:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7841e36 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc34 expref: 48 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.870415:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d26ede0f00) 00010000:00010000:0.0:1790773195.870418:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790773195.870423:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7841e36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc34 expref: 48 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.870437:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074b000, rc 0) 00000100:00100000:0.0:1790773195.870685:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2412ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+47:11214:x1877761484430976:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 626us (1691us total) trans 4294967341 rc 301/301 00000100:00100000:0.0:1790773195.870693:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 66 00000100:00100000:1.0:1790773195.876814:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773195.876918:0:6482:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484431232 00000100:00100000:2.0:1790773195.876929:0:6482:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484431232 00000100:00100000:2.0:1790773195.876997:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 14 00000100:00100000:2.0:1790773195.877008:0:6482:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+47:11214:x1877761484431232:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:2.0:1790773195.877285:0:6482:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+48:11214:x1877761484431232:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 278us (479us total) trans 4294967342 rc 0/0 00000100:00100000:2.0:1790773195.877293:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 14 00000100:00100000:3.0:1790773195.927159:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773195.927434:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484431488 00000100:00100000:1.0:1790773195.927620:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484431488 00000100:00100000:1.0:1790773195.927689:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 67 00000100:00100000:1.0:1790773195.927721:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2412aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+48:11220:x1877761484431488:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:1.0:1790773195.927749:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773195.927772:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7841e44 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bc3b expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773195.927886:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7841e4b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773195.927903:0:6478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc7841e2f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc2d expref: 49 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773195.927913:0:6478:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7841e4b lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773195.927955:0:6478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc7841e2f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc2d expref: 49 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773195.927970:0:6478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc7841e2f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc2d expref: 49 pid: 8697 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773195.927984:0:6478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1877761496049024:192.168.202.19@tcp:104: 00000100:00100000:1.0:1790773195.929417:0:6478:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d252f7d540 going to sleep for 11 seconds 00000100:00100000:1.0:1790773195.941833:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773195.941875:0:6478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1877761496049024:192.168.202.19@tcp:104: 00010000:00010000:0.0:1790773195.941909:0:6478:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7841e4b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773195.941931:0:10300:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484431616 00000100:00100000:3.0:1790773195.941940:0:10300:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484431616 00010000:00010000:3.0:1790773195.941975:0:10300:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc7841e2f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc2d expref: 50 pid: 8697 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773195.942020:0:10300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 58 00000100:00100000:3.0:1790773195.942029:0:10300:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:110130ab-04fa-4d7c-984e-562032df4432+50:2398:x1877761484431616:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790773195.942044:0:10300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773195.942049:0:10300:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc7841e2f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc2d expref: 50 pid: 8697 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773195.942078:0:10300:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc7841e2f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc2d expref: 50 pid: 8697 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773195.942099:0:10300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc7841e2f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc2d expref: 50 pid: 8697 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773195.942113:0:10300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d28095bf00) 00010000:00010000:3.0:1790773195.942118:0:10300:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7841e4b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773195.942127:0:10300:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7841e4b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773195.942135:0:10300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7841e4b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773195.942156:0:10300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790773195.942282:0:10300:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:110130ab-04fa-4d7c-984e-562032df4432+49:2398:x1877761484431616:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 253us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773195.942289:0:10300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 58 00010000:00010000:0.0:1790773195.942367:0:6478:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7841e4b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.942377:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7841e4b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790773195.942415:0:6478:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1790773195.942572:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7841e44 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc3b expref: 50 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.942589:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7841e4b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc3b expref: 49 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.942596:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d28095bf00) 00010000:00010000:0.0:1790773195.942599:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790773195.942602:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12bc00, rc 0) 00000100:00100000:0.0:1790773195.942652:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2412aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+49:11220:x1877761484431488:12345-192.168.202.19@tcp:101:bash.0 Request processed in 14933us (15503us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1790773195.942661:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 67 00000100:00100000:1.0:1790773195.947492:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773195.947748:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484431872 00000100:00100000:2.0:1790773195.947761:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484431872 00000100:00100000:2.0:1790773195.948661:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 68 00000100:00100000:2.0:1790773195.948688:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+49:11220:x1877761484431872:12345-192.168.202.19@tcp:36:bash.0 00010000:00010000:2.0:1790773195.948957:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7841e59 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.948977:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7841e59 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.948988:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7841e59 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790773195.949049:0:8697:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:2.0:1790773195.949074:0:8697:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000cc86f094 reply state 0000000027b48d2f transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7841e59 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.949087:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7841e59 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.949095:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d28095bf00) 00010000:00010000:2.0:1790773195.949098:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790773195.949101:0:8697:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790773195.949341:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+52:11220:x1877761484431872:12345-192.168.202.19@tcp:36:bash.0 Request processed in 524us (1723us total) trans 4294967345 rc 0/0 00000100:00100000:2.0:1790773195.949350:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 68 00000020:00080000:2.0:1790773195.949355:0:8697:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1790773195.957782:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773195.957943:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484432000 00000100:00100000:2.0:1790773195.957952:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484432000 00000100:00100000:2.0:1790773195.958013:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 69 00000100:00100000:2.0:1790773195.958020:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+52:11220:x1877761484432000:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:2.0:1790773195.958060:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773195.958080:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc7841e60 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bc42 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.958808:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc7841e67 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.958900:0:6480:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7841e4b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc3b expref: 53 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.958910:0:6480:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc7841e67 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.958950:0:6480:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7841e4b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc3b expref: 53 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.958966:0:6480:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7841e4b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc3b expref: 53 pid: 6478 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773195.958981:0:6480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6480:1877761496049152:192.168.202.19@tcp:104: 00000100:00100000:2.0:1790773195.959080:0:6480:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c144c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790773195.963424:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773195.963622:0:6463:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484432128 00000100:00100000:0.0:1790773195.963634:0:6463:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484432128 00010000:00010000:0.0:1790773195.963691:0:6463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7841e4b lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc3b expref: 54 pid: 6478 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773195.963739:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 59 00000100:00100000:0.0:1790773195.963750:0:6463:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:110130ab-04fa-4d7c-984e-562032df4432+54:2397:x1877761484432128:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790773195.963768:0:6463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773195.963775:0:6463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7841e4b lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc3b expref: 54 pid: 6478 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.963788:0:6463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7841e4b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc3b expref: 54 pid: 6478 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.963843:0:6463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d28095bf00) 00010000:00010000:0.0:1790773195.963849:0:6463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc7841e67 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.963860:0:6463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc7841e67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.963869:0:6463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc7841e67 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773195.963888:0:6463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790773195.963950:0:6463:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:110130ab-04fa-4d7c-984e-562032df4432+54:2397:x1877761484432128:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 201us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773195.963958:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 59 00010000:00010000:2.0:1790773195.965968:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7841e4b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc3b expref: 53 pid: 6478 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773195.965993:0:6480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6480:1877761496049152:192.168.202.19@tcp:104: 00010000:00010000:2.0:1790773195.966017:0:6480:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc7841e67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.966045:0:6480:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc7841e67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.966051:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc7841e67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790773195.966114:0:6480:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1790773195.966118:0:6480:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790773195.966140:0:6480:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc7841e67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.966171:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc7841e60 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc42 expref: 53 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.966186:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc7841e67 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc42 expref: 52 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773195.966193:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d28095bf00) 00010000:00010000:2.0:1790773195.966195:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790773195.966197:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26efc4e00, rc 0) 00000100:00100000:2.0:1790773195.966277:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+52:11220:x1877761484432000:12345-192.168.202.19@tcp:101:bash.0 Request processed in 8258us (8508us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773195.966284:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 69 00000100:00100000:1.0:1790773195.969258:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773195.970741:0:6482:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484432384 00000100:00100000:2.0:1790773195.970754:0:6482:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484432384 00000100:00100000:2.0:1790773195.970851:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 15 00000100:00100000:2.0:1790773195.970861:0:6482:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d279dba850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+52:11220:x1877761484432384:12345-192.168.202.19@tcp:35:bash.0 00000100:00100000:2.0:1790773195.971081:0:6482:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d279dba850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+53:11220:x1877761484432384:12345-192.168.202.19@tcp:35:bash.0 Request processed in 222us (1830us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1790773195.971101:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 15 00000100:00100000:1.0:1790773196.029863:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773196.030045:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484432640 00000100:00100000:0.0:1790773196.030057:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484432640 00000100:00100000:0.0:1790773196.030144:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 70 00000100:00100000:0.0:1790773196.030156:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+53:11230:x1877761484432640:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:0.0:1790773196.030187:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773196.030254:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7841e6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bc49 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790773196.030373:0:6478:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1790773196.030478:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7841e6e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc49 expref: 55 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773196.030494:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d26ede0f00) 00010000:00010000:0.0:1790773196.030504:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790773196.030511:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7841e6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc49 expref: 55 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773196.030525:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074b200, rc 0) 00000100:00100000:0.0:1790773196.030587:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+54:11230:x1877761484432640:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 433us (737us total) trans 4294967347 rc 301/301 00000100:00100000:0.0:1790773196.030596:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 70 00000100:00080000:1.0:1790773196.030717:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790773196.031910:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773196.031975:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484432768 00000100:00100000:2.0:1790773196.031985:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484432768 00000100:00100000:2.0:1790773196.032055:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 71 00000100:00100000:2.0:1790773196.032067:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+54:11230:x1877761484432768:12345-192.168.202.19@tcp:34:lfs.0 00010000:00010000:2.0:1790773196.032143:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7841e7c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.032166:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7841e7c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.032179:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7841e7c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.032198:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc7841e83 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.032271:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc7841e83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.032277:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc7841e83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.032342:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7841e8a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.032348:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7841e8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.032353:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7841e8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790773196.032411:0:8697:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7841e8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.032425:0:8697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7841e7c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.032431:0:8697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7841e7c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.032436:0:8697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7841e7c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.032439:0:8697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc5000 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:2.0:1790773196.032442:0:8697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7841e7c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.032450:0:8697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7841e7c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.032459:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93d14363d100) 00010000:00010000:2.0:1790773196.032460:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790773196.032464:0:8697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7841e7c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.032467:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7841e7c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.032478:0:8697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc7841e83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.032481:0:8697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc7841e83 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.032490:0:8697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc7841e83 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.032493:0:8697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc5c00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:2.0:1790773196.032494:0:8697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc7841e83 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.032499:0:8697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc7841e83 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.032512:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93d14363d300) 00010000:00010000:2.0:1790773196.032514:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790773196.032517:0:8697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc7841e83 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.032522:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc7841e83 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.032531:0:8697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7841e8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.032545:0:8697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7841e8a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.032551:0:8697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7841e8a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.032555:0:8697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc5800 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:2.0:1790773196.032557:0:8697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7841e8a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.032573:0:8697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7841e8a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.032579:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d28095bf00) 00010000:00010000:2.0:1790773196.032580:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790773196.032582:0:8697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7841e8a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.032590:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7841e8a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773196.032659:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+54:11230:x1877761484432768:12345-192.168.202.19@tcp:34:lfs.0 Request processed in 595us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773196.032684:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 71 00000100:00100000:2.0:1790773196.033835:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773196.034182:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484433024 00000100:00100000:3.0:1790773196.034189:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484433024 00000100:00100000:3.0:1790773196.034239:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:3.0:1790773196.034247:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:110130ab-04fa-4d7c-984e-562032df4432+54:11230:x1877761484433024:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:3.0:1790773196.034413:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:110130ab-04fa-4d7c-984e-562032df4432+55:11230:x1877761484433024:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 166us (581us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1790773196.034418:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:1.0:1790773196.050016:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773196.050099:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484433280 00000100:00100000:2.0:1790773196.050108:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484433280 00000100:00100000:2.0:1790773196.050200:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 72 00000100:00100000:2.0:1790773196.050231:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+55:11233:x1877761484433280:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1790773196.050255:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773196.050272:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7841e91 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bc50 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.050329:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc7841e98 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.050340:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc7841e98 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.050374:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc7841e98 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.050383:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7841e9f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.050388:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7841e9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.050391:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7841e9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.050500:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7841ea6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.050517:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7841ea6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.050522:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7841ea6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790773196.050531:0:6480:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1790773196.050601:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc7841e98 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.050607:0:6480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc7841e98 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.050612:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc7841e98 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.050616:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc5c00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:2.0:1790773196.050624:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc7841e98 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.050629:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc7841e98 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.050639:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93d14363d100) 00010000:00010000:2.0:1790773196.050642:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790773196.050645:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc7841e98 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.050649:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc7841e98 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.050658:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7841e9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.050661:0:6480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7841e9f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.050676:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7841e9f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.050682:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc5000 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:2.0:1790773196.050685:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7841e9f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.050692:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7841e9f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.050809:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93d14363d300) 00010000:00010000:2.0:1790773196.050812:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790773196.050821:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7841e9f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.050827:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7841e9f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.050862:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7841e91 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc50 expref: 58 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.050872:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7841ea6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc50 expref: 57 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.050877:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d28095bf00) 00010000:00010000:2.0:1790773196.050879:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790773196.050881:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26efc5200, rc 0) 00000100:00100000:2.0:1790773196.050931:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+57:11233:x1877761484433280:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 703us (926us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1790773196.050936:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 72 00000100:00100000:1.0:1790773196.053068:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773196.053122:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773196.053164:0:8410:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484433408 00000100:00100000:0.0:1790773196.053170:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484433536 00000100:00100000:3.0:1790773196.053174:0:8410:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484433408 00000100:00100000:0.0:1790773196.053174:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484433536 00000100:00100000:0.0:1790773196.053241:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 73 00000100:00100000:0.0:1790773196.053251:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+58:11233:x1877761484433536:12345-192.168.202.19@tcp:54:lfs.0 00010000:00010000:0.0:1790773196.053309:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7841eb4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773196.053324:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7841eb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773196.053335:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7841eb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773196.053375:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7841eb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773196.053382:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7841eb4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773196.053389:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7841eb4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773196.053395:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074b200 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773196.053409:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7841eb4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773196.053418:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7841eb4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773196.053428:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d28095bf00) 00010000:00010000:0.0:1790773196.053431:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790773196.053435:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7841eb4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773196.053441:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7841eb4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773196.053508:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+58:11233:x1877761484433536:12345-192.168.202.19@tcp:54:lfs.0 Request processed in 259us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773196.053516:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 73 00000100:00100000:3.0:1790773196.055220:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00100000:3.0:1790773196.055236:0:8410:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:110130ab-04fa-4d7c-984e-562032df4432+57:2398:x1877761484433408:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790773196.055254:0:8410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773196.055274:0:8410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7841ea6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc50 expref: 57 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.055291:0:8410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d28095bf00) 00010000:00010000:3.0:1790773196.055295:0:8410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790773196.055452:0:8410:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:110130ab-04fa-4d7c-984e-562032df4432+56:2398:x1877761484433408:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 212us (2380us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773196.055461:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00100000:1.0:1790773196.057129:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773196.057174:0:6482:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484433792 00000100:00100000:2.0:1790773196.057184:0:6482:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484433792 00000100:00100000:2.0:1790773196.057275:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:2.0:1790773196.057326:0:6482:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+56:11233:x1877761484433792:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:2.0:1790773196.057646:0:6482:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+57:11233:x1877761484433792:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 323us (521us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1790773196.057659:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:3.0:1790773196.109532:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000004:00080000:2.0:1790773196.109588:0:8905:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 338911382621ns, next at 339911379771ns, rc = 0 00000100:00100000:3.0:1790773196.109790:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ca4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496049408:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790773196.109893:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773196.109981:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496049280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790773196.110008:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773196.110311:0:11145:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496049408 00000100:00100000:2.0:1790773196.110330:0:11145:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496049408 00000100:00100000:2.0:1790773196.110404:0:11145:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496049280 00000100:00100000:2.0:1790773196.110409:0:11145:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496049280 00000100:00100000:2.0:1790773196.110431:0:11145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1790773196.110440:0:11145:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2412ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496049408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790773196.110479:0:11145:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790773196.110526:0:11145:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2412ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496049408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773196.110533:0:11145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1790773196.110550:0:11145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1790773196.110557:0:11145:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2412af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3605:x1877761496049280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790773196.110567:0:11145:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790773196.110592:0:11145:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2412af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3605:x1877761496049280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773196.110597:0:11145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1790773196.110857:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ca4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496049408:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790773196.110873:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496049280:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790773196.110957:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790773196.141637:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773196.143147:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484434048 00000100:00100000:2.0:1790773196.143164:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484434048 00000100:00100000:2.0:1790773196.143280:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 74 00000100:00100000:2.0:1790773196.143292:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+57:11251:x1877761484434048:12345-192.168.202.19@tcp:101:cat.0 00010000:00010000:2.0:1790773196.143322:0:8697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773196.143348:0:8697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7841ebb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bc57 expref: -99 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.143495:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7841ec2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.143513:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7841ec2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.143549:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7841ec2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790773196.143562:0:8697:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1790773196.143709:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7841ebb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc57 expref: 60 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.143729:0:8697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7841ec2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc57 expref: 59 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.143739:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d28095bf00) 00010000:00010000:2.0:1790773196.143742:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1790773196.144196:0:8697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26efc5000, rc 0) 00000100:00100000:2.0:1790773196.144400:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+59:11251:x1877761484434048:12345-192.168.202.19@tcp:101:cat.0 Request processed in 1109us (2773us total) trans 4294967351 rc 0/0 00000100:00100000:2.0:1790773196.144410:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 74 00000100:00100000:1.0:1790773196.184148:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773196.184283:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484434176 00000100:00100000:2.0:1790773196.184295:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484434176 00000100:00100000:2.0:1790773196.184349:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 75 00000100:00100000:2.0:1790773196.184370:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+59:11252:x1877761484434176:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1790773196.184398:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773196.184417:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7841ed0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bc5e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.184497:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc7841ed7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.184853:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc7841ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.184866:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc7841ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790773196.184911:0:6480:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1790773196.184915:0:6480:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790773196.184935:0:6480:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc7841ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.184966:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7841ed0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc5e expref: 61 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.184987:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc7841ed7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc5e expref: 60 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.184996:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93d14363d100) 00010000:00010000:2.0:1790773196.184999:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790773196.185003:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26efc5c00, rc 0) 00000100:00100000:2.0:1790773196.185079:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+60:11252:x1877761484434176:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 722us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773196.185087:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 75 00000100:00100000:1.0:1790773196.192808:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773196.192979:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484434560 00000100:00100000:3.0:1790773196.192989:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484434560 00000100:00100000:3.0:1790773196.193051:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 18 00000100:00100000:3.0:1790773196.193062:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:110130ab-04fa-4d7c-984e-562032df4432+60:11252:x1877761484434560:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:3.0:1790773196.193637:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:110130ab-04fa-4d7c-984e-562032df4432+61:11252:x1877761484434560:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 576us (839us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1790773196.193659:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 18 00000100:00100000:1.0:1790773196.196894:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773196.196998:0:6465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484434688 00000100:00100000:2.0:1790773196.197010:0:6465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484434688 00000100:00100000:2.0:1790773196.197083:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:2.0:1790773196.197093:0:6465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:110130ab-04fa-4d7c-984e-562032df4432+61:11252:x1877761484434688:12345-192.168.202.19@tcp:103:lfs.0 00010000:00010000:2.0:1790773196.197109:0:6465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1790773196.197150:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc7841e67 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc42 expref: 61 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.197173:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7841ec2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc57 expref: 60 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.197186:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4600/0xabf1cc0bc7841d64 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbfc expref: 59 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.197195:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d28095bf00) 00010000:00010000:2.0:1790773196.197199:0:6465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790773196.197296:0:6465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:110130ab-04fa-4d7c-984e-562032df4432+58:11252:x1877761484434688:12345-192.168.202.19@tcp:103:lfs.0 Request processed in 204us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773196.197304:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:1.0:1790773196.199415:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773196.199778:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484434816 00000100:00100000:0.0:1790773196.199788:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484434816 00000100:00100000:0.0:1790773196.199835:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 76 00000100:00100000:0.0:1790773196.199842:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d243ee0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+58:11252:x1877761484434816:12345-192.168.202.19@tcp:58:lfs.0 00010000:00010000:0.0:1790773196.199941:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7841ede lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773196.199957:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7841ede lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773196.199968:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7841ede lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790773196.200195:0:6479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790773196.200679:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1790773196.200758:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1790773196.200834:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d243ee0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+58:11252:x1877761484434816:12345-192.168.202.19@tcp:58:lfs.0 Request processed in 992us (1424us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773196.200842:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 76 00000100:00100000:1.0:1790773196.215806:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773196.215922:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484434944 00000100:00100000:0.0:1790773196.215933:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484434944 00000100:00100000:0.0:1790773196.216000:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 77 00000100:00100000:0.0:1790773196.216007:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d243ee2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+58:11254:x1877761484434944:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:0.0:1790773196.216030:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773196.216050:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc7841ee5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bc65 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773196.216117:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc7841eec lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773196.216130:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc7841eec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773196.216139:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc7841eec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773196.216146:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7841ef3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773196.216151:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7841ef3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773196.216155:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7841ef3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773196.216274:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a600/0xabf1cc0bc7841efa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773196.216284:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a600/0xabf1cc0bc7841efa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773196.216292:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a600/0xabf1cc0bc7841efa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790773196.216338:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1790773196.216343:0:13768:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790773196.216417:0:13768:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a600/0xabf1cc0bc7841efa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773196.216427:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a600/0xabf1cc0bc7841efa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773196.216433:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc7841eec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773196.216438:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc7841eec lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773196.216442:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc7841eec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773196.216447:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074b400 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773196.216451:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc7841eec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773196.216458:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc7841eec lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773196.216479:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93d14363d100) 00010000:00010000:0.0:1790773196.216482:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773196.216487:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc7841eec lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773196.216493:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc7841eec lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773196.216684:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7841ef3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773196.216692:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7841ef3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773196.216761:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7841ef3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773196.216766:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074a400 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773196.216769:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7841ef3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773196.216775:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7841ef3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773196.216784:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93d14363d300) 00010000:00010000:0.0:1790773196.216787:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773196.216789:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7841ef3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773196.216793:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7841ef3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773196.216825:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc7841ee5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc65 expref: 60 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773196.216844:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a600/0xabf1cc0bc7841efa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc65 expref: 59 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773196.216849:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d28095bf00) 00010000:00010000:0.0:1790773196.216850:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790773196.216852:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074a600, rc 0) 00000100:00100000:0.0:1790773196.216945:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d243ee2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+59:11254:x1877761484434944:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 938us (1148us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773196.216950:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 77 00000040:00080000:1.0:1790773196.623183:0:13753:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790773196.623526:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790773196.627589:0:13749:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790773196.627598:0:13749:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790773196.627634:0:13749:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1790773196.627640:0:13749:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790773196.627793:0:13749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2412af800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13749:1877761496049536:192.168.202.19@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790773196.627865:0:13749:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d143779a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790773196.654760:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773196.656890:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484435072 00000100:00100000:0.0:1790773196.656909:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484435072 00000100:00100000:0.0:1790773196.656978:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 78 00000100:00100000:0.0:1790773196.656989:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d243ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+60:11265:x1877761484435072:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790773196.657028:0:6478:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790773196.657174:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d243ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+60:11265:x1877761484435072:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 Request processed in 186us (2427us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773196.657182:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 78 00000100:00100000:3.0:1790773196.662954:0:13749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2412af800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13749:1877761496049536:192.168.202.19@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790773196.674583:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773196.674796:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484435200 00000100:00100000:2.0:1790773196.674808:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484435200 00000100:00100000:2.0:1790773196.674876:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 79 00000100:00100000:2.0:1790773196.674887:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2412af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+59:11265:x1877761484435200:12345-192.168.202.19@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1790773196.674966:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7841f01 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.674989:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7841f01 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.675002:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7841f01 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.675038:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc7841f08 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.675058:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc7841f08 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.675066:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc7841f08 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.675097:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7841f0f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.675106:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7841f0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.675112:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7841f0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790773196.675161:0:6479:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1790773196.675165:0:6479:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790773196.675180:0:6479:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7841f0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.675190:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7841f01 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.675197:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7841f01 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.677457:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7841f01 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.677477:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc5000 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:2.0:1790773196.677484:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7841f01 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.677503:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7841f01 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.677521:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93d26ede0500) 00010000:00010000:2.0:1790773196.677524:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790773196.677529:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7841f01 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.677536:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7841f01 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.677553:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc7841f08 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.677561:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc7841f08 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.677567:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc7841f08 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.677572:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc4e00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:2.0:1790773196.677574:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc7841f08 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.677580:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc7841f08 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.677587:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff93d28095b700) 00010000:00010000:2.0:1790773196.677590:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790773196.677593:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc7841f08 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.677609:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc7841f08 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.677633:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7841f0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.677639:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7841f0f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.677645:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7841f0f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.677649:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc5800 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:2.0:1790773196.677653:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7841f0f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.677670:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7841f0f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.677679:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d28095bf00) 00010000:00010000:2.0:1790773196.677681:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790773196.677684:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7841f0f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.677689:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7841f0f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773196.688300:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2412af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+59:11265:x1877761484435200:12345-192.168.202.19@tcp:34:lhsmtool_posix.0 Request processed in 13403us (13717us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773196.688315:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 79 00000100:00100000:0.0:1790773196.711306:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773196.711454:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484435456 00000100:00100000:3.0:1790773196.711464:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484435456 00000100:00100000:3.0:1790773196.711521:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 80 00000100:00100000:3.0:1790773196.711530:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ca6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+59:11265:x1877761484435456:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790773196.711552:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773196.711573:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc7841f16 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bc6c expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.711811:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7841f1d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.711827:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7841f1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.711840:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7841f1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790773196.711868:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1790773196.711950:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7841f1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.711959:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7841f1d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.711966:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7841f1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.711972:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ad000 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773196.711976:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7841f1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.711984:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7841f1d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.711997:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d28095bf00) 00010000:00010000:3.0:1790773196.712001:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790773196.712006:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7841f1d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.712012:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7841f1d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.712056:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc7841f16 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc6c expref: 61 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.712065:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93d26ede0500) 00010000:00010000:3.0:1790773196.712067:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790773196.712077:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc7841f16 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc6c expref: 61 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.712088:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d1434ace00, rc 0) 00000100:00100000:3.0:1790773196.712150:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ca6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+60:11265:x1877761484435456:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 621us (853us total) trans 4294967353 rc 301/301 00000100:00100000:3.0:1790773196.712158:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 80 00000100:00100000:0.0:1790773196.733503:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773196.733839:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484435584 00000100:00100000:1.0:1790773196.733849:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484435584 00000100:00100000:1.0:1790773196.733898:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 81 00000100:00100000:1.0:1790773196.733908:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ca4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+60:11265:x1877761484435584:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790773196.733944:0:8697:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790773196.734057:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ca4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+60:11265:x1877761484435584:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 Request processed in 150us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773196.734065:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 81 00000100:00100000:0.0:1790773196.760833:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773196.761561:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484435840 00000100:00100000:3.0:1790773196.761579:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484435840 00000100:00100000:0.0:1790773196.761916:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 82 00000100:00100000:0.0:1790773196.761938:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ca6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+60:11265:x1877761484435840:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790773196.761986:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773196.761990:0:13768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790773196.762019:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc7841ed7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc5e expref: 60 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773196.762040:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93d14363d100) 00010000:00010000:0.0:1790773196.762046:0:13768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790773196.762068:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc7841f2b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bc73 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790773196.762903:0:13768:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:0.0:1790773196.763080:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc7841f32 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773196.763097:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc7841f32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773196.763108:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc7841f32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773196.763180:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc7841f2b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc73 expref: 62 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773196.763237:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc7841f32 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc73 expref: 61 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773196.763246:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93d26ede0700) 00010000:00010000:0.0:1790773196.763250:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790773196.763266:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074b400, rc 0) 00000100:00100000:0.0:1790773196.764070:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ca6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+61:11265:x1877761484435840:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 1421us (2525us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1790773196.764083:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 82 00000100:00100000:0.0:1790773196.768791:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773196.768949:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484436096 00000100:00100000:1.0:1790773196.768961:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484436096 00000100:00100000:1.0:1790773196.769031:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 83 00000100:00100000:1.0:1790773196.769042:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+61:11265:x1877761484436096:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790773196.769139:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790773196.769172:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc7841f32 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc73 expref: 61 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773196.769196:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93d26ede0700) 00010000:00010000:1.0:1790773196.769234:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790773196.769258:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7841f40 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773196.769273:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7841f40 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773196.769284:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7841f40 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773196.769298:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc7841f47 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xb824e1a2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773196.769305:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc7841f47 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xb824e1a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773196.769311:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc7841f47 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xb824e1a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773196.769358:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7841f40 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773196.769365:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7841f40 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773196.769372:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7841f40 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773196.769385:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12a400 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773196.769390:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7841f40 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773196.769398:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7841f40 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773196.769406:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93d14363d100) 00010000:00010000:1.0:1790773196.769409:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790773196.769413:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7841f40 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773196.769419:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7841f40 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773196.769429:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc7841f47 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xb824e1a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773196.769435:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc7841f47 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xb824e1a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773196.769442:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc7841f47 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xb824e1a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773196.769448:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12ba00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773196.769450:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc7841f47 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xb824e1a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773196.769457:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc7841f47 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xb824e1a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773196.769476:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xb824e1a2 (ffff93d14363de00) 00010000:00010000:1.0:1790773196.769478:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790773196.769481:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc7841f47 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xb824e1a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773196.769486:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc7841f47 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xb824e1a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773196.769574:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+60:11265:x1877761484436096:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 533us (795us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790773196.769581:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 83 00000100:00100000:3.0:1790773196.781003:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773196.781057:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484436224 00000100:00100000:3.0:1790773196.781072:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484436224 00000100:00100000:3.0:1790773196.781142:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 84 00000100:00100000:3.0:1790773196.781154:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2412aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+60:11265:x1877761484436224:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790773196.781188:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773196.781233:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc7841f4e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bc7a expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.781301:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc7841f55 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.781322:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc7841f55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.781337:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc7841f55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.781487:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc7841f4e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc7a expref: 62 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.781540:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc7841f55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc7a expref: 61 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.781552:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93d250704400) 00010000:00010000:3.0:1790773196.781556:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790773196.781560:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d1434ace00, rc 0) 00000100:00100000:3.0:1790773196.783666:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2412aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+61:11265:x1877761484436224:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 2424us (2589us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773196.783680:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 84 00000100:00100000:0.0:1790773196.792458:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773196.792689:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484436480 00000100:00100000:3.0:1790773196.792708:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484436480 00000100:00100000:3.0:1790773196.792776:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 85 00000100:00100000:3.0:1790773196.792788:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+61:11265:x1877761484436480:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790773196.792878:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7841f5c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.792899:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7841f5c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.792912:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7841f5c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790773196.793102:0:13768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1790773196.793113:0:13768:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 339594907803ns, next at 340594904465ns, rc = 0 00000004:00010000:3.0:1790773196.793161:0:13768:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000018210b21 reply state 00000000f1ba0888 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7841f5c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.793184:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7841f5c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.793193:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93d250704400) 00010000:00010000:3.0:1790773196.793196:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1790773196.793200:0:13768:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790773196.793358:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+63:11265:x1877761484436480:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 564us (901us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1790773196.793367:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 85 00000100:00100000:2.0:1790773196.802019:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773196.808987:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484436608 00000100:00100000:1.0:1790773196.809003:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484436608 00000100:00100000:1.0:1790773196.809080:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 86 00000100:00100000:1.0:1790773196.809090:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+63:11265:x1877761484436608:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790773196.809118:0:8697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773196.809138:0:8697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc7841f63 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bc81 expref: -99 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773196.809195:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc7841f63 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc81 expref: 64 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773196.809234:0:8697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc7841f63 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc81 expref: 64 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773196.809255:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93d250704400) 00010000:00010000:1.0:1790773196.809259:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790773196.809273:0:8697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12ba00, rc 0) 00000100:00100000:1.0:1790773196.809353:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+64:11265:x1877761484436608:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 263us (7343us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773196.809360:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 86 00000100:00100000:0.0:1790773196.816948:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773196.819444:0:8906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484436736 00000100:00100000:1.0:1790773196.819460:0:8906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484436736 00000100:00100000:1.0:1790773196.819556:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 32 00000100:00100000:1.0:1790773196.819570:0:8906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2396:x1877761484436736:12345-192.168.202.19@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1790773196.819621:0:8906:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 110130ab-04fa-4d7c-984e-562032df4432@192.168.202.19@tcp t0 exp 0000000000000000 cur 339 last 0 00000020:00000080:1.0:1790773196.819654:0:8906:0:(genops.c:1384:class_connect()) connect: client 110130ab-04fa-4d7c-984e-562032df4432, cookie 0xabf1cc0bc7841f6a 00002000:00100000:1.0:1790773196.819675:0:8906:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 110130ab-04fa-4d7c-984e-562032df4432/ffff93d27fa2d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b04 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790773196.819861:0:8906:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1790773196.819941:0:8906:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1790773196.819980:0:8906:0:(import.c:65:import_set_state_nolock()) ffff93d27fa2e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790773196.820051:0:8906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:110130ab-04fa-4d7c-984e-562032df4432+6:2396:x1877761484436736:12345-192.168.202.19@tcp:8:lhsmtool_posix.0 Request processed in 481us (3116us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773196.820059:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 32 00000100:00100000:0.0:1790773196.830520:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773196.831848:0:8394:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484436864 00000100:00100000:3.0:1790773196.831865:0:8394:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484436864 00000100:00100000:3.0:1790773196.831943:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 33 00000100:00100000:3.0:1790773196.831953:0:8394:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:110130ab-04fa-4d7c-984e-562032df4432+6:0:x1877761484436864:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1790773196.832579:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1790773196.836043:0:9475:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:3.0:1790773196.836060:0:9475:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 110130ab-04fa-4d7c-984e-562032df4432 00000100:00100000:0.0:1790773196.846118:0:8394:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:110130ab-04fa-4d7c-984e-562032df4432+5:0:x1877761484436864:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 Request processed in 14140us (15581us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1790773196.846132:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 33 00000100:00100000:1.0:1790773196.855345:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773196.859427:0:6482:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484437120 00000100:00100000:2.0:1790773196.859443:0:6482:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484437120 00000100:00100000:2.0:1790773196.859561:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 19 00000100:00100000:2.0:1790773196.859579:0:6482:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d243ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+64:11265:x1877761484437120:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790773196.859834:0:6482:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d243ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+65:11265:x1877761484437120:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 Request processed in 256us (4498us total) trans 4294967356 rc 0/0 00000100:00100000:2.0:1790773196.859842:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 19 00000100:00100000:3.0:1790773196.867051:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773196.869030:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484437376 00000100:00100000:3.0:1790773196.869043:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484437376 00000100:00100000:3.0:1790773196.869114:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 87 00000100:00100000:3.0:1790773196.869124:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2412afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+65:11265:x1877761484437376:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790773196.869263:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2412afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+65:11265:x1877761484437376:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 139us (2221us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773196.869271:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 87 00000100:00100000:1.0:1790773196.874960:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773196.875029:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484437504 00000100:00100000:3.0:1790773196.875040:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484437504 00000100:00100000:3.0:1790773196.875102:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 88 00000100:00100000:3.0:1790773196.875128:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d243ee3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+65:11265:x1877761484437504:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790773196.875153:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773196.875175:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc7841f71 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bc88 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.875285:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac800/0xabf1cc0bc7841f78 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.875300:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac800/0xabf1cc0bc7841f78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.875311:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac800/0xabf1cc0bc7841f78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790773196.875369:0:13768:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790773196.875390:0:13768:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac800/0xabf1cc0bc7841f78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.875416:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc7841f71 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc88 expref: 67 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.875438:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac800/0xabf1cc0bc7841f78 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc88 expref: 66 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.875447:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93d250704400) 00010000:00010000:3.0:1790773196.875450:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1790773196.875454:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d1434ac800, rc 0) 00000100:00100000:3.0:1790773196.875529:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d243ee3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+66:11265:x1877761484437504:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 402us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773196.875546:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 88 00000100:00100000:0.0:1790773196.892067:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773196.892146:0:8907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484437632 00000100:00100000:3.0:1790773196.892156:0:8907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484437632 00000100:00100000:3.0:1790773196.892228:0:8907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 34 00000100:00100000:3.0:1790773196.892239:0:8907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:110130ab-04fa-4d7c-984e-562032df4432+5:2397:x1877761484437632:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790773196.892259:0:8907:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773196.892280:0:8907:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ddb50f82/0xabf1cc0bc7841f7f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bc8f expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790773196.892310:0:8907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abd07cc, blocks: 0x0 00010000:00010000:3.0:1790773196.892333:0:8907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=339s v=(0 0) 00010000:00010000:3.0:1790773196.892337:0:8907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773196.892347:0:8907:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ddb50f82/0xabf1cc0bc7841f7f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc8f expref: 6 pid: 8907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.892380:0:8907:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ddb50f82/0xabf1cc0bc7841f7f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc8f expref: 6 pid: 8907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.892394:0:8907:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d1434ad400, rc 0) 00000100:00100000:3.0:1790773196.892455:0:8907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:110130ab-04fa-4d7c-984e-562032df4432+6:2397:x1877761484437632:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 217us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773196.892463:0:8907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 34 00000100:00100000:2.0:1790773196.907180:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773196.907319:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484437888 00000100:00100000:0.0:1790773196.907329:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484437888 00000100:00100000:0.0:1790773196.907400:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 89 00000100:00100000:0.0:1790773196.907409:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+66:11265:x1877761484437888:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790773196.907526:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+66:11265:x1877761484437888:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 117us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773196.907533:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 89 00000100:00100000:3.0:1790773196.924670:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773196.924844:0:8906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484438016 00000100:00100000:1.0:1790773196.924855:0:8906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484438016 00000100:00100000:1.0:1790773196.924916:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 35 00000100:00100000:1.0:1790773196.924927:0:8906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2412ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:110130ab-04fa-4d7c-984e-562032df4432+6:11265:x1877761484438016:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790773196.924949:0:8906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773196.924969:0:8906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7ed604b/0xabf1cc0bc7841f86 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bc96 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773196.925017:0:8906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ddb50f82/0xabf1cc0bc7841f7f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc8f expref: 7 pid: 8907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773196.925027:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790773196.925031:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790773196.925036:0:8906:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7ed604b/0xabf1cc0bc7841f86 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc96 expref: 7 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773196.925068:0:8906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ddb50f82/0xabf1cc0bc7841f7f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc8f expref: 7 pid: 8907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773196.925082:0:8906:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ddb50f82/0xabf1cc0bc7841f7f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc8f expref: 7 pid: 8907 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773196.925098:0:8906:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d243ee3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8906:1877761496049664:192.168.202.19@tcp:104: 00000100:00100000:1.0:1790773196.925180:0:8906:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26bebf780 going to sleep for 11 seconds 00000100:00100000:2.0:1790773196.933181:0:8906:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d243ee3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8906:1877761496049664:192.168.202.19@tcp:104: 00010000:00010000:2.0:1790773196.933253:0:8906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d7ed604b/0xabf1cc0bc7841f86 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc96 expref: 7 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.933284:0:8906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12bc00, rc 0) 00000100:00100000:2.0:1790773196.933342:0:8906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2412ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:110130ab-04fa-4d7c-984e-562032df4432+7:11265:x1877761484438016:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 8416us (8688us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773196.933361:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 35 00000100:00100000:3.0:1790773196.937569:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773196.937738:0:6464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484438144 00000100:00100000:2.0:1790773196.937750:0:6464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484438144 00010000:00010000:2.0:1790773196.937794:0:6464:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ddb50f82/0xabf1cc0bc7841f7f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc8f expref: 7 pid: 8907 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773196.937833:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 60 00000100:00100000:2.0:1790773196.937843:0:6464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2412ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:110130ab-04fa-4d7c-984e-562032df4432+7:2397:x1877761484438144:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790773196.937858:0:6464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790773196.937881:0:6464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ddb50f82/0xabf1cc0bc7841f7f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc8f expref: 7 pid: 8907 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.937895:0:6464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ddb50f82/0xabf1cc0bc7841f7f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc8f expref: 7 pid: 8907 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.937932:0:6464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ddb50f82/0xabf1cc0bc7841f7f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc8f expref: 7 pid: 8907 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.937950:0:6464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790773196.937953:0:6464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790773196.937961:0:6464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d7ed604b/0xabf1cc0bc7841f86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc96 expref: 6 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.937973:0:6464:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7ed604b/0xabf1cc0bc7841f86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc96 expref: 6 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.938012:0:6464:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d7ed604b/0xabf1cc0bc7841f86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc96 expref: 6 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773196.938027:0:6464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6464:1877761496049792:192.168.202.19@tcp:105: 00000100:00100000:2.0:1790773196.938108:0:6464:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c144a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790773196.942906:0:6464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6464:1877761496049792:192.168.202.19@tcp:105: 00010000:00010000:3.0:1790773196.942950:0:6464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790773196.943020:0:6464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2412ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:110130ab-04fa-4d7c-984e-562032df4432+6:2397:x1877761484438144:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 5177us (5461us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773196.943032:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 60 00000100:00100000:0.0:1790773196.961957:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773196.963764:0:8400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484438272 00000100:00100000:0.0:1790773196.963779:0:8400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484438272 00002000:00100000:0.0:1790773196.963838:0:8400:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff93d27f9c8380 x1877761484438272/t0(0) o4->110130ab-04fa-4d7c-984e-562032df4432@192.168.202.19@tcp:32/0 lens 504/0 e 0 to 0 dl 1790773207 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790773196.963850:0:8400:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93d27f9c8380 with x1877761484438272 ext(0->8) 00002000:00010000:0.0:1790773196.963856:0:8400:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93d27f9c8380 00000100:00100000:0.0:1790773196.964184:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:0.0:1790773196.964194:0:8400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:110130ab-04fa-4d7c-984e-562032df4432+6:2398:x1877761484438272:12345-192.168.202.19@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1790773196.966154:0:8400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:110130ab-04fa-4d7c-984e-562032df4432+8:2398:x1877761484438272:12345-192.168.202.19@tcp:4:lhsmtool_posix.0 Request processed in 1945us (4194us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1790773196.966169:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 0 00002000:00100000:0.0:1790773196.966184:0:8400:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff93d27f9c8380 x1877761484438272/t4294967303(0) o4->110130ab-04fa-4d7c-984e-562032df4432@192.168.202.19@tcp:32/0 lens 504/448 e 0 to 0 dl 1790773207 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790773196.966194:0:8400:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93d27f9c8380 with x1877761484438272 ext(0->8) 00002000:00010000:0.0:1790773196.966227:0:8400:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93d27f9c8380 00000100:00100000:3.0:1790773196.975052:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773196.975333:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484438400 00000100:00100000:2.0:1790773196.975355:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484438400 00000100:00100000:2.0:1790773196.975412:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 90 00000100:00100000:2.0:1790773196.975422:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2412ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+66:11265:x1877761484438400:12345-192.168.202.19@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1790773196.982187:0:6457:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:2.0:1790773196.982224:0:6457:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000004:00080000:2.0:1790773196.982256:0:6457:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:2.0:1790773196.982329:0:6457:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:2.0:1790773196.982353:0:6457:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93d2465e0300 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1790773196.982364:0:6457:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93d279f52000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93d2465e0e40 00000020:00080000:2.0:1790773196.982367:0:6457:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93d279f52a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93d1426abe00 00000100:00100000:1.0:1790773196.983753:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d243ee3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496050048:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1790773196.983827:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773196.983869:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790773196.983876:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d243ee2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496049920:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1790773196.983899:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773196.983936:0:8394:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496050048 00000100:00100000:1.0:1790773196.983945:0:8394:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496050048 00000100:00100000:1.0:1790773196.983994:0:8394:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496049920 00000100:00100000:1.0:1790773196.983997:0:8394:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496049920 00000100:00100000:1.0:1790773196.984049:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790773196.984070:0:8394:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d243ee2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3607:x1877761496050048:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1790773196.984099:0:8394:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:1.0:1790773196.984138:0:8394:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6abd07ca, atime: 0x6abd07ca, ctime: 0x6abd07ca, blocks: 0x8 00010000:00010000:1.0:1790773196.984147:0:8394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f49b4351/0xabf1cc0bc7841f8d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773196.984165:0:8394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=339s v=(0 0) 00010000:00010000:1.0:1790773196.984169:0:8394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790773196.984175:0:8394:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f49b4351/0xabf1cc0bc7841f8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773196.984190:0:8394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f49b4351/0xabf1cc0bc7841f8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773196.984200:0:8394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f49b4351/0xabf1cc0bc7841f8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773196.984231:0:8394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f49b4351/0xabf1cc0bc7841f8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773196.984249:0:8394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790773196.984594:0:8394:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d243ee2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3607:x1877761496050048:12345-0@lo:6:osp-syn-0-0.0 Request processed in 524us (766us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1790773196.984602:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790773196.984622:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790773196.984629:0:8394:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d243ee1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496049920:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1790773196.984915:0:8394:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1790773196.984919:0:8394:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1790773197 00002000:00010000:1.0:1790773196.984921:0:8394:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1790773196.984923:0:8394:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1790773196 -> 1790773197 00002000:00010000:1.0:1790773196.984925:0:8394:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1790773196.984956:0:8394:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d243ee1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3607:x1877761496049920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 327us (1055us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1790773196.984962:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1790773196.984990:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1790773196.985026:0:3607:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93d243ee2d80/2, rc 0, transno 4294967304 00000100:00100000:1.0:1790773196.985032:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d243ee2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496049920:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1790773196.985044:0:3607:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93d243ee3b80/2, rc 0, transno 4294967302 00000100:00100000:1.0:1790773196.985048:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d243ee3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496050048:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1790773196.986035:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2412ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+20:11265:x1877761484438400:12345-192.168.202.19@tcp:44:lhsmtool_posix.0 Request processed in 10609us (10990us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773196.986047:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 90 00000020:00080000:0.0:1790773196.986688:0:6510:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1790773196.986901:0:6510:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00010000:00010000:2.0:1790773196.987273:0:8409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790773196.987284:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f49b4351/0xabf1cc0bc7841f8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.987297:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12b200 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:2.0:1790773196.987302:0:8409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f49b4351/0xabf1cc0bc7841f8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.987314:0:8409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f49b4351/0xabf1cc0bc7841f8d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.987345:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f49b4351/0xabf1cc0bc7841f8d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.987361:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f49b4351/0xabf1cc0bc7841f8d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773196.987385:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773196.987387:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773196.987389:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773196.989689:0:3591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b400/0xabf1cc0bc7841ca0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.990140:0:3591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b400/0xabf1cc0bc7841ca0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.990149:0:3591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b400/0xabf1cc0bc7841ca0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.990155:0:3591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12b400 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773196.990161:0:3591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b400/0xabf1cc0bc7841ca0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.990168:0:3591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b400/0xabf1cc0bc7841ca0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.990184:0:3591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff93d14363d600) 00010000:00010000:3.0:1790773196.990188:0:3591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790773196.990192:0:3591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b400/0xabf1cc0bc7841ca0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.990198:0:3591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b400/0xabf1cc0bc7841ca0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.990679:0:3591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc7841ca7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.990757:0:3591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc7841ca7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.990766:0:3591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc7841ca7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.990770:0:3591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12a200 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773196.990773:0:3591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc7841ca7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.990779:0:3591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc7841ca7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.990789:0:3591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93d14363d100) 00010000:00010000:3.0:1790773196.990791:0:3591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790773196.990794:0:3591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc7841ca7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.990799:0:3591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc7841ca7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.990817:0:3591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc7841ce6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.990824:0:3591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc7841ce6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.990830:0:3591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc7841ce6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.990834:0:3591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12ae00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773196.990844:0:3591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc7841ce6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.990851:0:3591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc7841ce6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.990859:0:3591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93d14363d300) 00010000:00010000:3.0:1790773196.990861:0:3591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790773196.990864:0:3591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc7841ce6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.990870:0:3591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc7841ce6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.990885:0:3591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc7841df0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.990891:0:3591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc7841df0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.990897:0:3591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc7841df0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.990903:0:3591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc4800 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773196.990906:0:3591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc7841df0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.990911:0:3591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc7841df0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.990918:0:3591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d28095bf00) 00010000:00010000:3.0:1790773196.990920:0:3591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790773196.990928:0:3591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc7841df0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.990934:0:3591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc7841df0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.990944:0:3591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7841e13 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.990950:0:3591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7841e13 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.990956:0:3591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7841e13 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.990962:0:3591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074ae00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773196.990965:0:3591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7841e13 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.990970:0:3591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7841e13 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.990978:0:3591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d28095bf00) 00010000:00010000:3.0:1790773196.990980:0:3591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790773196.990983:0:3591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7841e13 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.990989:0:3591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7841e13 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.990998:0:3591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7841e59 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.991004:0:3591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7841e59 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.991016:0:3591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7841e59 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.991021:0:3591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc5600 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773196.991025:0:3591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7841e59 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.991031:0:3591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7841e59 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.991039:0:3591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d28095bf00) 00010000:00010000:3.0:1790773196.991041:0:3591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790773196.991044:0:3591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7841e59 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.991049:0:3591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7841e59 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.991074:0:3591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7841f5c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.991080:0:3591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7841f5c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.991087:0:3591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7841f5c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.991092:0:3591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ad000 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773196.991094:0:3591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7841f5c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.991109:0:3591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7841f5c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.991117:0:3591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93d250704400) 00010000:00010000:3.0:1790773196.991120:0:3591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790773196.991123:0:3591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7841f5c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773196.991129:0:3591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7841f5c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773197.003013:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773197.003150:0:8906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484438528 00000100:00100000:1.0:1790773197.003162:0:8906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484438528 00000100:00100000:1.0:1790773197.003238:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 38 00000100:00100000:1.0:1790773197.003249:0:8906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:110130ab-04fa-4d7c-984e-562032df4432+8:2398:x1877761484438528:12345-192.168.202.19@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1790773197.006302:0:9475:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:3.0:1790773197.006316:0:9475:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:1.0:1790773197.006666:0:8906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:110130ab-04fa-4d7c-984e-562032df4432+6:2398:x1877761484438528:12345-192.168.202.19@tcp:16:lhsmtool_posix.0 Request processed in 3403us (3646us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773197.006679:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 38 00000100:00100000:0.0:1790773197.012422:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773197.012591:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484438784 00000100:00100000:1.0:1790773197.012602:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484438784 00000100:00100000:1.0:1790773197.012673:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 91 00000100:00100000:1.0:1790773197.012683:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+14:11265:x1877761484438784:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790773197.012751:0:8697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790773197.012784:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac800/0xabf1cc0bc7841f78 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc88 expref: 14 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.012807:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93d250704400) 00010000:00010000:1.0:1790773197.012812:0:8697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790773197.012841:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7841f94 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.012855:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7841f94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.012866:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7841f94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790773197.012988:0:8697:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000041b8b94a reply state 00000000de8a2654 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7841f94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.013001:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7841f94 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.013007:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93d250704400) 00010000:00010000:1.0:1790773197.013010:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790773197.013012:0:8697:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790773197.013119:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+15:11265:x1877761484438784:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 436us (706us total) trans 4294967357 rc 0/0 00000100:00100000:1.0:1790773197.013126:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 91 00000100:00100000:3.0:1790773197.017062:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773197.018768:0:8393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484438912 00000100:00100000:1.0:1790773197.018786:0:8393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484438912 00000100:00100000:1.0:1790773197.018852:0:8393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 39 00000100:00100000:1.0:1790773197.018862:0:8393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2412af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:110130ab-04fa-4d7c-984e-562032df4432+6:2398:x1877761484438912:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1790773197.019046:0:8393:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1790773197.019050:0:8393:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1790773197 -> 1790773196 00002000:00010000:1.0:1790773197.019114:0:8393:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1790773194 00002000:00010000:1.0:1790773197.019117:0:8393:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1790773197 -> 1790773196 00002000:00010000:1.0:1790773197.019120:0:8393:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1790773197.019175:0:8393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2412af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:110130ab-04fa-4d7c-984e-562032df4432+7:2398:x1877761484438912:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 Request processed in 314us (2132us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1790773197.019183:0:8393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 39 00000100:00100000:1.0:1790773197.027200:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773197.027479:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484439168 00000100:00100000:3.0:1790773197.027491:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484439168 00000100:00100000:3.0:1790773197.027806:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 92 00000100:00100000:3.0:1790773197.027817:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d243ee0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+15:11265:x1877761484439168:12345-192.168.202.19@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1790773197.027892:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7841f9b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773197.027910:0:6480:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc7841f55 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc7a expref: 15 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773197.027920:0:6480:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7841f9b lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773197.027956:0:6480:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc7841f55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc7a expref: 15 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773197.027983:0:6480:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc7841f55 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc7a expref: 15 pid: 6480 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773197.027997:0:6480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2412ad180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6480:1877761496050176:192.168.202.19@tcp:104: 00000100:00100000:3.0:1790773197.028938:0:6480:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d143779000 going to sleep for 11 seconds 00000100:00100000:3.0:1790773197.034171:0:6480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2412ad180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6480:1877761496050176:192.168.202.19@tcp:104: 00010000:00010000:3.0:1790773197.034225:0:6480:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7841f9b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773197.036826:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773197.036971:0:8410:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484439296 00000100:00100000:3.0:1790773197.036984:0:8410:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484439296 00010000:00010000:3.0:1790773197.037028:0:8410:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc7841f55 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc7a expref: 16 pid: 6480 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773197.037109:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 61 00000100:00100000:3.0:1790773197.037119:0:8410:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d243ee3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:110130ab-04fa-4d7c-984e-562032df4432+16:2398:x1877761484439296:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790773197.037135:0:8410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773197.037143:0:8410:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc7841f55 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc7a expref: 16 pid: 6480 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773197.037156:0:8410:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc7841f55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc7a expref: 16 pid: 6480 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773197.037178:0:8410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc7841f55 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc7a expref: 16 pid: 6480 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773197.037275:0:8410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93d250704400) 00010000:00010000:3.0:1790773197.037281:0:8410:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7841f9b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773197.037291:0:8410:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7841f9b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773197.037299:0:8410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7841f9b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773197.037327:0:8410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790773197.037922:0:8410:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d243ee3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:110130ab-04fa-4d7c-984e-562032df4432+15:2398:x1877761484439296:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 279us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773197.037933:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 61 00010000:00010000:1.0:1790773197.038865:0:6480:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7841f9b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.038876:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7841f9b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.038916:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7841f9b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.038924:0:6480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7841f9b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.038931:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7841f9b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.038937:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ad000 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773197.038941:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7841f9b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.038949:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7841f9b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.038973:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93d250704400) 00010000:00010000:1.0:1790773197.038976:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1790773197.038981:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7841f9b lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.038988:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7841f9b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773197.039053:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d243ee0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+14:11265:x1877761484439168:12345-192.168.202.19@tcp:55:lhsmtool_posix.0 Request processed in 11236us (11862us total) trans 0 rc -22/-22 00000100:00100000:1.0:1790773197.039062:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 92 00000100:00100000:1.0:1790773197.053299:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773197.053415:0:8907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484439424 00000100:00100000:0.0:1790773197.053425:0:8907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484439424 00000100:00100000:0.0:1790773197.053480:0:8907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 40 00000100:00100000:0.0:1790773197.053490:0:8907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d243ee0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:110130ab-04fa-4d7c-984e-562032df4432+7:2397:x1877761484439424:12345-192.168.202.19@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1790773197.053546:0:8907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007c2206ad/0xabf1cc0bc7841fa2 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.053569:0:8907:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d7ed604b/0xabf1cc0bc7841f86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc96 expref: 7 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.053600:0:8907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790773197.053605:0:8907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790773197.053610:0:8907:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c2206ad/0xabf1cc0bc7841fa2 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.053671:0:8907:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d7ed604b/0xabf1cc0bc7841f86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc96 expref: 7 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.053686:0:8907:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d7ed604b/0xabf1cc0bc7841f86 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc96 expref: 7 pid: 8906 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773197.053859:0:8907:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144499180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:8907:1877761496050304:192.168.202.19@tcp:104: 00000100:00100000:0.0:1790773197.053951:0:8907:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26efcc9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790773197.064645:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773197.064978:0:6463:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484439552 00000100:00100000:2.0:1790773197.065010:0:6463:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484439552 00010000:00010000:2.0:1790773197.065135:0:6463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d7ed604b/0xabf1cc0bc7841f86 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc96 expref: 8 pid: 8906 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773197.065240:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 62 00000100:00100000:2.0:1790773197.065252:0:6463:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512c8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:110130ab-04fa-4d7c-984e-562032df4432+8:2398:x1877761484439552:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790773197.065271:0:6463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790773197.065294:0:6463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d7ed604b/0xabf1cc0bc7841f86 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc96 expref: 8 pid: 8906 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773197.065308:0:6463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d7ed604b/0xabf1cc0bc7841f86 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc96 expref: 8 pid: 8906 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773197.065338:0:6463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790773197.065342:0:6463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790773197.065356:0:6463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007c2206ad/0xabf1cc0bc7841fa2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773197.065368:0:6463:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c2206ad/0xabf1cc0bc7841fa2 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773197.065392:0:6463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790773197.065457:0:6463:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512c8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:110130ab-04fa-4d7c-984e-562032df4432+8:2398:x1877761484439552:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 207us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773197.065464:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 62 00010000:00010000:0.0:1790773197.071218:0:8907:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7ed604b/0xabf1cc0bc7841f86 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc96 expref: 7 pid: 8906 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773197.071242:0:8907:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144499180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:8907:1877761496050304:192.168.202.19@tcp:104: 00010000:00010000:0.0:1790773197.071636:0:8907:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007c2206ad/0xabf1cc0bc7841fa2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.071650:0:8907:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007c2206ad/0xabf1cc0bc7841fa2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.071668:0:8907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c2206ad/0xabf1cc0bc7841fa2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.071943:0:8907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007c2206ad/0xabf1cc0bc7841fa2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.071953:0:8907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c2206ad/0xabf1cc0bc7841fa2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.071961:0:8907:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c2206ad/0xabf1cc0bc7841fa2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.071969:0:8907:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074bc00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:0.0:1790773197.071973:0:8907:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c2206ad/0xabf1cc0bc7841fa2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.071982:0:8907:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c2206ad/0xabf1cc0bc7841fa2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.072006:0:8907:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c2206ad/0xabf1cc0bc7841fa2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.072013:0:8907:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c2206ad/0xabf1cc0bc7841fa2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773197.072363:0:8907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d243ee0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:110130ab-04fa-4d7c-984e-562032df4432+6:2397:x1877761484439424:12345-192.168.202.19@tcp:1:lhsmtool_posix.0 Request processed in 18871us (19069us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773197.072374:0:8907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 40 00000100:00100000:1.0:1790773197.078895:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773197.079143:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484439808 00000100:00100000:0.0:1790773197.079153:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484439808 00000100:00100000:1.0:1790773197.079618:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 93 00000100:00100000:1.0:1790773197.079630:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d243ee1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+14:11265:x1877761484439808:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1790773197.079739:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b400/0xabf1cc0bc7841fa9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.079756:0:6478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc7841de9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc1f expref: 14 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.079765:0:6478:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b400/0xabf1cc0bc7841fa9 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.079802:0:6478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc7841de9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc1f expref: 14 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.079837:0:6478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc7841de9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc1f expref: 14 pid: 6480 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773197.079852:0:6478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d243ee1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1877761496050432:192.168.202.19@tcp:104: 00000100:00100000:1.0:1790773197.079980:0:6478:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26bebf240 going to sleep for 11 seconds 00000100:00100000:3.0:1790773197.083296:0:6478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d243ee1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1877761496050432:192.168.202.19@tcp:104: 00010000:00010000:3.0:1790773197.083331:0:6478:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b400/0xabf1cc0bc7841fa9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773197.094883:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773197.095997:0:6464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484439936 00000100:00100000:3.0:1790773197.096011:0:6464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484439936 00010000:00010000:3.0:1790773197.096073:0:6464:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc7841de9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc1f expref: 15 pid: 6480 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773197.096124:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 63 00000100:00100000:3.0:1790773197.096135:0:6464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d243ee1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:110130ab-04fa-4d7c-984e-562032df4432+15:2397:x1877761484439936:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790773197.096152:0:6464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773197.096158:0:6464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc7841de9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc1f expref: 15 pid: 6480 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773197.096187:0:6464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc7841de9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc1f expref: 15 pid: 6480 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773197.096629:0:6464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc7841de9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc1f expref: 15 pid: 6480 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773197.096648:0:6464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d28095bf00) 00010000:00010000:3.0:1790773197.096666:0:6464:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b400/0xabf1cc0bc7841fa9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773197.096676:0:6464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b400/0xabf1cc0bc7841fa9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773197.096685:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b400/0xabf1cc0bc7841fa9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.104781:0:6464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790773197.104876:0:6464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d243ee1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:110130ab-04fa-4d7c-984e-562032df4432+14:2397:x1877761484439936:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 8734us (9993us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773197.104889:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 63 00010000:00010000:3.0:1790773197.105091:0:6478:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b400/0xabf1cc0bc7841fa9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773197.105102:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b400/0xabf1cc0bc7841fa9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773197.105382:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc7841fb0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773197.105398:0:6478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc7841f63 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc81 expref: 14 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773197.105407:0:6478:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc7841fb0 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773197.105453:0:6478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc7841f63 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc81 expref: 14 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773197.105468:0:6478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc7841f63 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc81 expref: 14 pid: 8697 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773197.105482:0:6478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2412ad180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1877761496050560:192.168.202.19@tcp:104: 00000100:00100000:3.0:1790773197.105544:0:6478:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d1437793c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790773197.108164:0:6478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2412ad180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1877761496050560:192.168.202.19@tcp:104: 00010000:00010000:3.0:1790773197.108196:0:6478:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc7841fb0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773197.110630:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773197.111630:0:8410:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484440064 00000100:00100000:3.0:1790773197.111645:0:8410:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484440064 00010000:00010000:3.0:1790773197.111930:0:8410:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc7841f63 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc81 expref: 15 pid: 8697 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773197.111986:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 64 00000100:00100000:3.0:1790773197.111998:0:8410:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144499180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:110130ab-04fa-4d7c-984e-562032df4432+15:2397:x1877761484440064:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790773197.112015:0:8410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773197.112023:0:8410:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc7841f63 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc81 expref: 15 pid: 8697 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773197.112036:0:8410:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc7841f63 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc81 expref: 15 pid: 8697 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773197.112070:0:8410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc7841f63 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc81 expref: 15 pid: 8697 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773197.112085:0:8410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93d250704400) 00010000:00010000:3.0:1790773197.112091:0:8410:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc7841fb0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773197.112101:0:8410:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc7841fb0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773197.112109:0:8410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc7841fb0 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773197.112147:0:8410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790773197.112238:0:8410:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144499180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:110130ab-04fa-4d7c-984e-562032df4432+14:2397:x1877761484440064:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 242us (1616us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773197.112246:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 64 00010000:00010000:1.0:1790773197.112425:0:6478:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc7841fb0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.112434:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc7841fb0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790773197.112560:0:6478:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:1.0:1790773197.113853:0:6478:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:1.0:1790773197.113913:0:6478:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:1.0:1790773197.113996:0:6478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d243ee2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6478:1877761496050688:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1790773197.114060:0:6478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773197.114088:0:6478:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26bebf840 going to sleep for 11 seconds 00000100:00100000:0.0:1790773197.114507:0:6483:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496050688 00000100:00100000:0.0:1790773197.114517:0:6483:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496050688 00000100:00100000:0.0:1790773197.114569:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1790773197.114580:0:6483:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d243ee1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6478:x1877761496050688:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1790773197.114901:0:6483:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d243ee1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6478:x1877761496050688:12345-0@lo:1000:mdt00_000.0 Request processed in 323us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773197.114909:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1790773197.114952:0:6478:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1790773197.114957:0:6478:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93d243ee2d80, transno 4294967304 00000100:00100000:0.0:1790773197.114971:0:6478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d243ee2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6478:1877761496050688:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1790773197.116969:0:6478:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:0.0:1790773197.117081:0:6478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144499c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6478:1877761496050816:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1790773197.117149:0:6478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773197.117180:0:6478:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d14265b000 going to sleep for 11 seconds 00000100:00100000:3.0:1790773197.118699:0:12789:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496050816 00000100:00100000:3.0:1790773197.118716:0:12789:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496050816 00000100:00100000:3.0:1790773197.118775:0:12789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1790773197.118785:0:12789:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144499880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:6478:x1877761496050816:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1790773197.118966:0:12789:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144499880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:6478:x1877761496050816:12345-0@lo:1000:mdt00_000.0 Request processed in 182us (1816us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1790773197.118974:0:12789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1790773197.119289:0:6478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144499c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6478:1877761496050816:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1790773197.119338:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc7841fb0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.119348:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc7841fb0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.119355:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc7841fb0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.119377:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ace00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773197.119382:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc7841fb0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.119390:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc7841fb0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.119405:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93d250704400) 00010000:00010000:1.0:1790773197.119408:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790773197.119412:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc7841fb0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.119418:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc7841fb0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.119448:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7841ede lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.119455:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7841ede lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.119461:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7841ede lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.119465:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074b200 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773197.119468:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7841ede lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.119473:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7841ede lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.119492:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d28095bf00) 00010000:00010000:1.0:1790773197.119495:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790773197.119499:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7841ede lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.119504:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7841ede lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.119524:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7841fb7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.119537:0:6478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a600/0xabf1cc0bc7841efa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc65 expref: 17 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.119546:0:6478:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7841fb7 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.119578:0:6478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a600/0xabf1cc0bc7841efa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc65 expref: 17 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.119593:0:6478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a600/0xabf1cc0bc7841efa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc65 expref: 17 pid: 13768 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773197.119607:0:6478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d243ee2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1877761496050944:192.168.202.19@tcp:104: 00000100:00100000:1.0:1790773197.119696:0:6478:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26bebf480 going to sleep for 11 seconds 00000100:00100000:3.0:1790773197.127814:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773197.128494:0:10300:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484440192 00000100:00100000:2.0:1790773197.128507:0:10300:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484440192 00010000:00010000:2.0:1790773197.128554:0:10300:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a600/0xabf1cc0bc7841efa lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc65 expref: 18 pid: 13768 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773197.128620:0:10300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 65 00000100:00100000:2.0:1790773197.128630:0:10300:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2412ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:110130ab-04fa-4d7c-984e-562032df4432+18:2397:x1877761484440192:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790773197.128646:0:10300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790773197.128665:0:10300:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a600/0xabf1cc0bc7841efa lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc65 expref: 18 pid: 13768 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773197.128680:0:10300:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a600/0xabf1cc0bc7841efa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc65 expref: 18 pid: 13768 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773197.128703:0:10300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d28095bf00) 00010000:00010000:2.0:1790773197.128708:0:10300:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7841fb7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773197.128719:0:10300:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7841fb7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773197.128727:0:10300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7841fb7 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773197.128749:0:10300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790773197.128820:0:10300:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2412ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:110130ab-04fa-4d7c-984e-562032df4432+18:2397:x1877761484440192:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 191us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773197.128828:0:10300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 65 00010000:00010000:1.0:1790773197.134429:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a600/0xabf1cc0bc7841efa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc65 expref: 17 pid: 13768 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773197.134457:0:6478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d243ee2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1877761496050944:192.168.202.19@tcp:104: 00010000:00010000:1.0:1790773197.134505:0:6478:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7841fb7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.134515:0:6478:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7841fb7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.134520:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7841fb7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.134536:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7841fb7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.134543:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7841fb7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.134552:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7841fb7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.134557:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12be00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773197.134563:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7841fb7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.134572:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7841fb7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.134601:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d28095bf00) 00010000:00010000:1.0:1790773197.134605:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790773197.134610:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7841fb7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.134616:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7841fb7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.134637:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b400/0xabf1cc0bc7841fa9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.134644:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b400/0xabf1cc0bc7841fa9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.134650:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b400/0xabf1cc0bc7841fa9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.134667:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12b400 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773197.134670:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b400/0xabf1cc0bc7841fa9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.134676:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b400/0xabf1cc0bc7841fa9 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.134685:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d28095bf00) 00010000:00010000:1.0:1790773197.134687:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790773197.134690:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b400/0xabf1cc0bc7841fa9 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.134696:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b400/0xabf1cc0bc7841fa9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773197.134891:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d243ee1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+16:11265:x1877761484439808:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 55262us (56004us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1790773197.134903:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 93 00000020:00080000:1.0:1790773197.134910:0:6478:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1790773197.134974:0:13749:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790773197.134980:0:13749:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790773197.135001:0:13749:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1790773197.135008:0:13749:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790773197.144783:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773197.145519:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484440448 00000100:00100000:3.0:1790773197.145530:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484440448 00000100:00100000:3.0:1790773197.145592:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00100000:3.0:1790773197.145603:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d243ee2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:110130ab-04fa-4d7c-984e-562032df4432+16:11265:x1877761484440448:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1790773197.145861:0:6481:0:(mdd_object.c:4189:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1790773197.145896:0:6481:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:3.0:1790773197.145926:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc7841fbe lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773197.145940:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc7841fbe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773197.145949:0:6481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc7841fbe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773197.145955:0:6481:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc7841fbe lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773197.145960:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc7841fbe lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773197.145964:0:6481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc7841fbe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773197.145982:0:6481:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790773197.146010:0:6467:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790773197.146029:0:6467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc7841fbe lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.146035:0:6467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ade00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:1.0:1790773197.146039:0:6467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc7841fbe lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.146046:0:6467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc7841fbe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.146059:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93d250704400) 00010000:00010000:1.0:1790773197.146062:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1790773197.146066:0:6467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc7841fbe lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.146072:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc7841fbe lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773197.146083:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d243ee2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:110130ab-04fa-4d7c-984e-562032df4432+18:11265:x1877761484440448:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 Request processed in 480us (1431us total) trans 4294967364 rc 0/0 00010000:00010000:1.0:1790773197.146083:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773197.146085:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773197.146087:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773197.146090:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 20 00000020:00080000:3.0:1790773197.146095:0:6481:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:0.0:1790773197.356820:0:14172:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790773197.356833:0:14172:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790773197.356870:0:14172:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1790773197.356877:0:14172:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790773197.463452:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773197.464885:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484440704 00000100:00100000:3.0:1790773197.464899:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484440704 00000100:00100000:3.0:1790773197.465000:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 94 00000100:00100000:3.0:1790773197.465011:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d243ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+18:11275:x1877761484440704:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:3.0:1790773197.465039:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773197.465060:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7841fc5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bc9d expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773197.465173:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434acc00/0xabf1cc0bc7841fcc lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773197.465187:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434acc00/0xabf1cc0bc7841fcc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773197.465201:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434acc00/0xabf1cc0bc7841fcc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790773197.465254:0:6479:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1790773197.465355:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7841fc5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc9d expref: 21 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773197.465370:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434acc00/0xabf1cc0bc7841fcc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc9d expref: 20 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773197.465379:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93d14363d100) 00010000:00010000:3.0:1790773197.465382:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790773197.465385:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d1434acc00, rc 0) 00000100:00100000:3.0:1790773197.465439:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d243ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+20:11275:x1877761484440704:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 430us (1996us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1790773197.465446:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 94 00000100:00100000:0.0:1790773197.472340:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773197.472474:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484440832 00000100:00100000:1.0:1790773197.472485:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484440832 00000100:00100000:1.0:1790773197.472544:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 95 00000100:00100000:1.0:1790773197.472554:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14449aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+20:11275:x1877761484440832:12345-192.168.202.19@tcp:34:lfs.0 00010000:00010000:1.0:1790773197.472643:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7841fda lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.472670:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7841fda lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.472695:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7841fda lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.472711:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7841fe1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.472717:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7841fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.472723:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7841fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.472809:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc7841fe8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.472816:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc7841fe8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.472822:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc7841fe8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790773197.472866:0:6480:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc7841fe8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.472878:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7841fda lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.472885:0:6480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7841fda lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.472892:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7841fda lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.472907:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12be00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773197.472912:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7841fda lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.472919:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7841fda lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.472931:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93d14363d100) 00010000:00010000:1.0:1790773197.472934:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790773197.472939:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7841fda lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.472944:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7841fda lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.472955:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7841fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.472960:0:6480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7841fe1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.472964:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7841fe1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.472968:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12a400 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773197.472970:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7841fe1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.472975:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7841fe1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.472993:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93d14363df00) 00010000:00010000:1.0:1790773197.472995:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790773197.472998:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7841fe1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.473003:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7841fe1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.473019:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc7841fe8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.473024:0:6480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc7841fe8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.473030:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc7841fe8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.473035:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12ac00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773197.473038:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc7841fe8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.473044:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc7841fe8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.473052:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d14363d300) 00010000:00010000:1.0:1790773197.473054:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790773197.473056:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc7841fe8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.473062:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc7841fe8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773197.473145:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14449aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+20:11275:x1877761484440832:12345-192.168.202.19@tcp:34:lfs.0 Request processed in 592us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773197.473152:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 95 00000100:00100000:1.0:1790773197.536361:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773197.536445:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484441088 00000100:00100000:0.0:1790773197.536455:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484441088 00000100:00100000:0.0:1790773197.536545:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 96 00000100:00100000:0.0:1790773197.536557:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d243ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+20:11278:x1877761484441088:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:0.0:1790773197.536579:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773197.536599:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc7841fef lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bca4 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.536697:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7841ff6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.536713:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7841ff6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.536724:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7841ff6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.536742:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a600/0xabf1cc0bc7841ffd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.536749:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a600/0xabf1cc0bc7841ffd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.536756:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a600/0xabf1cc0bc7841ffd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.536865:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc7842004 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.536873:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc7842004 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.536880:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc7842004 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790773197.536899:0:6478:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1790773197.536970:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7841ff6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.536977:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7841ff6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.536983:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7841ff6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.536988:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074a400 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773197.536992:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7841ff6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.537000:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7841ff6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.537011:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93d14363d100) 00010000:00010000:0.0:1790773197.537014:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773197.537019:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7841ff6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.537025:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7841ff6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.537036:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a600/0xabf1cc0bc7841ffd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.537042:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a600/0xabf1cc0bc7841ffd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.537056:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a600/0xabf1cc0bc7841ffd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.537061:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074a600 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773197.537064:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a600/0xabf1cc0bc7841ffd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.537070:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a600/0xabf1cc0bc7841ffd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.537076:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93d26ede0800) 00010000:00010000:0.0:1790773197.537079:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773197.537081:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a600/0xabf1cc0bc7841ffd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.537086:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a600/0xabf1cc0bc7841ffd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.537123:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc7841fef lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bca4 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.537135:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc7842004 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bca4 expref: 22 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.537142:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d26ede0300) 00010000:00010000:0.0:1790773197.537144:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790773197.537146:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074aa00, rc 0) 00000100:00100000:0.0:1790773197.537235:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d243ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+22:11278:x1877761484441088:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 680us (1034us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1790773197.537260:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 96 00000100:00100000:1.0:1790773197.544882:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773197.545349:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484441216 00000100:00100000:3.0:1790773197.545359:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484441216 00000100:00100000:3.0:1790773197.545420:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 97 00000100:00100000:3.0:1790773197.545431:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d243ee3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+22:11278:x1877761484441216:12345-192.168.202.19@tcp:54:lfs.0 00010000:00010000:3.0:1790773197.545560:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7842012 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773197.545577:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7842012 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773197.545587:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7842012 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773197.548356:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7842012 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773197.548374:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7842012 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773197.548394:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7842012 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773197.548398:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ada00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:2.0:1790773197.548401:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7842012 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773197.548407:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7842012 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773197.548420:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d26ede0300) 00010000:00010000:2.0:1790773197.548423:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790773197.548426:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7842012 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773197.548431:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7842012 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773197.549423:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d243ee3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+22:11278:x1877761484441216:12345-192.168.202.19@tcp:54:lfs.0 Request processed in 3986us (4541us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773197.549435:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 97 00000100:00100000:3.0:1790773197.553878:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773197.554755:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484441472 00000100:00100000:0.0:1790773197.554777:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484441472 00000100:00100000:0.0:1790773197.554842:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:0.0:1790773197.554853:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d279db8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:110130ab-04fa-4d7c-984e-562032df4432+22:11278:x1877761484441472:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:0.0:1790773197.555099:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d279db8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:110130ab-04fa-4d7c-984e-562032df4432+23:11278:x1877761484441472:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 246us (1230us total) trans 4294967367 rc 0/0 00000100:00100000:0.0:1790773197.555107:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:1.0:1790773197.585511:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773197.585732:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484441728 00000100:00100000:0.0:1790773197.585743:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484441728 00000100:00100000:0.0:1790773197.585810:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 98 00000100:00100000:0.0:1790773197.585821:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d243ee3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+23:10804:x1877761484441728:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:0.0:1790773197.585846:0:8697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773197.585867:0:8697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc7842019 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bcab expref: -99 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.585975:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a600/0xabf1cc0bc7842020 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.585991:0:8697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc7842004 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bca4 expref: 24 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.586001:0:8697:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a600/0xabf1cc0bc7842020 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.586031:0:8697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc7842004 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bca4 expref: 24 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.586062:0:8697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc7842004 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bca4 expref: 24 pid: 6478 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773197.586076:0:8697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144499f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8697:1877761496051072:192.168.202.19@tcp:104: 00000100:00100000:0.0:1790773197.586179:0:8697:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d14265b480 going to sleep for 11 seconds 00000100:00100000:1.0:1790773197.589231:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773197.589280:0:6464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484441856 00000100:00100000:2.0:1790773197.589289:0:6464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484441856 00010000:00010000:2.0:1790773197.589331:0:6464:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc7842004 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bca4 expref: 25 pid: 6478 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773197.589374:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 66 00000100:00100000:2.0:1790773197.589383:0:6464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d243ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:110130ab-04fa-4d7c-984e-562032df4432+25:2397:x1877761484441856:12345-192.168.202.19@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790773197.589383:0:8697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144499f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8697:1877761496051072:192.168.202.19@tcp:104: 00010000:00010000:2.0:1790773197.589397:0:6464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773197.589407:0:8697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a600/0xabf1cc0bc7842020 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773197.589415:0:6464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc7842004 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bca4 expref: 25 pid: 6478 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773197.589427:0:6464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc7842004 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bca4 expref: 25 pid: 6478 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773197.589449:0:6464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc7842004 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bca4 expref: 25 pid: 6478 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773197.589465:0:6464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d26ede0300) 00010000:00010000:2.0:1790773197.589470:0:6464:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a600/0xabf1cc0bc7842020 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773197.589480:0:6464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a600/0xabf1cc0bc7842020 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773197.589488:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a600/0xabf1cc0bc7842020 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773197.589515:0:6464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790773197.589568:0:6464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d243ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:110130ab-04fa-4d7c-984e-562032df4432+24:2397:x1877761484441856:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 186us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773197.589576:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 66 00010000:00010000:0.0:1790773197.589934:0:8697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a600/0xabf1cc0bc7842020 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.589940:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a600/0xabf1cc0bc7842020 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790773197.589957:0:8697:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1790773197.590071:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc7842019 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcab expref: 25 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.590082:0:8697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a600/0xabf1cc0bc7842020 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcab expref: 24 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.590087:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d26ede0300) 00010000:00010000:0.0:1790773197.590090:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790773197.590091:0:8697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074a600, rc 0) 00000100:00100000:0.0:1790773197.590122:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d243ee3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+24:10804:x1877761484441728:12345-192.168.202.19@tcp:101:bash.0 Request processed in 4304us (4622us total) trans 4294967368 rc 0/0 00000100:00100000:0.0:1790773197.590151:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 98 00000100:00100000:1.0:1790773197.593278:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773197.593390:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484441984 00000100:00100000:0.0:1790773197.593399:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484441984 00000100:00100000:0.0:1790773197.593452:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 99 00000100:00100000:0.0:1790773197.593459:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d243ee2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+24:10804:x1877761484441984:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:0.0:1790773197.593480:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773197.593502:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc784202e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bcb2 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.593527:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842035 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.593538:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842035 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.593547:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842035 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.593647:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc784202e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcb2 expref: 26 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.593676:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842035 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcb2 expref: 25 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.593682:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d26ede0300) 00010000:00010000:0.0:1790773197.593684:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790773197.593687:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074b200, rc 0) 00000100:00100000:0.0:1790773197.593734:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d243ee2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+25:10804:x1877761484441984:12345-192.168.202.19@tcp:101:bash.0 Request processed in 275us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773197.593747:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 99 00000100:00100000:2.0:1790773197.597984:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773197.598059:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484442240 00000100:00100000:0.0:1790773197.598067:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484442240 00000100:00100000:0.0:1790773197.598133:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 100 00000100:00100000:0.0:1790773197.598148:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+25:10804:x1877761484442240:12345-192.168.202.19@tcp:36:bash.0 00010000:00010000:0.0:1790773197.598387:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc784203c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.598401:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc784203c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.598408:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc784203c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790773197.598437:0:6479:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:0.0:1790773197.598462:0:6479:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d0484ca6 reply state 00000000ad9fbe9d transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc784203c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.598470:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc784203c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.598475:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d26ede0300) 00010000:00010000:0.0:1790773197.598477:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790773197.598480:0:6479:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1790773197.598512:0:6479:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:0.0:1790773197.598577:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+29:10804:x1877761484442240:12345-192.168.202.19@tcp:36:bash.0 Request processed in 437us (601us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1790773197.598582:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 100 00000020:00080000:0.0:1790773197.598586:0:6479:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1790773197.600391:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773197.600494:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484442368 00000100:00100000:0.0:1790773197.600501:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484442368 00000100:00100000:0.0:1790773197.600541:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 101 00000100:00100000:0.0:1790773197.600550:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+29:10804:x1877761484442368:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:0.0:1790773197.600570:0:8697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773197.600586:0:8697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7842043 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bcb9 expref: -99 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.600635:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7842043 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcb9 expref: 30 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.600647:0:8697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7842043 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcb9 expref: 30 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.600769:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d26ede0300) 00010000:00010000:0.0:1790773197.600771:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790773197.600774:0:8697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074b000, rc 0) 00000100:00100000:0.0:1790773197.600825:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+30:10804:x1877761484442368:12345-192.168.202.19@tcp:101:bash.0 Request processed in 276us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773197.600833:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 101 00000100:00100000:1.0:1790773197.602756:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773197.602864:0:8906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484442496 00000100:00100000:2.0:1790773197.602874:0:8906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484442496 00000100:00100000:2.0:1790773197.603055:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 41 00000100:00100000:2.0:1790773197.603081:0:8906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:110130ab-04fa-4d7c-984e-562032df4432+6:10804:x1877761484442496:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:2.0:1790773197.603116:0:8906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773197.603133:0:8906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f8391af/0xabf1cc0bc784204a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bcc0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790773197.603166:0:8906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6abd07cc, atime: 0x6abd07ca, ctime: 0x6abd07cc, blocks: 0x8 00010000:00010000:2.0:1790773197.603184:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=340s v=(0 0) 00010000:00010000:2.0:1790773197.603189:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790773197.603196:0:8906:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f8391af/0xabf1cc0bc784204a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcc0 expref: 7 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773197.603276:0:8906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005f8391af/0xabf1cc0bc784204a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcc0 expref: 7 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773197.603308:0:8906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26efc4200, rc 0) 00000100:00100000:2.0:1790773197.603388:0:8906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:110130ab-04fa-4d7c-984e-562032df4432+7:10804:x1877761484442496:12345-192.168.202.19@tcp:101:bash.0 Request processed in 312us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773197.603396:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 41 00000100:00100000:2.0:1790773197.608184:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773197.608570:0:8398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484442624 00000100:00100000:0.0:1790773197.608579:0:8398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484442624 00002000:00010000:0.0:1790773197.608644:0:8398:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:0.0:1790773197.608718:0:8398:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93d2526cdc00 with x1877761484442624 ext(0->18446744073709551615) 00002000:00010000:0.0:1790773197.608748:0:8398:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93d2526cdc00. 00000100:00100000:0.0:1790773197.608817:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 1 00000100:00100000:0.0:1790773197.608828:0:8398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:110130ab-04fa-4d7c-984e-562032df4432+7:2397:x1877761484442624:12345-192.168.202.19@tcp:10:bash.0 00002000:00010000:0.0:1790773197.609128:0:8398:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1790773197.609131:0:8398:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1790773196 -> 1790773197 00002000:00010000:0.0:1790773197.609133:0:8398:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1790773194 -> 1790773194 00002000:00010000:0.0:1790773197.609135:0:8398:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1790773196 -> 1790773197 00002000:00010000:0.0:1790773197.609136:0:8398:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1790773197.609627:0:8398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:110130ab-04fa-4d7c-984e-562032df4432+8:2397:x1877761484442624:12345-192.168.202.19@tcp:10:bash.0 Request processed in 799us (1448us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1790773197.609636:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 1 00002000:00010000:0.0:1790773197.609641:0:8398:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:0.0:1790773197.609644:0:8398:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93d2526cdc00 with x1877761484442624 ext(0->18446744073709551615) 00002000:00010000:0.0:1790773197.609660:0:8398:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93d2526cdc00. 00010000:00010000:1.0:1790773197.649240:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773197.665548:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773197.667347:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484442752 00000100:00100000:1.0:1790773197.667360:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484442752 00000100:00100000:1.0:1790773197.667422:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 102 00000100:00100000:1.0:1790773197.667432:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2412ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+30:11292:x1877761484442752:12345-192.168.202.19@tcp:34:lfs.0 00010000:00010000:1.0:1790773197.667512:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7842051 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.667529:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7842051 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.667737:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7842051 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.667755:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc7842058 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.667763:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc7842058 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.667789:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc7842058 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.667856:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc784205f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.667863:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc784205f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.667871:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc784205f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790773197.667915:0:6480:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc784205f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.667926:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7842051 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.667933:0:6480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7842051 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.667939:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7842051 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.667945:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12bc00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773197.667949:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7842051 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.667957:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7842051 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.667969:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93d14363d100) 00010000:00010000:1.0:1790773197.667978:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790773197.667984:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7842051 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.667990:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7842051 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.668003:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc7842058 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.668009:0:6480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc7842058 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.668015:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc7842058 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.668020:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12a200 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773197.668022:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc7842058 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.668028:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc7842058 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.668036:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93d14363d300) 00010000:00010000:1.0:1790773197.668038:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790773197.668041:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc7842058 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.668047:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc7842058 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.668061:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc784205f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.668070:0:6480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc784205f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.668073:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc784205f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.668076:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12ae00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773197.668078:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc784205f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.668081:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc784205f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.668086:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d26ede0300) 00010000:00010000:1.0:1790773197.668087:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790773197.668089:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc784205f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.668093:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc784205f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773197.668159:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2412ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+30:11292:x1877761484442752:12345-192.168.202.19@tcp:34:lfs.0 Request processed in 727us (2626us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773197.668167:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 102 00000100:00100000:1.0:1790773197.728031:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773197.728472:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484443008 00000100:00100000:0.0:1790773197.728487:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484443008 00000100:00100000:0.0:1790773197.728683:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 103 00000100:00100000:0.0:1790773197.728696:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+30:11295:x1877761484443008:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:0.0:1790773197.728720:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773197.728741:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7842066 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bcc7 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.728817:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784206d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.728835:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784206d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.728847:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784206d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.728893:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc7842074 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.728902:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc7842074 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.728909:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc7842074 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.729023:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc784207b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.729033:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc784207b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.729039:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc784207b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790773197.729050:0:6479:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1790773197.729137:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784206d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.729146:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784206d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.729154:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784206d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.729160:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074b400 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773197.729165:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784206d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.729182:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784206d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.729193:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93d14363d100) 00010000:00010000:0.0:1790773197.729196:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773197.729251:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784206d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.729259:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784206d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.729274:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc7842074 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.729279:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc7842074 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.729285:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc7842074 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.729290:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074bc00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773197.729293:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc7842074 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.729299:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc7842074 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.729307:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93d26ede0800) 00010000:00010000:0.0:1790773197.729309:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773197.729312:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc7842074 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.729329:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc7842074 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.729917:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7842066 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcc7 expref: 33 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.729934:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc784207b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcc7 expref: 32 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.729941:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d26ede0300) 00010000:00010000:0.0:1790773197.729944:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1790773197.729947:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074be00, rc 0) 00000100:00100000:0.0:1790773197.730020:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+32:11295:x1877761484443008:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 1326us (2000us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1790773197.730028:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 103 00000100:00100000:2.0:1790773197.738478:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773197.738585:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484443136 00000100:00100000:0.0:1790773197.738596:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484443136 00000100:00100000:0.0:1790773197.738668:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 104 00000100:00100000:0.0:1790773197.738678:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+32:11295:x1877761484443136:12345-192.168.202.19@tcp:54:lfs.0 00010000:00010000:0.0:1790773197.738755:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7842089 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.738775:0:8697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a600/0xabf1cc0bc7842020 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcab expref: 32 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.738784:0:8697:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7842089 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.738836:0:8697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a600/0xabf1cc0bc7842020 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcab expref: 32 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.738852:0:8697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a600/0xabf1cc0bc7842020 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcab expref: 32 pid: 8697 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773197.738880:0:8697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144499f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8697:1877761496051200:192.168.202.19@tcp:104: 00000100:00100000:0.0:1790773197.738967:0:8697:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d14265b840 going to sleep for 11 seconds 00000100:00100000:0.0:1790773197.747057:0:8697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144499f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8697:1877761496051200:192.168.202.19@tcp:104: 00010000:00010000:0.0:1790773197.747091:0:8697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7842089 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773197.748678:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773197.748754:0:6482:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484443392 00000100:00100000:0.0:1790773197.748766:0:6482:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484443392 00000100:00100000:0.0:1790773197.748825:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 22 00000100:00100000:0.0:1790773197.748837:0:6482:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+33:6166:x1877761484443392:12345-192.168.202.19@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1790773197.749139:0:6482:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+34:6166:x1877761484443392:12345-192.168.202.19@tcp:35:ldlm_bl.0 Request processed in 305us (470us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1790773197.749145:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 22 00000100:00100000:3.0:1790773197.751799:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773197.751970:0:8410:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484443520 00000100:00100000:1.0:1790773197.751983:0:8410:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484443520 00010000:00010000:1.0:1790773197.752038:0:8410:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a600/0xabf1cc0bc7842020 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcab expref: 34 pid: 8697 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773197.752118:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 67 00000100:00100000:1.0:1790773197.752128:0:8410:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2412ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:110130ab-04fa-4d7c-984e-562032df4432+34:2397:x1877761484443520:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790773197.752148:0:8410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790773197.752157:0:8410:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a600/0xabf1cc0bc7842020 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcab expref: 34 pid: 8697 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.752170:0:8410:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a600/0xabf1cc0bc7842020 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcab expref: 34 pid: 8697 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.752194:0:8410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a600/0xabf1cc0bc7842020 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcab expref: 34 pid: 8697 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.752240:0:8410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d26ede0300) 00010000:00010000:1.0:1790773197.752255:0:8410:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7842089 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.752265:0:8410:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7842089 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.752273:0:8410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7842089 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.752303:0:8410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790773197.752478:0:8410:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2412ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:110130ab-04fa-4d7c-984e-562032df4432+33:2397:x1877761484443520:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 350us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773197.752487:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 67 00010000:00010000:0.0:1790773197.752781:0:8697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7842089 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.752791:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7842089 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.752835:0:8697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7842089 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.752852:0:8697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7842089 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.752859:0:8697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7842089 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.752866:0:8697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074a400 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773197.752870:0:8697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7842089 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.752878:0:8697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7842089 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.752889:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d26ede0300) 00010000:00010000:0.0:1790773197.752892:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790773197.752896:0:8697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7842089 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.752901:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7842089 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773197.752946:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+32:11295:x1877761484443136:12345-192.168.202.19@tcp:54:lfs.0 Request processed in 14269us (14481us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773197.752954:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 104 00000100:00100000:1.0:1790773197.756637:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773197.756812:0:6482:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484443776 00000100:00100000:0.0:1790773197.756828:0:6482:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484443776 00000100:00100000:0.0:1790773197.756897:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 23 00000100:00100000:0.0:1790773197.756908:0:6482:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+32:11295:x1877761484443776:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:0.0:1790773197.757171:0:6482:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+33:11295:x1877761484443776:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 264us (546us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1790773197.757186:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 23 00000100:00100000:3.0:1790773197.826506:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773197.826828:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484444032 00000100:00100000:1.0:1790773197.826839:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484444032 00000100:00100000:1.0:1790773197.826915:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 105 00000100:00100000:1.0:1790773197.826925:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+33:11306:x1877761484444032:12345-192.168.202.19@tcp:101:cat.0 00010000:00010000:1.0:1790773197.826950:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773197.826971:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7842090 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bcce expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.827042:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc7842097 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.827058:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc7842097 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.827068:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc7842097 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.827083:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc784209e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.827091:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc784209e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.827098:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc784209e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.827199:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc78420a5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.827238:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc78420a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.827511:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc78420a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790773197.827521:0:6480:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:1.0:1790773197.827599:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc7842097 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.827607:0:6480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc7842097 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.827614:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc7842097 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.827620:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12b200 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773197.827624:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc7842097 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.827633:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc7842097 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.828006:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93d14363d100) 00010000:00010000:1.0:1790773197.828010:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790773197.828015:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc7842097 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.828023:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc7842097 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.828036:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc784209e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.828043:0:6480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc784209e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.828055:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc784209e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.828061:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12a200 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773197.828064:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc784209e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.828070:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc784209e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.828079:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93d14363d300) 00010000:00010000:1.0:1790773197.828081:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790773197.828084:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc784209e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.828090:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc784209e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.828135:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7842090 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcce expref: 36 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.828149:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc78420a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcce expref: 35 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.828157:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d26ede0300) 00010000:00010000:1.0:1790773197.828159:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790773197.828162:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12ae00, rc 0) 00000100:00100000:1.0:1790773197.828536:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+35:11306:x1877761484444032:12345-192.168.202.19@tcp:101:cat.0 Request processed in 1610us (2041us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1790773197.828555:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 105 00000100:00100000:3.0:1790773197.832838:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773197.832867:0:6482:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484444288 00000100:00100000:0.0:1790773197.832881:0:6482:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484444288 00000100:00100000:0.0:1790773197.832939:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 24 00000100:00100000:0.0:1790773197.832949:0:6482:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+35:11306:x1877761484444288:12345-192.168.202.19@tcp:35:cat.0 00000100:00100000:0.0:1790773197.833178:0:6482:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+36:11306:x1877761484444288:12345-192.168.202.19@tcp:35:cat.0 Request processed in 229us (349us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1790773197.833186:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 24 00000100:00100000:1.0:1790773197.859556:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773197.859669:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484444544 00000100:00100000:0.0:1790773197.859681:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484444544 00000100:00100000:1.0:1790773197.859810:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 106 00000100:00100000:1.0:1790773197.859823:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+36:11307:x1877761484444544:12345-192.168.202.19@tcp:36:rm.0 00010000:00010000:1.0:1790773197.859885:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1790773197.859912:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7842043 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcb9 expref: 36 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.859932:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc78420a5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcce expref: 35 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.859943:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc784207b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcc7 expref: 34 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.859954:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842035 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcb2 expref: 33 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.859964:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d26ede0300) 00010000:00010000:1.0:1790773197.859969:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790773197.859989:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc78420b3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.860004:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc78420b3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.860014:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc78420b3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.860049:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc78420ba lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.860058:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc78420ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.860065:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc78420ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.860142:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc78420c1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.860151:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc78420c1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.860159:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc78420c1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790773197.860643:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:1.0:1790773197.860668:0:6479:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 340662462478ns, next at 341662460144ns, rc = 0 00010000:00010000:1.0:1790773197.860714:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc78420c8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.860724:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc78420c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.860731:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc78420c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.860739:0:6479:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc78420c8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.860756:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc78420c8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.860764:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc78420c8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.860829:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790773197.860853:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc78420c1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.860860:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc78420c1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.860866:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc78420c1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.860873:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12b200 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773197.860878:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc78420c1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.860885:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc78420c1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.860893:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d26ede0300) 00010000:00010000:1.0:1790773197.860896:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1790773197.860900:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc78420c1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.860906:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc78420c1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.860921:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc78420b3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.860932:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc78420b3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.860938:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc78420b3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.860944:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12bc00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773197.860946:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc78420b3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.860953:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc78420b3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.860961:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93d14363d100) 00010000:00010000:1.0:1790773197.860964:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790773197.860967:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc78420b3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.860972:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc78420b3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790773197.860982:0:6479:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000aafd6b67 reply state 00000000bd3cd18c transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc78420ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.860993:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc78420ba lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.860999:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93d14363d300) 00010000:00010000:1.0:1790773197.861002:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790773197.861004:0:6479:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790773197.861086:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+34:11307:x1877761484444544:12345-192.168.202.19@tcp:36:rm.0 Request processed in 1265us (1539us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1790773197.861100:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 106 00010000:00010000:2.0:1790773197.863048:0:8409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790773197.863061:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc78420c8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773197.863070:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12ba00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:2.0:1790773197.863074:0:8409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc78420c8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773197.863098:0:8409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc78420c8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773197.863113:0:8409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d26ede0300) 00010000:00010000:2.0:1790773197.863116:0:8409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1790773197.863120:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc78420c8 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773197.863126:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc78420c8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.863545:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773197.863548:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773197.863550:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773197.870320:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773197.870372:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773197.870399:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773197.870428:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773197.870470:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773197.870499:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484445184 00000100:00100000:3.0:1790773197.870510:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484445184 00000100:00100000:3.0:1790773197.870565:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484444800 00000100:00100000:3.0:1790773197.870568:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484444800 00000100:00100000:3.0:1790773197.870588:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484445056 00000100:00100000:3.0:1790773197.870590:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484445056 00000100:00100000:3.0:1790773197.870609:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 271 00000100:00100000:3.0:1790773197.870632:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2398:x1877761484445184:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1790773197.870742:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2398:x1877761484445184:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 111us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773197.870749:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 271 00000100:00100000:3.0:1790773197.870766:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 272 00000100:00100000:3.0:1790773197.870772:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+5:2398:x1877761484444800:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1790773197.870794:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+5:2398:x1877761484444800:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 22us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773197.870800:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 272 00000100:00100000:3.0:1790773197.870810:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 273 00000100:00100000:3.0:1790773197.870816:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2398:x1877761484445056:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1790773197.870836:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2398:x1877761484445056:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 21us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773197.870842:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 273 00000100:00080000:3.0:1790773197.870855:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790773197.870859:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790773197.871032:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484444672 00000100:00100000:1.0:1790773197.871038:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484444672 00000100:00100000:1.0:1790773197.871069:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 381 00000100:00100000:1.0:1790773197.871076:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25120ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:2398:x1877761484444672:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773197.871105:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25120ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:2398:x1877761484444672:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 31us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773197.871111:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 381 00000100:00100000:2.0:1790773197.871612:0:8392:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484444928 00000100:00100000:2.0:1790773197.871619:0:8392:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484444928 00000100:00100000:2.0:1790773197.871672:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 100 00000100:00100000:2.0:1790773197.871681:0:8392:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:110130ab-04fa-4d7c-984e-562032df4432+7:2398:x1877761484444928:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1790773197.871723:0:8392:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:110130ab-04fa-4d7c-984e-562032df4432+7:2398:x1877761484444928:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 44us (1350us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773197.871729:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 100 00000100:00080000:1.0:1790773197.871825:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790773197.902521:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773197.907441:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484445440 00000100:00100000:0.0:1790773197.907634:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484445440 00000100:00100000:1.0:1790773197.908028:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 107 00000100:00100000:1.0:1790773197.908041:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+34:11313:x1877761484445440:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:1.0:1790773197.908069:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773197.908093:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc78420cf lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bcd5 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.908255:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc78420d6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.908272:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc78420d6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.908284:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc78420d6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.908310:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc78420dd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.908332:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc78420dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.908348:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc78420dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790773197.908735:0:6478:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:1.0:1790773197.908907:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc78420e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.908917:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc78420e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.908925:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc78420e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.908956:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc78420d6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.908963:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc78420d6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.908970:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc78420d6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.908976:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12b200 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773197.908980:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc78420d6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.908988:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc78420d6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.909011:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93d14363d100) 00010000:00010000:1.0:1790773197.909014:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790773197.909020:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc78420d6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.909026:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc78420d6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790773197.909039:0:6478:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d3281917 reply state 00000000addbeaf9 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc78420dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.909049:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc78420dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.909055:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93d14363d300) 00010000:00010000:1.0:1790773197.909057:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790773197.909059:0:6478:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790773197.909085:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc78420cf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcd5 expref: 37 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.909098:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc78420e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcd5 expref: 36 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.909105:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93d14363df00) 00010000:00010000:1.0:1790773197.909108:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790773197.909110:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12be00, rc 0) 00000100:00100000:1.0:1790773197.909421:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+37:11313:x1877761484445440:12345-192.168.202.19@tcp:101:bash.0 Request processed in 1383us (6911us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1790773197.909428:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 107 00000100:00100000:3.0:1790773197.914120:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773197.914312:0:8907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484445568 00000100:00100000:0.0:1790773197.914324:0:8907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484445568 00000100:00100000:0.0:1790773197.914380:0:8907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 42 00000100:00100000:0.0:1790773197.914389:0:8907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:110130ab-04fa-4d7c-984e-562032df4432+7:2400:x1877761484445568:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:0.0:1790773197.914409:0:8907:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773197.914431:0:8907:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c2206ad/0xabf1cc0bc78420f2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bcdc expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790773197.914461:0:8907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790773197.914483:0:8907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=340s v=(0 0) 00010000:00010000:0.0:1790773197.914487:0:8907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790773197.914497:0:8907:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c2206ad/0xabf1cc0bc78420f2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcdc expref: 8 pid: 8907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.914540:0:8907:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007c2206ad/0xabf1cc0bc78420f2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcdc expref: 8 pid: 8907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773197.914554:0:8907:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074bc00, rc 0) 00000100:00100000:0.0:1790773197.914624:0:8907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:110130ab-04fa-4d7c-984e-562032df4432+8:2400:x1877761484445568:12345-192.168.202.19@tcp:101:bash.0 Request processed in 235us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773197.914632:0:8907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 42 00000100:00100000:0.0:1790773197.916826:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773197.916877:0:8906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484445696 00000100:00100000:2.0:1790773197.916887:0:8906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484445696 00000100:00100000:2.0:1790773197.916933:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 43 00000100:00100000:2.0:1790773197.916939:0:8906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144499f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:110130ab-04fa-4d7c-984e-562032df4432+8:11313:x1877761484445696:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:2.0:1790773197.916954:0:8906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773197.916968:0:8906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006cceac74/0xabf1cc0bc78420f9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bce3 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773197.916991:0:8906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007c2206ad/0xabf1cc0bc78420f2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcdc expref: 9 pid: 8907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773197.917006:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790773197.917008:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790773197.917012:0:8906:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006cceac74/0xabf1cc0bc78420f9 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bce3 expref: 9 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773197.917038:0:8906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007c2206ad/0xabf1cc0bc78420f2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcdc expref: 9 pid: 8907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773197.917049:0:8906:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007c2206ad/0xabf1cc0bc78420f2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcdc expref: 9 pid: 8907 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773197.917060:0:8906:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8906:1877761496051328:192.168.202.19@tcp:104: 00000100:00100000:2.0:1790773197.917124:0:8906:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c1446c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790773197.921176:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773197.921428:0:8906:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8906:1877761496051328:192.168.202.19@tcp:104: 00010000:00010000:1.0:1790773197.921466:0:8906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006cceac74/0xabf1cc0bc78420f9 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bce3 expref: 9 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773197.921486:0:8906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26efc4600, rc 0) 00000100:00100000:1.0:1790773197.921552:0:8906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144499f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:110130ab-04fa-4d7c-984e-562032df4432+9:11313:x1877761484445696:12345-192.168.202.19@tcp:101:bash.0 Request processed in 4611us (4733us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773197.921561:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 43 00000100:00100000:3.0:1790773197.924524:0:6465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484445824 00000100:00100000:3.0:1790773197.924608:0:6465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484445824 00010000:00010000:3.0:1790773197.924673:0:6465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007c2206ad/0xabf1cc0bc78420f2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcdc expref: 9 pid: 8907 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773197.924726:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 68 00000100:00100000:3.0:1790773197.924737:0:6465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:110130ab-04fa-4d7c-984e-562032df4432+9:2398:x1877761484445824:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790773197.924779:0:6465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773197.924807:0:6465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007c2206ad/0xabf1cc0bc78420f2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcdc expref: 9 pid: 8907 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773197.924823:0:6465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007c2206ad/0xabf1cc0bc78420f2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcdc expref: 9 pid: 8907 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773197.924853:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c2206ad/0xabf1cc0bc78420f2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcdc expref: 9 pid: 8907 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773197.924880:0:6465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773197.924885:0:6465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773197.924894:0:6465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006cceac74/0xabf1cc0bc78420f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bce3 expref: 8 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773197.924906:0:6465:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006cceac74/0xabf1cc0bc78420f9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bce3 expref: 8 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773197.924954:0:6465:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006cceac74/0xabf1cc0bc78420f9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bce3 expref: 8 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773197.924970:0:6465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa95f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6465:1877761496051456:192.168.202.19@tcp:105: 00000100:00100000:3.0:1790773197.925080:0:6465:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d143779f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790773197.929856:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773197.930018:0:6465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa95f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6465:1877761496051456:192.168.202.19@tcp:105: 00010000:00010000:0.0:1790773197.930048:0:6465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790773197.930119:0:6465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:110130ab-04fa-4d7c-984e-562032df4432+8:2398:x1877761484445824:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 5384us (8953us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773197.930131:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 68 00000100:00100000:1.0:1790773197.930694:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484446080 00000100:00100000:1.0:1790773197.930704:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484446080 00000100:00100000:1.0:1790773197.930759:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 25 00000100:00100000:1.0:1790773197.930771:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:110130ab-04fa-4d7c-984e-562032df4432+37:11313:x1877761484446080:12345-192.168.202.19@tcp:35:bash.0 00000100:00100000:1.0:1790773197.931054:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:110130ab-04fa-4d7c-984e-562032df4432+38:11313:x1877761484446080:12345-192.168.202.19@tcp:35:bash.0 Request processed in 286us (1211us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1790773197.931059:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 25 00000100:00100000:2.0:1790773198.097487:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773198.097790:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484446208 00000100:00100000:3.0:1790773198.097800:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484446208 00000100:00100000:3.0:1790773198.097885:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 108 00000100:00100000:3.0:1790773198.097922:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+38:11329:x1877761484446208:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:3.0:1790773198.097949:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773198.097971:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc7842100 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bcea expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773198.098043:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc7842107 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773198.098059:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc7842107 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773198.098070:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc7842107 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1790773198.098087:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:3.0:1790773198.098115:0:6479:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1790773198.098118:0:6479:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790773198.098137:0:6479:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc7842107 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773198.098167:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc7842100 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcea expref: 40 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773198.098180:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc7842107 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcea expref: 39 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773198.098194:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93d14363d100) 00010000:00010000:3.0:1790773198.098198:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790773198.098201:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d1434ad200, rc 0) 00000100:00100000:3.0:1790773198.098418:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+39:11329:x1877761484446208:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 499us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773198.098435:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 108 00000100:00100000:0.0:1790773198.102998:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773198.103814:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484446464 00000100:00100000:1.0:1790773198.103829:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484446464 00000100:00100000:1.0:1790773198.103932:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 109 00000100:00100000:1.0:1790773198.103943:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144498700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+39:11329:x1877761484446464:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1790773198.103972:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773198.103995:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc784210e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bcf1 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773198.104119:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7842115 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773198.104155:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7842115 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773198.104168:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7842115 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790773198.104182:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1790773198.104513:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc784210e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcf1 expref: 42 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773198.104535:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7842115 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcf1 expref: 41 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773198.104545:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93d14363df00) 00010000:00010000:1.0:1790773198.104549:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790773198.104553:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12a400, rc 0) 00000100:00100000:1.0:1790773198.104699:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144498700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+41:11329:x1877761484446464:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 757us (1713us total) trans 4294967380 rc 0/0 00000100:00100000:1.0:1790773198.104707:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 109 00000100:00100000:1.0:1790773198.108609:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773198.108669:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773198.108787:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484446848 00000100:00100000:3.0:1790773198.108799:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484446848 00000100:00100000:3.0:1790773198.108862:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 110 00000100:00100000:3.0:1790773198.108873:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+41:11329:x1877761484446848:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:3.0:1790773198.108901:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773198.108927:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7842123 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bcf8 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773198.109041:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc784212a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773198.109057:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc784212a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773198.109070:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc784212a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790773198.109082:0:6478:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1790773198.109193:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7842123 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcf8 expref: 44 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773198.109362:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc784212a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcf8 expref: 43 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773198.109373:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93d14363df00) 00010000:00010000:3.0:1790773198.109376:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1790773198.109379:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d1434ade00, rc 0) 00000100:00100000:3.0:1790773198.109581:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+43:11329:x1877761484446848:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 708us (909us total) trans 4294967381 rc 0/0 00000100:00100000:3.0:1790773198.109588:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 110 00000100:00100000:0.0:1790773198.110365:0:6463:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484446592 00000100:00100000:0.0:1790773198.110374:0:6463:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484446592 00000100:00100000:0.0:1790773198.110425:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:0.0:1790773198.110434:0:6463:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512c9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:110130ab-04fa-4d7c-984e-562032df4432+43:2398:x1877761484446592:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790773198.110457:0:6463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773198.110475:0:6463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7842115 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcf1 expref: 43 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.110490:0:6463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93d14363df00) 00010000:00010000:0.0:1790773198.110493:0:6463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790773198.110532:0:6463:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512c9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:110130ab-04fa-4d7c-984e-562032df4432+42:2398:x1877761484446592:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 99us (1936us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773198.110539:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:2.0:1790773198.117407:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773198.117987:0:8394:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484446976 00000100:00100000:0.0:1790773198.118000:0:8394:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484446976 00000100:00100000:0.0:1790773198.118100:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 44 00000100:00100000:0.0:1790773198.118112:0:8394:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:110130ab-04fa-4d7c-984e-562032df4432+8:2397:x1877761484446976:12345-192.168.202.19@tcp:1:lfs.0 00010000:00010000:0.0:1790773198.118172:0:8394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083c4e23b/0xabf1cc0bc7842138 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.118194:0:8394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006cceac74/0xabf1cc0bc78420f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bce3 expref: 8 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.118230:0:8394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790773198.118236:0:8394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790773198.118242:0:8394:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083c4e23b/0xabf1cc0bc7842138 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.118287:0:8394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006cceac74/0xabf1cc0bc78420f9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bce3 expref: 8 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.118304:0:8394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006cceac74/0xabf1cc0bc78420f9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bce3 expref: 8 pid: 8906 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773198.118320:0:8394:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144499180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8394:1877761496051584:192.168.202.19@tcp:104: 00000100:00100000:0.0:1790773198.118513:0:8394:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d14265b000 going to sleep for 11 seconds 00000100:00100000:1.0:1790773198.122305:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773198.122887:0:8400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484447104 00000100:00100000:2.0:1790773198.122899:0:8400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484447104 00002000:00100000:2.0:1790773198.122958:0:8400:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff93d27fa91c00 x1877761484447104/t0(0) o4->110130ab-04fa-4d7c-984e-562032df4432@192.168.202.19@tcp:34/0 lens 504/0 e 0 to 0 dl 1790773209 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790773198.122970:0:8400:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93d27fa91c00 with x1877761484447104 ext(0->8) 00010000:00010000:2.0:1790773198.122982:0:8400:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000006cceac74/0xabf1cc0bc78420f9 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bce3 expref: 9 pid: 8906 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773198.123019:0:8400:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000006cceac74/0xabf1cc0bc78420f9 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bce3 expref: 9 pid: 8906 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790773198.123029:0:8400:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93d27fa91c00 00000100:00100000:2.0:1790773198.123069:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 1 00000100:00100000:2.0:1790773198.123079:0:8400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:110130ab-04fa-4d7c-984e-562032df4432+9:2397:x1877761484447104:12345-192.168.202.19@tcp:4:lfs.0 00000100:00100000:2.0:1790773198.124296:0:8400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:110130ab-04fa-4d7c-984e-562032df4432+11:2397:x1877761484447104:12345-192.168.202.19@tcp:4:lfs.0 Request processed in 1210us (1995us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1790773198.124309:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 1 00002000:00100000:2.0:1790773198.124320:0:8400:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff93d27fa91c00 x1877761484447104/t4294967303(0) o4->110130ab-04fa-4d7c-984e-562032df4432@192.168.202.19@tcp:34/0 lens 504/448 e 0 to 0 dl 1790773209 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790773198.124331:0:8400:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93d27fa91c00 with x1877761484447104 ext(0->8) 00010000:00010000:2.0:1790773198.124349:0:8400:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000006cceac74/0xabf1cc0bc78420f9 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bce3 expref: 11 pid: 8906 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773198.124367:0:8400:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000006cceac74/0xabf1cc0bc78420f9 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bce3 expref: 11 pid: 8906 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790773198.124375:0:8400:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93d27fa91c00 00000100:00100000:0.0:1790773198.124554:0:8394:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144499180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8394:1877761496051584:192.168.202.19@tcp:104: 00010000:00010000:0.0:1790773198.124598:0:8394:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000083c4e23b/0xabf1cc0bc7842138 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773198.126746:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773198.126873:0:10300:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484447232 00000100:00100000:2.0:1790773198.126882:0:10300:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484447232 00010000:00010000:2.0:1790773198.126919:0:10300:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006cceac74/0xabf1cc0bc78420f9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bce3 expref: 11 pid: 8906 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773198.126984:0:10300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 69 00000100:00100000:2.0:1790773198.126995:0:10300:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:110130ab-04fa-4d7c-984e-562032df4432+11:2398:x1877761484447232:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790773198.127012:0:10300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1790773198.127032:0:10300:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1790773198.127035:0:10300:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1790773198 00002000:00010000:2.0:1790773198.127037:0:10300:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1790773198 00002000:00010000:2.0:1790773198.127039:0:10300:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1790773198 00002000:00010000:2.0:1790773198.127040:0:10300:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1790773198.127045:0:10300:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006cceac74/0xabf1cc0bc78420f9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bce3 expref: 11 pid: 8906 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773198.127059:0:10300:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006cceac74/0xabf1cc0bc78420f9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bce3 expref: 11 pid: 8906 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773198.127083:0:10300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006cceac74/0xabf1cc0bc78420f9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bce3 expref: 11 pid: 8906 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773198.127100:0:10300:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790773198.127104:0:10300:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790773198.127109:0:10300:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000083c4e23b/0xabf1cc0bc7842138 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773198.127119:0:10300:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083c4e23b/0xabf1cc0bc7842138 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773198.127167:0:10300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790773198.127261:0:10300:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:110130ab-04fa-4d7c-984e-562032df4432+10:2398:x1877761484447232:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 267us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773198.127268:0:10300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 69 00010000:00010000:1.0:1790773198.127861:0:8394:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000083c4e23b/0xabf1cc0bc7842138 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773198.127874:0:8394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083c4e23b/0xabf1cc0bc7842138 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773198.127905:0:8394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083c4e23b/0xabf1cc0bc7842138 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773198.127914:0:8394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083c4e23b/0xabf1cc0bc7842138 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773198.127922:0:8394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083c4e23b/0xabf1cc0bc7842138 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773198.127929:0:8394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074ae00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:1.0:1790773198.127933:0:8394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083c4e23b/0xabf1cc0bc7842138 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773198.127942:0:8394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083c4e23b/0xabf1cc0bc7842138 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773198.127955:0:8394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083c4e23b/0xabf1cc0bc7842138 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773198.127962:0:8394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083c4e23b/0xabf1cc0bc7842138 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773198.128031:0:8394:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:110130ab-04fa-4d7c-984e-562032df4432+9:2397:x1877761484446976:12345-192.168.202.19@tcp:1:lfs.0 Request processed in 9920us (10693us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773198.128040:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 44 00000100:00100000:1.0:1790773198.130471:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773198.130552:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484447488 00000100:00100000:3.0:1790773198.130562:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484447488 00000100:00100000:3.0:1790773198.130620:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 26 00000100:00100000:3.0:1790773198.130631:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d279db9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:110130ab-04fa-4d7c-984e-562032df4432+42:11329:x1877761484447488:12345-192.168.202.19@tcp:35:lfs.0 00000004:00010000:3.0:1790773198.130715:0:6481:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc784212a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcf8 expref: 42 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790773198.130961:0:6481:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:3.0:1790773198.130999:0:6481:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1790773198.131438:0:6481:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:3.0:1790773198.131478:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc784213f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773198.131495:0:6481:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc78420e4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcd5 expref: 46 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773198.131504:0:6481:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc784213f lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773198.131541:0:6481:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc78420e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcd5 expref: 46 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773198.131557:0:6481:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc78420e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcd5 expref: 46 pid: 6478 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773198.131570:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa94700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6481:1877761496051712:192.168.202.19@tcp:104: 00000100:00100000:3.0:1790773198.131785:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d143779f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790773198.135162:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773198.135269:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa94700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6481:1877761496051712:192.168.202.19@tcp:104: 00010000:00010000:3.0:1790773198.135296:0:6481:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc784213f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773198.135887:0:6465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484447616 00000100:00100000:2.0:1790773198.135898:0:6465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484447616 00010000:00010000:2.0:1790773198.135940:0:6465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc78420e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcd5 expref: 47 pid: 6478 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773198.135985:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 70 00000100:00100000:2.0:1790773198.135996:0:6465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:110130ab-04fa-4d7c-984e-562032df4432+47:2398:x1877761484447616:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790773198.136012:0:6465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790773198.136019:0:6465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc78420e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcd5 expref: 47 pid: 6478 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773198.136032:0:6465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc78420e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcd5 expref: 47 pid: 6478 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773198.136053:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc78420e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcd5 expref: 47 pid: 6478 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773198.136069:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93d14363df00) 00010000:00010000:2.0:1790773198.136074:0:6465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc784213f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773198.136082:0:6465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc784213f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773198.136103:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc784213f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773198.136124:0:6465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790773198.136179:0:6465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:110130ab-04fa-4d7c-984e-562032df4432+46:2398:x1877761484447616:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 185us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773198.136187:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 70 00010000:00010000:3.0:1790773198.138041:0:6481:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc784213f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773198.138059:0:6481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc784213f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790773198.138182:0:6481:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:3.0:1790773198.138605:0:6481:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:3.0:1790773198.138804:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa94700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6481:1877761496051840:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1790773198.138875:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773198.138954:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d1437793c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790773198.139053:0:6483:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496051840 00000100:00100000:1.0:1790773198.139061:0:6483:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496051840 00000100:00100000:1.0:1790773198.139163:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1790773198.139175:0:6483:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6481:x1877761496051840:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1790773198.139291:0:6483:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6481:x1877761496051840:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 118us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773198.139298:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1790773198.139478:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa94700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6481:1877761496051840:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1790773198.139588:0:6481:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:2.0:1790773198.139634:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143c7ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6481:1877761496051968:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1790773198.139675:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773198.139703:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c1446c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790773198.139801:0:12789:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496051968 00000100:00100000:0.0:1790773198.139806:0:12789:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496051968 00000100:00100000:0.0:1790773198.139840:0:12789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1790773198.139848:0:12789:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:6481:x1877761496051968:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1790773198.139962:0:12789:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+8:6481:x1877761496051968:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 115us (285us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1790773198.139969:0:12789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1790773198.140066:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143c7ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6481:1877761496051968:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1790773198.140101:0:6481:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:1.0:1790773198.140131:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc784213f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773198.140141:0:6481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc784213f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773198.140148:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc784213f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773198.140154:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ada00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773198.140160:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc784213f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773198.140168:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc784213f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773198.140184:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93d14363df00) 00010000:00010000:1.0:1790773198.140187:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1790773198.140192:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc784213f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773198.140243:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc784213f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790773198.140628:0:6481:0:(mdd_object.c:4189:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1790773198.140776:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:1.0:1790773198.140789:0:6481:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 340942583614ns, next at 341942581301ns, rc = 0 00000001:00080000:1.0:1790773198.140797:0:6481:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:1.0:1790773198.140823:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93d14363df00) 00010000:00010000:1.0:1790773198.140827:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1790773198.140835:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc784212a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcf8 expref: 50 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773198.140996:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d279db9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:110130ab-04fa-4d7c-984e-562032df4432+49:11329:x1877761484447488:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 10366us (10532us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1790773198.141006:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 26 00000020:00080000:1.0:1790773198.141011:0:6481:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:3.0:1790773198.141101:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790773198.143843:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773198.143930:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484447744 00000100:00100000:0.0:1790773198.143940:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484447744 00000100:00100000:0.0:1790773198.144020:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 111 00000100:00100000:0.0:1790773198.144030:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+49:11329:x1877761484447744:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:0.0:1790773198.144056:0:8697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773198.144079:0:8697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7842146 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bcff expref: -99 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.144137:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7842146 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcff expref: 50 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.144151:0:8697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7842146 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcff expref: 50 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.144170:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93d26ede0200) 00010000:00010000:0.0:1790773198.144174:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790773198.144193:0:8697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074a400, rc 0) 00000100:00100000:0.0:1790773198.144288:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+50:11329:x1877761484447744:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 259us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773198.144296:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 111 00000100:00100000:0.0:1790773198.149441:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773198.149591:0:6482:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484448000 00000100:00100000:2.0:1790773198.149601:0:6482:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484448000 00000100:00100000:2.0:1790773198.149662:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 27 00000100:00100000:2.0:1790773198.149670:0:6482:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144499180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+50:11329:x1877761484448000:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:2.0:1790773198.149924:0:6482:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144499180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+51:11329:x1877761484448000:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 252us (492us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1790773198.149932:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 27 00000100:00100000:3.0:1790773198.157669:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496052096:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790773198.157750:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773198.157866:0:11145:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496052096 00000100:00100000:1.0:1790773198.157875:0:11145:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496052096 00000100:00100000:1.0:1790773198.157942:0:11145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1790773198.157953:0:11145:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496052096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790773198.157980:0:11145:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:1.0:1790773198.158029:0:11145:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496052096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773198.158037:0:11145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:3.0:1790773198.158145:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790773198.158184:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496052096:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790773198.158480:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790773198.158489:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496052224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790773198.158519:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773198.158624:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790773198.158634:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496052352:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790773198.158694:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773198.158727:0:6483:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496052352 00000100:00100000:1.0:1790773198.158732:0:6483:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496052352 00000100:00100000:1.0:1790773198.158762:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1790773198.158770:0:6483:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496052352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790773198.158799:0:6483:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1790773198.158840:0:6483:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496052352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773198.158846:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1790773198.158878:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496052352:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790773198.159230:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496052224 00000100:00100000:0.0:1790773198.159236:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496052224 00000100:00100000:0.0:1790773198.159271:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1790773198.159278:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3604:x1877761496052224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790773198.159307:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:0.0:1790773198.159361:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3604:x1877761496052224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773198.159368:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:0.0:1790773198.159389:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790773198.159419:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496052224:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790773198.159638:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496052736:0@lo:400:kworker.0 00000100:00100000:2.0:1790773198.159680:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773198.159697:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496053248:0@lo:400:kworker.0 00000100:00100000:2.0:1790773198.159717:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773198.159736:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1790773198.159741:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3605:1877761496052608:0@lo:400:kworker.0 00000100:00100000:2.0:1790773198.159775:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773198.159790:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3605:1877761496053120:0@lo:400:kworker.0 00000100:00100000:2.0:1790773198.159810:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773198.160165:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496052608 00000100:00100000:1.0:1790773198.160171:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496052608 00000100:00100000:1.0:1790773198.160230:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496053120 00000100:00100000:1.0:1790773198.160234:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496053120 00000100:00100000:1.0:1790773198.160261:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1790773198.160268:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3605:x1877761496052608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773198.160312:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3605:x1877761496052608:12345-0@lo:400:kworker.0 Request processed in 44us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773198.160319:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1790773198.160347:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1790773198.160354:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3605:x1877761496053120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773198.160384:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3605:x1877761496053120:12345-0@lo:400:kworker.0 Request processed in 31us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773198.160390:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00080000:0.0:1790773198.160587:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790773198.160601:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce0675b4-b0c5-48e7-b182-565e22fed04c:3607:1877761496052480:0@lo:400:kworker.0 00000100:00100000:0.0:1790773198.160636:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773198.160678:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3607:1877761496052992:0@lo:400:kworker.0 00000100:00100000:0.0:1790773198.160701:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773198.160718:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3607:1877761496053504:0@lo:400:kworker.0 00000100:00100000:0.0:1790773198.160740:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773198.160759:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1790773198.160765:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877761496052864:0@lo:400:kworker.0 00000100:00100000:0.0:1790773198.160786:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773198.160799:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3607:1877761496053376:0@lo:400:kworker.0 00000100:00100000:0.0:1790773198.160832:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773198.160854:0:12789:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496052736 00000100:00100000:0.0:1790773198.160859:0:12789:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496052736 00000100:00100000:0.0:1790773198.160887:0:12789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1790773198.160893:0:12789:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496052736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773198.160929:0:12789:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496052736:12345-0@lo:400:kworker.0 Request processed in 35us (1248us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773198.160934:0:12789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1790773198.160958:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496052992 00000100:00100000:0.0:1790773198.160961:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496052992 00000100:00100000:0.0:1790773198.160982:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496053504 00000100:00100000:0.0:1790773198.160985:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496053504 00000100:00100000:0.0:1790773198.160996:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496052864 00000100:00100000:0.0:1790773198.160998:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496052864 00000100:00100000:0.0:1790773198.161007:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496053376 00000100:00100000:0.0:1790773198.161009:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496053376 00000100:00100000:0.0:1790773198.161022:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1790773198.161028:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14449a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1877761496052992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773198.161060:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14449a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1877761496052992:12345-0@lo:400:kworker.0 Request processed in 32us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773198.161066:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1790773198.161078:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1790773198.161083:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144498a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1877761496053504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773198.161109:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144498a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1877761496053504:12345-0@lo:400:kworker.0 Request processed in 26us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773198.161114:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1790773198.161125:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1790773198.161131:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144498e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877761496052864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773198.161166:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144498e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877761496052864:12345-0@lo:400:kworker.0 Request processed in 35us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773198.161171:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1790773198.161183:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1790773198.161201:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14449b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1877761496053376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773198.161256:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14449b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1877761496053376:12345-0@lo:400:kworker.0 Request processed in 68us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773198.161262:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00080000:0.0:1790773198.161275:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790773198.161278:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790773198.161302:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877761496052864:0@lo:400:kworker.0 00000100:00100000:0.0:1790773198.161311:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3607:1877761496053376:0@lo:400:kworker.0 00000100:00100000:0.0:1790773198.161320:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3607:1877761496052992:0@lo:400:kworker.0 00010000:00080000:0.0:1790773198.161329:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27fa89180 x1877761496053504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773198.161446:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3607:1877761496053504:0@lo:400:kworker.0 00000100:00100000:2.0:1790773198.161549:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3605:1877761496052608:0@lo:400:kworker.0 00010000:00080000:2.0:1790773198.161561:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27fa88380 x1877761496053120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773198.161570:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3605:1877761496053120:0@lo:400:kworker.0 00000100:00100000:2.0:1790773198.161579:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496052736:0@lo:400:kworker.0 00000100:00100000:1.0:1790773198.162237:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496052480 00000100:00100000:1.0:1790773198.162246:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496052480 00000100:00100000:1.0:1790773198.162302:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1790773198.162310:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d251209450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3607:x1877761496052480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773198.162383:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d251209450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3607:x1877761496052480:12345-0@lo:400:kworker.0 Request processed in 74us (1746us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773198.162390:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1790773198.162544:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce0675b4-b0c5-48e7-b182-565e22fed04c:3607:1877761496052480:0@lo:400:kworker.0 00000100:00100000:0.0:1790773198.162777:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496053632:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790773198.162813:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773198.162873:0:6483:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496053632 00000100:00100000:1.0:1790773198.162878:0:6483:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496053632 00000100:00100000:1.0:1790773198.162913:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1790773198.162920:0:6483:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14449b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496053632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790773198.162945:0:6483:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1790773198.163055:0:8393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496053248 00000100:00100000:3.0:1790773198.163061:0:8393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496053248 00000100:00100000:3.0:1790773198.163105:0:8393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1790773198.163112:0:8393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496053248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773198.163158:0:8393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496053248:12345-0@lo:400:kworker.0 Request processed in 46us (3439us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773198.163166:0:8393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:3.0:1790773198.163184:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790773198.163287:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496053248:0@lo:400:kworker.0 00000100:00100000:1.0:1790773198.163696:0:6483:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14449b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496053632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 775us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773198.163703:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1790773198.163797:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496053632:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790773198.298960:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773198.299013:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484448128 00000100:00100000:0.0:1790773198.299025:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484448128 00000100:00100000:0.0:1790773198.299146:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 112 00000100:00100000:0.0:1790773198.299155:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+51:11339:x1877761484448128:12345-192.168.202.19@tcp:34:lfs.0 00010000:00010000:0.0:1790773198.299327:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc784214d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.299343:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc784214d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.299357:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc784214d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.299368:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc7842154 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.299376:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc7842154 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.299383:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc7842154 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.299447:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc784215b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.299455:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc784215b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.299462:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc784215b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790773198.299508:0:8697:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc784215b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.299521:0:8697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc784214d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.299796:0:8697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc784214d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.299803:0:8697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc784214d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.299809:0:8697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074b200 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773198.299814:0:8697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc784214d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.299823:0:8697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc784214d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.299836:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93d14363d100) 00010000:00010000:0.0:1790773198.299839:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773198.299845:0:8697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc784214d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.299850:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc784214d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.299863:0:8697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc7842154 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.299869:0:8697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc7842154 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.299875:0:8697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc7842154 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.299880:0:8697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074be00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773198.299888:0:8697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc7842154 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.299894:0:8697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc7842154 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.299901:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93d14363d300) 00010000:00010000:0.0:1790773198.299904:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773198.299907:0:8697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc7842154 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.299912:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc7842154 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.299921:0:8697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc784215b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.299926:0:8697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc784215b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.299932:0:8697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc784215b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.299936:0:8697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074b000 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773198.299939:0:8697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc784215b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.299945:0:8697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc784215b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.299952:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93d26ede0200) 00010000:00010000:0.0:1790773198.299954:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773198.299963:0:8697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc784215b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.299969:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc784215b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773198.300093:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+51:11339:x1877761484448128:12345-192.168.202.19@tcp:34:lfs.0 Request processed in 936us (1192us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773198.300102:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 112 00000100:00100000:3.0:1790773198.334815:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773198.335369:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484448384 00000100:00100000:2.0:1790773198.335380:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484448384 00000100:00100000:2.0:1790773198.335449:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 113 00000100:00100000:2.0:1790773198.335460:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+51:11342:x1877761484448384:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1790773198.335482:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773198.335503:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc7842162 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bd06 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773198.335609:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4600/0xabf1cc0bc7842169 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773198.335626:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4600/0xabf1cc0bc7842169 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773198.335666:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4600/0xabf1cc0bc7842169 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773198.335679:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7842170 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773198.335688:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7842170 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773198.335694:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7842170 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773198.335807:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7842177 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773198.335817:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7842177 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773198.335823:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7842177 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790773198.335833:0:6478:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1790773198.335905:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4600/0xabf1cc0bc7842169 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773198.335913:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4600/0xabf1cc0bc7842169 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773198.335920:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4600/0xabf1cc0bc7842169 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773198.335926:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc4600 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:2.0:1790773198.335937:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4600/0xabf1cc0bc7842169 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773198.335945:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4600/0xabf1cc0bc7842169 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773198.335957:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93d14363d100) 00010000:00010000:2.0:1790773198.335959:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790773198.335962:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4600/0xabf1cc0bc7842169 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773198.335967:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4600/0xabf1cc0bc7842169 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773198.335976:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7842170 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773198.335980:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7842170 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773198.335983:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7842170 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773198.335986:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc5600 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:2.0:1790773198.335988:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7842170 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773198.335991:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7842170 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773198.335995:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93d14363d300) 00010000:00010000:2.0:1790773198.335996:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790773198.336002:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7842170 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773198.336005:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7842170 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773198.336033:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc7842162 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd06 expref: 54 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773198.336045:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7842177 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd06 expref: 53 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773198.336050:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93d26ede0200) 00010000:00010000:2.0:1790773198.336051:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790773198.336053:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26efc5000, rc 0) 00000100:00100000:2.0:1790773198.336111:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+53:11342:x1877761484448384:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 654us (1309us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1790773198.336116:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 113 00000100:00100000:1.0:1790773198.341102:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773198.341242:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484448512 00000100:00100000:3.0:1790773198.341252:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484448512 00000100:00100000:3.0:1790773198.341316:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 114 00000100:00100000:3.0:1790773198.341327:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+53:11342:x1877761484448512:12345-192.168.202.19@tcp:54:lfs.0 00010000:00010000:3.0:1790773198.341395:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc7842185 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773198.341413:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc7842185 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773198.341424:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc7842185 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773198.341454:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc7842185 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773198.341461:0:6480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc7842185 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773198.341468:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc7842185 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773198.341473:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ac200 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773198.341478:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc7842185 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773198.341504:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc7842185 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773198.341516:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93d26ede0200) 00010000:00010000:3.0:1790773198.341519:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790773198.341524:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc7842185 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773198.341530:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc7842185 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773198.341613:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+53:11342:x1877761484448512:12345-192.168.202.19@tcp:54:lfs.0 Request processed in 287us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773198.341621:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 114 00000100:00100000:3.0:1790773198.351138:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773198.351520:0:6482:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484448768 00000100:00100000:2.0:1790773198.351530:0:6482:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484448768 00000100:00100000:2.0:1790773198.351591:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 28 00000100:00100000:2.0:1790773198.351601:0:6482:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+53:11342:x1877761484448768:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:2.0:1790773198.351940:0:6482:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+54:11342:x1877761484448768:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 340us (812us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1790773198.351949:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 28 00000100:00100000:1.0:1790773198.444250:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773198.444351:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484449024 00000100:00100000:0.0:1790773198.444362:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484449024 00000100:00100000:0.0:1790773198.444428:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 115 00000100:00100000:0.0:1790773198.444439:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+54:11352:x1877761484449024:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:0.0:1790773198.444465:0:8697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773198.444469:0:8697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790773198.444497:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc7842107 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcea expref: 54 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.444518:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93d14363d100) 00010000:00010000:0.0:1790773198.444523:0:8697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790773198.444549:0:8697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc784218c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bd0d expref: -99 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.444656:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842193 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.444670:0:8697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7842177 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd06 expref: 54 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.444689:0:8697:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842193 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.444733:0:8697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7842177 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd06 expref: 54 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.444748:0:8697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7842177 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd06 expref: 54 pid: 6478 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773198.444762:0:8697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14449ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8697:1877761496053760:192.168.202.19@tcp:104: 00000100:00100000:0.0:1790773198.445139:0:8697:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d14265b000 going to sleep for 11 seconds 00000100:00100000:0.0:1790773198.448067:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773198.448196:0:8697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14449ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8697:1877761496053760:192.168.202.19@tcp:104: 00010000:00010000:2.0:1790773198.448257:0:8697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842193 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773198.448481:0:8410:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484449152 00000100:00100000:1.0:1790773198.448489:0:8410:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484449152 00010000:00010000:1.0:1790773198.448525:0:8410:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7842177 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd06 expref: 55 pid: 6478 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773198.448565:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 71 00000100:00100000:1.0:1790773198.448575:0:8410:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14449bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:110130ab-04fa-4d7c-984e-562032df4432+55:2398:x1877761484449152:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790773198.448589:0:8410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790773198.448596:0:8410:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7842177 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd06 expref: 55 pid: 6478 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773198.448608:0:8410:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7842177 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd06 expref: 55 pid: 6478 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773198.448637:0:8410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7842177 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd06 expref: 55 pid: 6478 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773198.448664:0:8410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93d26ede0200) 00010000:00010000:1.0:1790773198.448669:0:8410:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842193 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773198.448786:0:8410:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842193 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773198.448795:0:8410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842193 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773198.448857:0:8410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790773198.448921:0:8410:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14449bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:110130ab-04fa-4d7c-984e-562032df4432+54:2398:x1877761484449152:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 347us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773198.448928:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 71 00010000:00010000:2.0:1790773198.452656:0:8697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842193 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773198.452844:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842193 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790773198.452871:0:8697:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1790773198.453852:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc784218c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd0d expref: 55 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773198.453876:0:8697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842193 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd0d expref: 54 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773198.453890:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93d26ede0200) 00010000:00010000:2.0:1790773198.453893:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790773198.453896:0:8697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074b200, rc 0) 00000100:00100000:2.0:1790773198.454031:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+54:11352:x1877761484449024:12345-192.168.202.19@tcp:101:bash.0 Request processed in 9592us (9826us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1790773198.454041:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 115 00000100:00100000:0.0:1790773198.457877:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773198.457969:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484449280 00000100:00100000:1.0:1790773198.457981:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484449280 00000100:00100000:1.0:1790773198.458073:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 116 00000100:00100000:1.0:1790773198.458083:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14449a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+54:11352:x1877761484449280:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:1.0:1790773198.458107:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773198.458129:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc78421a1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bd14 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773198.458178:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc78421a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773198.458415:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc78421a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773198.458427:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc78421a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773198.458668:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc78421a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd14 expref: 56 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773198.458793:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc78421a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd14 expref: 55 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773198.458802:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93d26ede0200) 00010000:00010000:1.0:1790773198.458805:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790773198.458808:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12a400, rc 0) 00000100:00100000:1.0:1790773198.458911:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14449a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+55:11352:x1877761484449280:12345-192.168.202.19@tcp:101:bash.0 Request processed in 828us (1043us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773198.458918:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 116 00000100:00100000:3.0:1790773198.461867:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773198.462043:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484449536 00000100:00100000:0.0:1790773198.462055:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484449536 00000100:00100000:0.0:1790773198.462113:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 117 00000100:00100000:0.0:1790773198.462122:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+55:11352:x1877761484449536:12345-192.168.202.19@tcp:36:bash.0 00010000:00010000:0.0:1790773198.462597:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a600/0xabf1cc0bc78421af lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.462618:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a600/0xabf1cc0bc78421af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.462631:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a600/0xabf1cc0bc78421af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790773198.462687:0:6479:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:0.0:1790773198.462710:0:6479:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000970efab4 reply state 000000005df17d45 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a600/0xabf1cc0bc78421af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.462722:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a600/0xabf1cc0bc78421af lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.462747:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93d26ede0200) 00010000:00010000:0.0:1790773198.462749:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790773198.462754:0:6479:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790773198.462971:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+58:11352:x1877761484449536:12345-192.168.202.19@tcp:36:bash.0 Request processed in 847us (1112us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1790773198.462979:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 117 00000020:00080000:0.0:1790773198.462985:0:6479:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1790773198.471034:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773198.471364:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484449664 00000100:00100000:2.0:1790773198.471375:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484449664 00000100:00100000:2.0:1790773198.471433:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 118 00000100:00100000:2.0:1790773198.471444:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+58:11352:x1877761484449664:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:2.0:1790773198.471468:0:8697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773198.471598:0:8697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc78421b6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bd1b expref: -99 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773198.472519:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc78421bd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773198.472550:0:8697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842193 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd0d expref: 59 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773198.472559:0:8697:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc78421bd lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773198.472595:0:8697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842193 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd0d expref: 59 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773198.472611:0:8697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842193 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd0d expref: 59 pid: 8697 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773198.472625:0:8697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa8bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8697:1877761496053888:192.168.202.19@tcp:104: 00000100:00100000:2.0:1790773198.472722:0:8697:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c380240 going to sleep for 11 seconds 00000100:00100000:2.0:1790773198.486358:0:8697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa8bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8697:1877761496053888:192.168.202.19@tcp:104: 00010000:00010000:2.0:1790773198.486390:0:8697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc78421bd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773198.493727:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773198.494180:0:6464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484449792 00000100:00100000:0.0:1790773198.494200:0:6464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484449792 00010000:00010000:0.0:1790773198.494330:0:6464:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842193 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd0d expref: 60 pid: 8697 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773198.495478:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 72 00000100:00100000:0.0:1790773198.495494:0:6464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:110130ab-04fa-4d7c-984e-562032df4432+60:2398:x1877761484449792:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790773198.495515:0:6464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773198.495523:0:6464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842193 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd0d expref: 60 pid: 8697 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.495612:0:6464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842193 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd0d expref: 60 pid: 8697 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.495637:0:6464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842193 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd0d expref: 60 pid: 8697 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.495665:0:6464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93d26ede0200) 00010000:00010000:0.0:1790773198.495671:0:6464:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc78421bd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.495709:0:6464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc78421bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.495716:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc78421bd lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.495760:0:6464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790773198.495953:0:6464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:110130ab-04fa-4d7c-984e-562032df4432+59:2398:x1877761484449792:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 464us (2236us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773198.495962:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 72 00010000:00010000:3.0:1790773198.497292:0:8697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc78421bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773198.497306:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc78421bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790773198.497365:0:8697:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1790773198.497369:0:8697:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790773198.497390:0:8697:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc78421bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773198.497425:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc78421b6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd1b expref: 59 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773198.497459:0:8697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc78421bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd1b expref: 58 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773198.497467:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93d26ede0200) 00010000:00010000:3.0:1790773198.497470:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790773198.497473:0:8697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26efc5600, rc 0) 00000100:00100000:3.0:1790773198.497517:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+58:11352:x1877761484449664:12345-192.168.202.19@tcp:101:bash.0 Request processed in 26076us (26495us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773198.497535:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 118 00000100:00100000:1.0:1790773198.503571:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773198.503636:0:6482:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484450048 00000100:00100000:2.0:1790773198.503653:0:6482:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484450048 00000100:00100000:2.0:1790773198.503717:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 29 00000100:00100000:2.0:1790773198.503728:0:6482:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+58:11352:x1877761484450048:12345-192.168.202.19@tcp:35:bash.0 00000100:00100000:2.0:1790773198.503972:0:6482:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+59:11352:x1877761484450048:12345-192.168.202.19@tcp:35:bash.0 Request processed in 246us (408us total) trans 4294967397 rc 0/0 00000100:00100000:2.0:1790773198.503989:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 29 00000100:00100000:1.0:1790773198.607310:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773198.607560:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484450176 00000100:00100000:2.0:1790773198.607570:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484450176 00000100:00100000:2.0:1790773198.607633:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 119 00000100:00100000:2.0:1790773198.607692:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+59:11358:x1877761484450176:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1790773198.607717:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773198.607740:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4600/0xabf1cc0bc78421c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bd22 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773198.607806:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc78421cb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773198.607819:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc78421cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773198.607830:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc78421cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790773198.607876:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1790773198.607880:0:13768:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790773198.607899:0:13768:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc78421cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773198.607922:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4600/0xabf1cc0bc78421c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd22 expref: 61 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773198.607940:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc78421cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd22 expref: 60 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773198.607967:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93d14363d100) 00010000:00010000:2.0:1790773198.607970:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790773198.607974:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26efc5c00, rc 0) 00000100:00100000:2.0:1790773198.608035:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+60:11358:x1877761484450176:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 391us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773198.608041:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 119 00000100:00100000:3.0:1790773198.611969:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773198.612102:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484450304 00000100:00100000:0.0:1790773198.612113:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484450304 00000100:00100000:0.0:1790773198.612171:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 120 00000100:00100000:0.0:1790773198.612181:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+60:11358:x1877761484450304:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:0.0:1790773198.612250:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773198.612272:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc78421d2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bd29 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.612350:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc78421d9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.612364:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc78421d9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.612374:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc78421d9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.612384:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78421e0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.612410:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78421e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.612416:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78421e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.612490:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc78421e7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.612498:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc78421e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.612505:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc78421e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790773198.612545:0:6479:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1790773198.612549:0:6479:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790773198.612566:0:6479:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc78421e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.612577:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc78421e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.612585:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc78421d9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.612592:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc78421d9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.612598:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc78421d9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.612613:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074aa00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773198.612617:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc78421d9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.612625:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc78421d9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.612636:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93d14363d100) 00010000:00010000:0.0:1790773198.612651:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773198.612657:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc78421d9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.612663:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc78421d9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.612686:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78421e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.612692:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78421e0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.612697:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78421e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.612701:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074be00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773198.612704:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78421e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.612709:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78421e0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.612724:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93d14363d300) 00010000:00010000:0.0:1790773198.612726:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773198.612729:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78421e0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.612734:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78421e0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.612764:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc78421d2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd29 expref: 62 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.612775:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc78421e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd29 expref: 61 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.612781:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93d26ede0200) 00010000:00010000:0.0:1790773198.612784:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790773198.612786:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074b000, rc 0) 00000100:00100000:0.0:1790773198.612843:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+61:11358:x1877761484450304:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 664us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773198.612850:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 120 00000100:00100000:1.0:1790773198.617252:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773198.617289:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773198.617469:0:6463:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484450432 00000100:00100000:0.0:1790773198.617480:0:6463:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484450432 00000100:00100000:0.0:1790773198.617547:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 8 00000100:00100000:0.0:1790773198.617559:0:6463:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:110130ab-04fa-4d7c-984e-562032df4432+61:2398:x1877761484450432:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790773198.617576:0:6463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773198.617603:0:6463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc78421e7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd29 expref: 61 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.617652:0:6463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93d26ede0200) 00010000:00010000:0.0:1790773198.617657:0:6463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790773198.617720:0:6463:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:110130ab-04fa-4d7c-984e-562032df4432+60:2398:x1877761484450432:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 163us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773198.617728:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 8 00000100:00100000:3.0:1790773198.617978:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484450688 00000100:00100000:3.0:1790773198.617984:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484450688 00000100:00100000:3.0:1790773198.618023:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 121 00000100:00100000:3.0:1790773198.618031:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+60:11358:x1877761484450688:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:3.0:1790773198.618046:0:8697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773198.618061:0:8697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc78421ee lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bd30 expref: -99 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773198.618157:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc78421f5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773198.618171:0:8697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc78421bd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd1b expref: 61 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773198.618180:0:8697:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc78421f5 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773198.618270:0:8697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc78421bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd1b expref: 61 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773198.618283:0:8697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc78421bd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd1b expref: 61 pid: 8697 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773198.618296:0:8697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa94700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8697:1877761496054016:192.168.202.19@tcp:104: 00000100:00100000:3.0:1790773198.618399:0:8697:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d143779000 going to sleep for 11 seconds 00000100:00100000:1.0:1790773198.625078:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773198.625266:0:8410:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484450816 00000100:00100000:0.0:1790773198.625275:0:8410:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484450816 00010000:00010000:0.0:1790773198.625317:0:8410:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc78421bd lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd1b expref: 62 pid: 8697 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773198.625375:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 73 00000100:00100000:0.0:1790773198.625385:0:8410:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:110130ab-04fa-4d7c-984e-562032df4432+62:2398:x1877761484450816:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790773198.625399:0:8410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773198.625406:0:8410:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc78421bd lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd1b expref: 62 pid: 8697 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.625419:0:8410:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc78421bd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd1b expref: 62 pid: 8697 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.625439:0:8410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93d26ede0200) 00010000:00010000:0.0:1790773198.625444:0:8410:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc78421f5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.625455:0:8410:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc78421f5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.625463:0:8410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc78421f5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.625493:0:8410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790773198.625540:0:8410:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:110130ab-04fa-4d7c-984e-562032df4432+62:2398:x1877761484450816:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 157us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773198.625548:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 73 00010000:00010000:3.0:1790773198.625893:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc78421bd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd1b expref: 61 pid: 8697 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773198.625911:0:8697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa94700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8697:1877761496054016:192.168.202.19@tcp:104: 00010000:00010000:3.0:1790773198.625933:0:8697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc78421f5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773198.625942:0:8697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc78421f5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773198.625949:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc78421f5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790773198.625969:0:8697:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1790773198.626095:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc78421ee lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd30 expref: 62 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773198.626110:0:8697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc78421f5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd30 expref: 61 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773198.626128:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93d26ede0200) 00010000:00010000:3.0:1790773198.626131:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790773198.626134:0:8697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d1434ad000, rc 0) 00000100:00100000:3.0:1790773198.626170:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+61:11358:x1877761484450688:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 8140us (8986us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1790773198.626178:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 121 00000100:00100000:1.0:1790773198.636976:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773198.637065:0:6464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484451072 00000100:00100000:0.0:1790773198.637075:0:6464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484451072 00000100:00100000:0.0:1790773198.637136:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:0.0:1790773198.637144:0:6464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d252ea5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:110130ab-04fa-4d7c-984e-562032df4432+61:11358:x1877761484451072:12345-192.168.202.19@tcp:103:lfs.0 00010000:00010000:0.0:1790773198.637159:0:6464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773198.637184:0:6464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7842146 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcff expref: 61 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773198.637254:0:6464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93d26ede0200) 00010000:00010000:0.0:1790773198.637259:0:6464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790773198.637330:0:6464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d252ea5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:110130ab-04fa-4d7c-984e-562032df4432+60:11358:x1877761484451072:12345-192.168.202.19@tcp:103:lfs.0 Request processed in 186us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773198.637335:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:0.0:1790773198.639513:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773198.639829:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484451200 00000100:00100000:3.0:1790773198.639838:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484451200 00000100:00100000:3.0:1790773198.639970:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 122 00000100:00100000:3.0:1790773198.639980:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14449bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+60:11358:x1877761484451200:12345-192.168.202.19@tcp:58:lfs.0 00010000:00010000:3.0:1790773198.640098:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc7842203 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773198.640116:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc7842203 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773198.640127:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc7842203 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790773198.640832:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1790773198.640932:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14449bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+60:11358:x1877761484451200:12345-192.168.202.19@tcp:58:lfs.0 Request processed in 951us (1420us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773198.640954:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 122 00000100:00100000:0.0:1790773198.647991:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773198.648134:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484451328 00000100:00100000:3.0:1790773198.648145:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484451328 00000100:00100000:3.0:1790773198.648344:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 123 00000100:00100000:3.0:1790773198.648356:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144499500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+60:11358:x1877761484451328:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:3.0:1790773198.648392:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773198.648412:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac800/0xabf1cc0bc784220a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bd37 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773198.648466:0:6480:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc7842203 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773198.648489:0:6480:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac800/0xabf1cc0bc784220a lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd37 expref: 61 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773198.648509:0:6480:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc7842203 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773198.648522:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac800/0xabf1cc0bc784220a lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd37 expref: 61 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773198.648545:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93d26ede0200) 00010000:00010000:3.0:1790773198.648549:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790773198.648553:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac800/0xabf1cc0bc784220a lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd37 expref: 61 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773198.648560:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d1434ac800, rc 0) 00000100:00100000:3.0:1790773198.648624:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144499500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+61:11358:x1877761484451328:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 271us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773198.648631:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 123 00010000:00010000:1.0:1790773198.669431:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790773199.181668:0:13749:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790773199.181678:0:13749:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790773199.181735:0:13749:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1790773199.181745:0:13749:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790773199.181886:0:13749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144498380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13749:1877761496054144:192.168.202.19@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790773199.181973:0:13749:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d14265b840 going to sleep for 11 seconds 00000100:00100000:0.0:1790773199.195858:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773199.195989:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484451456 00000100:00100000:2.0:1790773199.195998:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484451456 00000100:00100000:3.0:1790773199.196271:0:13749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144498380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13749:1877761496054144:192.168.202.19@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790773199.197729:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 124 00000100:00100000:2.0:1790773199.197761:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14449b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+61:11360:x1877761484451456:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790773199.197799:0:8697:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790773199.197928:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14449b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+61:11360:x1877761484451456:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 Request processed in 188us (2080us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773199.197936:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 124 00000100:00100000:1.0:1790773199.208312:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773199.216904:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484451584 00000100:00100000:0.0:1790773199.216920:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484451584 00000100:00100000:0.0:1790773199.217007:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 125 00000100:00100000:0.0:1790773199.217042:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+61:11360:x1877761484451584:12345-192.168.202.19@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1790773199.217113:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7842211 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.217131:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7842211 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.217156:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7842211 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.217173:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7842218 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.217181:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7842218 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.217188:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7842218 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.217243:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc784221f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.217253:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc784221f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.217259:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc784221f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790773199.217302:0:6479:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1790773199.217318:0:6479:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790773199.217331:0:6479:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc784221f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.217343:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7842211 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.217350:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7842211 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.217357:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7842211 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.217363:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074a400 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773199.217367:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7842211 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.217375:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7842211 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.217388:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93d26ede0500) 00010000:00010000:0.0:1790773199.217391:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773199.217396:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7842211 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.217402:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7842211 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.217414:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7842218 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.217421:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7842218 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.217438:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7842218 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.217444:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074b000 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773199.217447:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7842218 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.217454:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7842218 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.217462:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff93d26ede0800) 00010000:00010000:0.0:1790773199.217465:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773199.217468:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7842218 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.217474:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7842218 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.217490:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc784221f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.217496:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc784221f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.217501:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc784221f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.217506:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074b200 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773199.217509:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc784221f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.217523:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc784221f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.217531:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93d26ede0200) 00010000:00010000:0.0:1790773199.217533:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773199.217536:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc784221f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.217542:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc784221f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773199.217834:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+61:11360:x1877761484451584:12345-192.168.202.19@tcp:34:lhsmtool_posix.0 Request processed in 816us (9531us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773199.217844:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 125 00000100:00100000:3.0:1790773199.221934:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773199.222137:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484451840 00000100:00100000:0.0:1790773199.222158:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484451840 00000100:00100000:0.0:1790773199.222272:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 126 00000100:00100000:0.0:1790773199.222282:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+61:11360:x1877761484451840:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790773199.222304:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773199.222323:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc7842226 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bd3e expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.222425:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784222d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.222441:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784222d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.222452:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784222d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790773199.222478:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1790773199.222583:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784222d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.222590:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784222d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.222597:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784222d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.222602:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074b400 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773199.222607:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784222d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.222614:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784222d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.222625:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93d26ede0200) 00010000:00010000:0.0:1790773199.222628:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790773199.222642:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784222d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.222648:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784222d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.222697:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc7842226 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd3e expref: 63 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.222706:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93d26ede0500) 00010000:00010000:0.0:1790773199.222708:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790773199.222718:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc7842226 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd3e expref: 63 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.222729:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074aa00, rc 0) 00000100:00100000:0.0:1790773199.222787:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+62:11360:x1877761484451840:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 507us (871us total) trans 4294967399 rc 301/301 00000100:00100000:0.0:1790773199.222793:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 126 00000100:00100000:0.0:1790773199.227170:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773199.227257:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484451968 00000100:00100000:2.0:1790773199.227267:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484451968 00000100:00100000:2.0:1790773199.227313:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 127 00000100:00100000:2.0:1790773199.227319:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144498000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+62:11360:x1877761484451968:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790773199.227374:0:8697:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790773199.227483:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144498000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+62:11360:x1877761484451968:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 Request processed in 163us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773199.227491:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 127 00000100:00100000:2.0:1790773199.243402:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773199.245127:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484452224 00000100:00100000:3.0:1790773199.245142:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484452224 00000100:00100000:3.0:1790773199.245251:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 128 00000100:00100000:3.0:1790773199.245261:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+62:11360:x1877761484452224:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790773199.245282:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773199.245286:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1790773199.245311:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc78421cb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd22 expref: 62 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.245345:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93d14363d100) 00010000:00010000:3.0:1790773199.245350:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790773199.245363:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc784223b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bd45 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790773199.245751:0:6480:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:3.0:1790773199.245880:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc7842242 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.245894:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc7842242 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.245903:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc7842242 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.245951:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc784223b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd45 expref: 64 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.245965:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc7842242 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd45 expref: 63 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.245992:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93d250704000) 00010000:00010000:3.0:1790773199.245996:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790773199.245998:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d1434ad400, rc 0) 00000100:00100000:3.0:1790773199.246063:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+63:11360:x1877761484452224:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 804us (2671us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1790773199.246069:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 128 00000100:00100000:3.0:1790773199.257688:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773199.259974:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484452480 00000100:00100000:0.0:1790773199.259988:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484452480 00000100:00100000:0.0:1790773199.260063:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 129 00000100:00100000:0.0:1790773199.260073:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+63:11360:x1877761484452480:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790773199.260131:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773199.260164:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc7842242 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd45 expref: 63 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.260197:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93d250704000) 00010000:00010000:0.0:1790773199.260251:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790773199.260272:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc7842250 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.260285:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc7842250 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.260294:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc7842250 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.260358:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842257 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xb0decd79 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.260385:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842257 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xb0decd79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.260393:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842257 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xb0decd79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.260433:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc7842250 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.260441:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc7842250 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.260448:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc7842250 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.260454:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074b400 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773199.260458:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc7842250 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.260466:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc7842250 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.260475:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93d14363d100) 00010000:00010000:0.0:1790773199.260477:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773199.260481:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc7842250 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.260487:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc7842250 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.260496:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842257 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xb0decd79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.260509:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842257 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xb0decd79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.260514:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842257 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xb0decd79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.260530:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074b200 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773199.260533:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842257 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xb0decd79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.260540:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842257 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xb0decd79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.260547:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xb0decd79 (ffff93d26ede0800) 00010000:00010000:0.0:1790773199.260550:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773199.260552:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842257 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xb0decd79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.260557:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842257 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xb0decd79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773199.260659:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+62:11360:x1877761484452480:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 586us (2980us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790773199.260666:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 129 00000100:00100000:0.0:1790773199.272787:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773199.272916:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484452608 00000100:00100000:1.0:1790773199.272939:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484452608 00000100:00100000:1.0:1790773199.273004:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 130 00000100:00100000:1.0:1790773199.273014:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144498380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+62:11360:x1877761484452608:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790773199.273035:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773199.273059:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc784225e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bd4c expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773199.273095:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7842265 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773199.273108:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7842265 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773199.273119:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7842265 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773199.273430:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc784225e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd4c expref: 64 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773199.273449:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7842265 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd4c expref: 63 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773199.273457:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93d14363df00) 00010000:00010000:1.0:1790773199.273460:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790773199.273464:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12bc00, rc 0) 00000100:00100000:1.0:1790773199.273537:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144498380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+63:11360:x1877761484452608:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 523us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773199.273544:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 130 00000100:00100000:1.0:1790773199.276880:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773199.276978:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484452864 00000100:00100000:3.0:1790773199.276989:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484452864 00000100:00100000:3.0:1790773199.277055:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 131 00000100:00100000:3.0:1790773199.277065:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+63:11360:x1877761484452864:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790773199.277147:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc784226c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.277165:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc784226c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.277177:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc784226c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790773199.277371:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:3.0:1790773199.277382:0:6480:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 342079176643ns, next at 343079173970ns, rc = 0 00000004:00010000:3.0:1790773199.277427:0:6480:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000050971e15 reply state 0000000018332c9a transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc784226c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.277440:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc784226c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.277460:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93d14363df00) 00010000:00010000:3.0:1790773199.277463:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1790773199.277467:0:6480:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790773199.277749:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+65:11360:x1877761484452864:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 494us (688us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1790773199.277757:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 131 00000100:00100000:3.0:1790773199.292394:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773199.292542:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484452992 00000100:00100000:2.0:1790773199.292574:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484452992 00000100:00100000:2.0:1790773199.292626:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 132 00000100:00100000:2.0:1790773199.292647:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+65:11360:x1877761484452992:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790773199.292678:0:8697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773199.292698:0:8697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7842273 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bd53 expref: -99 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773199.292761:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7842273 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd53 expref: 66 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773199.292776:0:8697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7842273 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd53 expref: 66 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773199.292795:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93d14363df00) 00010000:00010000:2.0:1790773199.292797:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790773199.292802:0:8697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26efc5200, rc 0) 00000100:00100000:2.0:1790773199.292864:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+66:11360:x1877761484452992:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 229us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773199.292872:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 132 00000100:00100000:3.0:1790773199.295090:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773199.295899:0:8906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484453120 00000100:00100000:2.0:1790773199.295910:0:8906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484453120 00000100:00100000:2.0:1790773199.295982:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 45 00000100:00100000:2.0:1790773199.295993:0:8906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143048000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:110130ab-04fa-4d7c-984e-562032df4432+8:2397:x1877761484453120:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1790773199.296199:0:8906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143048000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:110130ab-04fa-4d7c-984e-562032df4432+9:2397:x1877761484453120:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 Request processed in 208us (1115us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1790773199.296240:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 45 00000100:00080000:3.0:1790773199.296351:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790773199.303305:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773199.304240:0:6482:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484453376 00000100:00100000:2.0:1790773199.304266:0:6482:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484453376 00000100:00100000:2.0:1790773199.304332:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 30 00000100:00100000:2.0:1790773199.304343:0:6482:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143049180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+66:11360:x1877761484453376:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790773199.304582:0:6482:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143049180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+67:11360:x1877761484453376:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 Request processed in 240us (1285us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1790773199.304590:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 30 00000100:00100000:1.0:1790773199.306818:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773199.306902:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484453632 00000100:00100000:0.0:1790773199.306911:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484453632 00000100:00100000:0.0:1790773199.306967:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 133 00000100:00100000:0.0:1790773199.306977:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+67:11360:x1877761484453632:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790773199.307093:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+67:11360:x1877761484453632:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 117us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773199.307101:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 133 00000100:00100000:3.0:1790773199.310170:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773199.310357:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484453760 00000100:00100000:2.0:1790773199.310367:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484453760 00000100:00100000:2.0:1790773199.310428:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 134 00000100:00100000:2.0:1790773199.310437:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143049c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+67:11360:x1877761484453760:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790773199.310457:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773199.310476:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc784227a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bd5a expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773199.310862:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc7842281 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773199.310879:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc7842281 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773199.310892:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc7842281 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790773199.310939:0:6480:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790773199.310960:0:6480:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc7842281 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773199.310993:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc784227a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd5a expref: 69 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773199.311026:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc7842281 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd5a expref: 68 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773199.311034:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93d14363df00) 00010000:00010000:2.0:1790773199.311038:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790773199.311042:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26efc5c00, rc 0) 00000100:00100000:2.0:1790773199.311158:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143049c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+68:11360:x1877761484453760:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 721us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773199.311167:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 134 00000100:00100000:2.0:1790773199.328100:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773199.328199:0:8394:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484453888 00000100:00100000:1.0:1790773199.328256:0:8394:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484453888 00000100:00100000:1.0:1790773199.328312:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 46 00000100:00100000:1.0:1790773199.328331:0:8394:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:110130ab-04fa-4d7c-984e-562032df4432+9:2397:x1877761484453888:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790773199.328352:0:8394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773199.328370:0:8394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094ae9e98/0xabf1cc0bc7842288 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bd61 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790773199.328397:0:8394:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abd07cf, blocks: 0x0 00010000:00010000:1.0:1790773199.328416:0:8394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=342s v=(0 0) 00010000:00010000:1.0:1790773199.328420:0:8394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790773199.328429:0:8394:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094ae9e98/0xabf1cc0bc7842288 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd61 expref: 10 pid: 8394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773199.328447:0:8394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000094ae9e98/0xabf1cc0bc7842288 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd61 expref: 10 pid: 8394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773199.328460:0:8394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12b400, rc 0) 00000100:00100000:1.0:1790773199.328510:0:8394:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:110130ab-04fa-4d7c-984e-562032df4432+10:2397:x1877761484453888:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 190us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773199.328517:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 46 00000100:00100000:0.0:1790773199.340319:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773199.340617:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484454144 00000100:00100000:1.0:1790773199.340627:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484454144 00000100:00100000:1.0:1790773199.340701:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 135 00000100:00100000:1.0:1790773199.340712:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14449ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+68:11360:x1877761484454144:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1790773199.340848:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14449ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+68:11360:x1877761484454144:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 138us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773199.340856:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 135 00000100:00100000:0.0:1790773199.344522:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773199.347974:0:8392:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484454272 00000100:00100000:3.0:1790773199.347988:0:8392:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484454272 00000100:00100000:3.0:1790773199.348043:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 47 00000100:00100000:3.0:1790773199.348052:0:8392:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d243ee1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:110130ab-04fa-4d7c-984e-562032df4432+10:11360:x1877761484454272:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790773199.348069:0:8392:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773199.348087:0:8392:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ddb50f82/0xabf1cc0bc784228f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bd68 expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.348118:0:8392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000094ae9e98/0xabf1cc0bc7842288 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd61 expref: 11 pid: 8394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.348127:0:8392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773199.348131:0:8392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773199.348137:0:8392:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ddb50f82/0xabf1cc0bc784228f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd68 expref: 11 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.348199:0:8392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000094ae9e98/0xabf1cc0bc7842288 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd61 expref: 11 pid: 8394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.348436:0:8392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000094ae9e98/0xabf1cc0bc7842288 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd61 expref: 11 pid: 8394 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773199.348453:0:8392:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143049880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8392:1877761496054272:192.168.202.19@tcp:104: 00000100:00100000:0.0:1790773199.353684:0:8392:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d143779d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790773199.359350:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773199.359555:0:10300:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484454400 00000100:00100000:1.0:1790773199.359565:0:10300:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484454400 00010000:00010000:1.0:1790773199.359623:0:10300:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000094ae9e98/0xabf1cc0bc7842288 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd61 expref: 12 pid: 8394 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773199.359702:0:10300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 74 00000100:00100000:1.0:1790773199.359738:0:10300:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa88700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:110130ab-04fa-4d7c-984e-562032df4432+12:2398:x1877761484454400:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790773199.359757:0:10300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790773199.359778:0:10300:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000094ae9e98/0xabf1cc0bc7842288 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd61 expref: 12 pid: 8394 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773199.359793:0:10300:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000094ae9e98/0xabf1cc0bc7842288 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd61 expref: 12 pid: 8394 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773199.359818:0:10300:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790773199.359822:0:10300:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790773199.359830:0:10300:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ddb50f82/0xabf1cc0bc784228f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd68 expref: 12 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773199.359841:0:10300:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ddb50f82/0xabf1cc0bc784228f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd68 expref: 12 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773199.359897:0:10300:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ddb50f82/0xabf1cc0bc784228f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd68 expref: 12 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773199.359913:0:10300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa92d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10300:1877761496054400:192.168.202.19@tcp:105: 00000100:00100000:1.0:1790773199.359995:0:10300:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26bebfd80 going to sleep for 11 seconds 00010000:00010000:0.0:1790773199.360201:0:8392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094ae9e98/0xabf1cc0bc7842288 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd61 expref: 12 pid: 8394 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773199.360267:0:8392:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143049880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8392:1877761496054272:192.168.202.19@tcp:104: 00010000:00010000:0.0:1790773199.360292:0:8392:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ddb50f82/0xabf1cc0bc784228f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd68 expref: 11 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.360303:0:8392:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d1434ad400, rc 0) 00000100:00100000:0.0:1790773199.360336:0:8392:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d243ee1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:110130ab-04fa-4d7c-984e-562032df4432+11:11360:x1877761484454272:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 12285us (15824us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773199.360343:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 47 00000100:00100000:1.0:1790773199.371529:0:10300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa92d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10300:1877761496054400:192.168.202.19@tcp:105: 00010000:00010000:1.0:1790773199.371647:0:10300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790773199.371759:0:10300:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa88700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:110130ab-04fa-4d7c-984e-562032df4432+10:2398:x1877761484454400:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 12023us (12418us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773199.371771:0:10300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 74 00000100:00100000:1.0:1790773199.375779:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773199.375936:0:8398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484454528 00000100:00100000:0.0:1790773199.375947:0:8398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484454528 00002000:00100000:0.0:1790773199.376006:0:8398:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff93d27fa92d80 x1877761484454528/t0(0) o4->110130ab-04fa-4d7c-984e-562032df4432@192.168.202.19@tcp:35/0 lens 504/0 e 0 to 0 dl 1790773210 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790773199.376017:0:8398:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93d27fa92d80 with x1877761484454528 ext(0->12) 00002000:00010000:0.0:1790773199.376023:0:8398:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93d27fa92d80 00000100:00100000:0.0:1790773199.376054:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 2 00000100:00100000:0.0:1790773199.376064:0:8398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:110130ab-04fa-4d7c-984e-562032df4432+10:2397:x1877761484454528:12345-192.168.202.19@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1790773199.381950:0:8398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:110130ab-04fa-4d7c-984e-562032df4432+12:2397:x1877761484454528:12345-192.168.202.19@tcp:4:lhsmtool_posix.0 Request processed in 5875us (6169us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1790773199.381965:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 2 00002000:00100000:0.0:1790773199.381978:0:8398:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff93d27fa92d80 x1877761484454528/t4294967309(0) o4->110130ab-04fa-4d7c-984e-562032df4432@192.168.202.19@tcp:35/0 lens 504/448 e 0 to 0 dl 1790773210 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790773199.381989:0:8398:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93d27fa92d80 with x1877761484454528 ext(0->12) 00002000:00010000:0.0:1790773199.381996:0:8398:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93d27fa92d80 00000100:00100000:0.0:1790773199.406018:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773199.406537:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484454656 00000100:00100000:1.0:1790773199.406549:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484454656 00000100:00100000:1.0:1790773199.406656:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 136 00000100:00100000:1.0:1790773199.406667:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d243ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+68:11360:x1877761484454656:12345-192.168.202.19@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1790773199.408539:0:6457:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:2.0:1790773199.408561:0:6457:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:2.0:1790773199.408594:0:6457:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1790773199.408617:0:6457:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93d27c144300 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1790773199.408621:0:6457:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93d14270ba00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93d27c144a80 00000020:00080000:2.0:1790773199.408625:0:6457:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93d14270b000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93d244b2a000 00000004:00080000:2.0:1790773199.408658:0:6457:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000100:00100000:3.0:1790773199.408850:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14304aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496054528:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1790773199.408925:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773199.408992:0:8907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496054528 00000100:00100000:3.0:1790773199.408999:0:8907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496054528 00000100:00100000:3.0:1790773199.409043:0:8907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790773199.409052:0:8907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143049f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3605:x1877761496054528:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1790773199.409077:0:8907:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00002000:00010000:3.0:1790773199.409109:0:8907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6abd07ce, atime: 0x6abd07ce, ctime: 0x6abd07ce, blocks: 0x8 00010000:00010000:3.0:1790773199.409118:0:8907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d73d19b3/0xabf1cc0bc7842296 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.409135:0:8907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=342s v=(0 0) 00010000:00010000:3.0:1790773199.409140:0:8907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773199.409147:0:8907:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d73d19b3/0xabf1cc0bc7842296 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.409178:0:8907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d73d19b3/0xabf1cc0bc7842296 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.409199:0:8907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d73d19b3/0xabf1cc0bc7842296 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.409246:0:8907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d73d19b3/0xabf1cc0bc7842296 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.409264:0:8907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1790773199.409416:0:8907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143049f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3605:x1877761496054528:12345-0@lo:6:osp-syn-0-0.0 Request processed in 365us (490us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1790773199.409424:0:8907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790773199.409466:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496054656:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1790773199.409493:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773199.409523:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790773199.409529:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496054784:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1790773199.409552:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790773199.409577:0:6466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790773199.409583:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d73d19b3/0xabf1cc0bc7842296 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.409592:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ad200 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:3.0:1790773199.409596:0:6466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d73d19b3/0xabf1cc0bc7842296 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.409606:0:6466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d73d19b3/0xabf1cc0bc7842296 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.409648:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d73d19b3/0xabf1cc0bc7842296 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.409657:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d73d19b3/0xabf1cc0bc7842296 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773199.409673:0:8393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496054656 00000100:00100000:1.0:1790773199.409679:0:8393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496054656 00010000:00010000:3.0:1790773199.409883:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773199.409885:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773199.409887:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773199.409915:0:8393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496054784 00000100:00100000:1.0:1790773199.409919:0:8393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496054784 00000004:00080000:3.0:1790773199.409927:0:3605:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93d14304aa00/2, rc 0, transno 4294967305 00000100:00100000:3.0:1790773199.409934:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14304aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496054528:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1790773199.409936:0:8393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790773199.409942:0:8393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143048700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3606:x1877761496054656:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1790773199.409951:0:8907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790773199.409957:0:8907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14304a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3606:x1877761496054784:12345-0@lo:2:osp-syn-1-0.0 00002000:00080000:1.0:1790773199.409958:0:8393:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:1.0:1790773199.409974:0:8393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060df18b3/0xabf1cc0bc784229d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773199.409999:0:8393:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005f8391af/0xabf1cc0bc784204a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcc0 expref: 11 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773199.410006:0:8393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1790773199.410010:0:8393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790773199.410013:0:8393:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060df18b3/0xabf1cc0bc784229d lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790773199.410023:0:8907:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1790773199.410025:0:8907:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1790773199 00002000:00010000:3.0:1790773199.410028:0:8907:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1790773199.410029:0:8907:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1790773199 -> 1790773199 00002000:00010000:3.0:1790773199.410032:0:8907:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1790773199.410038:0:8393:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005f8391af/0xabf1cc0bc784204a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcc0 expref: 11 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773199.410052:0:8393:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005f8391af/0xabf1cc0bc784204a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcc0 expref: 11 pid: 8906 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773199.410061:0:8907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14304a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3606:x1877761496054784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 105us (509us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1790773199.410064:0:8393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8393:1877761496054912:192.168.202.19@tcp:104: 00000100:00100000:3.0:1790773199.410067:0:8907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:3.0:1790773199.410093:0:3606:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93d27fa91f80/2, rc 0, transno 4294967310 00000100:00100000:3.0:1790773199.410097:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496054784:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1790773199.410121:0:8393:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26bebfd80 going to sleep for 11 seconds 00000020:00080000:2.0:1790773199.410730:0:6457:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93d26efcc0c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1790773199.410736:0:6457:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93d279f52700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93d26efcc9c0 00000020:00080000:2.0:1790773199.410739:0:6457:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93d279f52f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93d1437b7000 00000020:00080000:2.0:1790773199.410755:0:6457:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00010000:00010000:0.0:1790773199.410825:0:3590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7841f94 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.410835:0:3590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7841f94 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.410841:0:3590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7841f94 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.410846:0:3590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12b600 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773199.410850:0:3590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7841f94 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.410856:0:3590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7841f94 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.410867:0:3590:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff93d250704400) 00010000:00010000:0.0:1790773199.410870:0:3590:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773199.410874:0:3590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7841f94 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.410892:0:3590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7841f94 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.410913:0:3590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc784203c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.410919:0:3590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc784203c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.410924:0:3590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc784203c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.410929:0:3590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074a800 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773199.410932:0:3590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc784203c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.410937:0:3590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc784203c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.410944:0:3590:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff93d26ede0300) 00010000:00010000:0.0:1790773199.410946:0:3590:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773199.410949:0:3590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc784203c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.410954:0:3590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc784203c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.410968:0:3590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc78420ba lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773199.412346:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d243ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+20:11360:x1877761484454656:12345-192.168.202.19@tcp:44:lhsmtool_posix.0 Request processed in 5675us (6330us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773199.412357:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 136 00010000:00010000:0.0:1790773199.412474:0:3590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc78420ba lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.412499:0:3590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc78420ba lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.412505:0:3590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12a200 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773199.412509:0:3590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc78420ba lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.412517:0:3590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc78420ba lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.412530:0:3590:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93d14363d300) 00010000:00010000:0.0:1790773199.412532:0:3590:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773199.412537:0:3590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc78420ba lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.412543:0:3590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc78420ba lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.412643:0:3590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc78420dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.412651:0:3590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc78420dd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.412658:0:3590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc78420dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.412664:0:3590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12ae00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773199.412667:0:3590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc78420dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.412683:0:3590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc78420dd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.412691:0:3590:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93d14363d300) 00010000:00010000:0.0:1790773199.412693:0:3590:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773199.412697:0:3590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc78420dd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.412702:0:3590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc78420dd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.412729:0:3590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a600/0xabf1cc0bc78421af lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.412736:0:3590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a600/0xabf1cc0bc78421af lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.412743:0:3590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a600/0xabf1cc0bc78421af lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.412747:0:3590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074a600 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773199.412750:0:3590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a600/0xabf1cc0bc78421af lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.412756:0:3590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a600/0xabf1cc0bc78421af lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.412764:0:3590:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93d26ede0200) 00010000:00010000:0.0:1790773199.412766:0:3590:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773199.412770:0:3590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a600/0xabf1cc0bc78421af lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.412784:0:3590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a600/0xabf1cc0bc78421af lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.412797:0:3590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc784226c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.412803:0:3590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc784226c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.412808:0:3590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc784226c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.412813:0:3590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ace00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773199.412816:0:3590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc784226c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.412822:0:3590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc784226c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.412830:0:3590:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93d14363df00) 00010000:00010000:0.0:1790773199.412832:0:3590:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790773199.412835:0:3590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc784226c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.412841:0:3590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc784226c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1790773199.412861:0:6510:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1790773199.412930:0:6510:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1790773199.423463:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773199.423546:0:6465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484454784 00000100:00100000:2.0:1790773199.423562:0:6465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484454784 00000100:00100000:1.0:1790773199.423579:0:8393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8393:1877761496054912:192.168.202.19@tcp:104: 00010000:00010000:1.0:1790773199.423605:0:8393:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000060df18b3/0xabf1cc0bc784229d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773199.423619:0:6465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005f8391af/0xabf1cc0bc784204a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcc0 expref: 12 pid: 8906 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773199.423713:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 75 00000100:00100000:2.0:1790773199.423731:0:6465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2412ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:110130ab-04fa-4d7c-984e-562032df4432+12:2397:x1877761484454784:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790773199.423757:0:6465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790773199.423763:0:6465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005f8391af/0xabf1cc0bc784204a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcc0 expref: 12 pid: 8906 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773199.423776:0:6465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005f8391af/0xabf1cc0bc784204a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcc0 expref: 12 pid: 8906 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773199.423806:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f8391af/0xabf1cc0bc784204a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bcc0 expref: 12 pid: 8906 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773199.423832:0:6465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790773199.423836:0:6465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790773199.423842:0:6465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000060df18b3/0xabf1cc0bc784229d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773199.423859:0:6465:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060df18b3/0xabf1cc0bc784229d lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773199.423897:0:6465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790773199.423980:0:6465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2412ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:110130ab-04fa-4d7c-984e-562032df4432+11:2397:x1877761484454784:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 251us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773199.424005:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 75 00010000:00010000:1.0:1790773199.424141:0:8393:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000060df18b3/0xabf1cc0bc784229d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773199.424166:0:8393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060df18b3/0xabf1cc0bc784229d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773199.424175:0:8393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060df18b3/0xabf1cc0bc784229d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773199.424183:0:8393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060df18b3/0xabf1cc0bc784229d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773199.424390:0:8393:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790773199.424548:0:8393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143048700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3606:x1877761496054656:12345-0@lo:6:osp-syn-1-0.0 Request processed in 14605us (15053us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1790773199.424566:0:8393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000004:00080000:3.0:1790773199.424581:0:3606:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93d27fa93b80/2, rc 0, transno 4294967311 00000100:00100000:3.0:1790773199.424601:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496054656:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1790773199.426105:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773199.426258:0:8394:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484454912 00000100:00100000:2.0:1790773199.426266:0:8394:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484454912 00000100:00100000:2.0:1790773199.426316:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 51 00000100:00100000:2.0:1790773199.426326:0:8394:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:110130ab-04fa-4d7c-984e-562032df4432+11:2397:x1877761484454912:12345-192.168.202.19@tcp:16:lhsmtool_posix.0 00010000:00010000:0.0:1790773199.428847:0:8409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790773199.428874:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060df18b3/0xabf1cc0bc784229d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.428888:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12a800 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:0.0:1790773199.428893:0:8409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060df18b3/0xabf1cc0bc784229d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.428903:0:8409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060df18b3/0xabf1cc0bc784229d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.428924:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060df18b3/0xabf1cc0bc784229d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.428931:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060df18b3/0xabf1cc0bc784229d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.428952:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773199.428953:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773199.428955:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1790773199.429946:0:9475:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:3.0:1790773199.429968:0:9475:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:2.0:1790773199.430144:0:8394:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:110130ab-04fa-4d7c-984e-562032df4432+6:2397:x1877761484454912:12345-192.168.202.19@tcp:16:lhsmtool_posix.0 Request processed in 3814us (4038us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773199.430155:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 51 00000100:00100000:3.0:1790773199.436182:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773199.437403:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484455168 00000100:00100000:2.0:1790773199.437423:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484455168 00000100:00100000:2.0:1790773199.437884:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 137 00000100:00100000:2.0:1790773199.437903:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143048a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+16:11360:x1877761484455168:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790773199.437974:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790773199.438014:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc7842281 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd5a expref: 16 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773199.438034:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93d14363df00) 00010000:00010000:2.0:1790773199.438039:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790773199.438069:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc78422a4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773199.438083:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc78422a4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773199.438093:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc78422a4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790773199.438253:0:6480:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000096bf0b00 reply state 000000001c45a910 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc78422a4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773199.438265:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc78422a4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773199.438272:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93d14363df00) 00010000:00010000:2.0:1790773199.438275:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790773199.438277:0:6480:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790773199.438392:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143048a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+17:11360:x1877761484455168:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 498us (2218us total) trans 4294967403 rc 0/0 00000100:00100000:2.0:1790773199.438399:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 137 00000100:00100000:0.0:1790773199.442851:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773199.443109:0:8906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484455296 00000100:00100000:3.0:1790773199.443120:0:8906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484455296 00000100:00100000:3.0:1790773199.443180:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 52 00000100:00100000:3.0:1790773199.443190:0:8906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2412ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:110130ab-04fa-4d7c-984e-562032df4432+6:2397:x1877761484455296:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1790773199.443373:0:8906:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1790773199.443377:0:8906:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1790773199 -> 1790773198 00002000:00010000:3.0:1790773199.443380:0:8906:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1790773198 00002000:00010000:3.0:1790773199.443382:0:8906:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1790773199 -> 1790773198 00002000:00010000:3.0:1790773199.443384:0:8906:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1790773199.443453:0:8906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2412ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:110130ab-04fa-4d7c-984e-562032df4432+7:2397:x1877761484455296:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 Request processed in 255us (602us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1790773199.443461:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 52 00000100:00100000:3.0:1790773199.445659:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773199.445802:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484455552 00000100:00100000:0.0:1790773199.445813:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484455552 00000100:00100000:0.0:1790773199.445873:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 138 00000100:00100000:0.0:1790773199.445883:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143048e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+17:11360:x1877761484455552:12345-192.168.202.19@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1790773199.445947:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc78422ab lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.445966:0:13768:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7842265 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd4c expref: 17 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.445990:0:13768:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc78422ab lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.446039:0:13768:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7842265 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd4c expref: 17 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.446054:0:13768:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7842265 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd4c expref: 17 pid: 6478 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773199.446069:0:13768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13768:1877761496055040:192.168.202.19@tcp:104: 00000100:00100000:0.0:1790773199.446149:0:13768:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d14265b840 going to sleep for 11 seconds 00000100:00100000:2.0:1790773199.454738:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773199.455030:0:13768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13768:1877761496055040:192.168.202.19@tcp:104: 00010000:00010000:0.0:1790773199.455058:0:13768:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc78422ab lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773199.455193:0:6463:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484455680 00000100:00100000:1.0:1790773199.455201:0:6463:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484455680 00010000:00010000:1.0:1790773199.455274:0:6463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7842265 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd4c expref: 18 pid: 6478 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773199.455311:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 76 00000100:00100000:1.0:1790773199.455321:0:6463:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa8a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:110130ab-04fa-4d7c-984e-562032df4432+18:2398:x1877761484455680:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790773199.455346:0:6463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790773199.455353:0:6463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7842265 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd4c expref: 18 pid: 6478 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773199.455383:0:6463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7842265 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd4c expref: 18 pid: 6478 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773199.455404:0:6463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7842265 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd4c expref: 18 pid: 6478 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773199.455420:0:6463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93d14363df00) 00010000:00010000:1.0:1790773199.455425:0:6463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc78422ab lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773199.455433:0:6463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc78422ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773199.455441:0:6463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc78422ab lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773199.455460:0:6463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790773199.455573:0:13768:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc78422ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.455580:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc78422ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.455618:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc78422ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.455626:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc78422ab lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.455643:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc78422ab lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.455657:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074a800 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773199.455662:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc78422ab lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.455670:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc78422ab lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.455680:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93d14363df00) 00010000:00010000:0.0:1790773199.455683:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1790773199.455687:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc78422ab lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.455705:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc78422ab lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773199.455765:0:6463:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa8a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:110130ab-04fa-4d7c-984e-562032df4432+17:2398:x1877761484455680:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 444us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773199.455773:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 76 00000100:00100000:0.0:1790773199.463266:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143048e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+16:11360:x1877761484455552:12345-192.168.202.19@tcp:55:lhsmtool_posix.0 Request processed in 17370us (17601us total) trans 0 rc -22/-22 00000100:00100000:0.0:1790773199.463283:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 138 00000100:00100000:1.0:1790773199.474272:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773199.474535:0:8393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484455808 00000100:00100000:3.0:1790773199.474547:0:8393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484455808 00000100:00100000:3.0:1790773199.474607:0:8393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 53 00000100:00100000:3.0:1790773199.474618:0:8393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:110130ab-04fa-4d7c-984e-562032df4432+7:2399:x1877761484455808:12345-192.168.202.19@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1790773199.474684:0:8393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d73d19b3/0xabf1cc0bc78422b2 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.474865:0:8393:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ddb50f82/0xabf1cc0bc784228f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd68 expref: 7 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.474895:0:8393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773199.474899:0:8393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790773199.474916:0:8393:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d73d19b3/0xabf1cc0bc78422b2 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.474965:0:8393:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ddb50f82/0xabf1cc0bc784228f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd68 expref: 7 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.474988:0:8393:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ddb50f82/0xabf1cc0bc784228f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd68 expref: 7 pid: 8392 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773199.475003:0:8393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14304b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8393:1877761496055168:192.168.202.19@tcp:104: 00000100:00100000:3.0:1790773199.475117:0:8393:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d143779c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790773199.478682:0:8393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14304b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8393:1877761496055168:192.168.202.19@tcp:104: 00010000:00010000:3.0:1790773199.479601:0:8393:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d73d19b3/0xabf1cc0bc78422b2 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773199.480048:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773199.481285:0:10300:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484455936 00000100:00100000:3.0:1790773199.481297:0:10300:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484455936 00010000:00010000:3.0:1790773199.481373:0:10300:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ddb50f82/0xabf1cc0bc784228f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd68 expref: 8 pid: 8392 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773199.481441:0:10300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 77 00000100:00100000:3.0:1790773199.481452:0:10300:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144441f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:110130ab-04fa-4d7c-984e-562032df4432+8:2397:x1877761484455936:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790773199.481485:0:10300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773199.481514:0:10300:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ddb50f82/0xabf1cc0bc784228f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd68 expref: 8 pid: 8392 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.481530:0:10300:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ddb50f82/0xabf1cc0bc784228f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd68 expref: 8 pid: 8392 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.481554:0:10300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ddb50f82/0xabf1cc0bc784228f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd68 expref: 8 pid: 8392 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.481572:0:10300:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790773199.481576:0:10300:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790773199.481589:0:10300:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d73d19b3/0xabf1cc0bc78422b2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.481600:0:10300:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d73d19b3/0xabf1cc0bc78422b2 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.481650:0:10300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790773199.481737:0:10300:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144441f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:110130ab-04fa-4d7c-984e-562032df4432+7:2397:x1877761484455936:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 286us (1692us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773199.481751:0:10300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 77 00010000:00010000:3.0:1790773199.481786:0:8393:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d73d19b3/0xabf1cc0bc78422b2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.481802:0:8393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d73d19b3/0xabf1cc0bc78422b2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.481855:0:8393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d73d19b3/0xabf1cc0bc78422b2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.481866:0:8393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d73d19b3/0xabf1cc0bc78422b2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.481875:0:8393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d73d19b3/0xabf1cc0bc78422b2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.481882:0:8393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ad200 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:3.0:1790773199.481886:0:8393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d73d19b3/0xabf1cc0bc78422b2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.481894:0:8393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d73d19b3/0xabf1cc0bc78422b2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.481906:0:8393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d73d19b3/0xabf1cc0bc78422b2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.481918:0:8393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d73d19b3/0xabf1cc0bc78422b2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773199.481979:0:8393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:110130ab-04fa-4d7c-984e-562032df4432+6:2399:x1877761484455808:12345-192.168.202.19@tcp:1:lhsmtool_posix.0 Request processed in 7355us (7710us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773199.481988:0:8393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 53 00000100:00100000:3.0:1790773199.547914:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773199.548032:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484456192 00000100:00100000:1.0:1790773199.548043:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484456192 00000100:00100000:1.0:1790773199.548099:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 139 00000100:00100000:1.0:1790773199.548108:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14304b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+16:11360:x1877761484456192:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1790773199.548191:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc78422b9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773199.548396:0:6479:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc78421a8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd14 expref: 16 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773199.548406:0:6479:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc78422b9 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773199.548441:0:6479:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc78421a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd14 expref: 16 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773199.548455:0:6479:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc78421a8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd14 expref: 16 pid: 13768 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773199.548469:0:6479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144440700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1877761496055296:192.168.202.19@tcp:104: 00000100:00100000:1.0:1790773199.548544:0:6479:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26bebf000 going to sleep for 11 seconds 00000100:00100000:0.0:1790773199.555869:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773199.555972:0:6479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144440700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1877761496055296:192.168.202.19@tcp:104: 00010000:00010000:1.0:1790773199.556010:0:6479:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc78422b9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773199.556580:0:6464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484456320 00000100:00100000:3.0:1790773199.556587:0:6464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484456320 00010000:00010000:3.0:1790773199.556621:0:6464:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc78421a8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd14 expref: 17 pid: 13768 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773199.556662:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 78 00000100:00100000:3.0:1790773199.556671:0:6464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:110130ab-04fa-4d7c-984e-562032df4432+17:2397:x1877761484456320:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790773199.556685:0:6464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773199.556691:0:6464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc78421a8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd14 expref: 17 pid: 13768 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.556702:0:6464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc78421a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd14 expref: 17 pid: 13768 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.556723:0:6464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc78421a8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd14 expref: 17 pid: 13768 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.556737:0:6464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93d26ede0200) 00010000:00010000:3.0:1790773199.556743:0:6464:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac800/0xabf1cc0bc784220a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd37 expref: 16 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.556753:0:6464:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc78422b9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.556762:0:6464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc78422b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.556770:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc78422b9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.556806:0:6464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790773199.556852:0:6464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:110130ab-04fa-4d7c-984e-562032df4432+16:2397:x1877761484456320:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 181us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773199.556858:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 78 00010000:00010000:0.0:1790773199.557343:0:6479:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc78422b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.557352:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc78422b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.557507:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc78422c0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.557520:0:6479:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7842273 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd53 expref: 16 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.557540:0:6479:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc78422c0 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.557567:0:6479:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7842273 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd53 expref: 16 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773199.557579:0:6479:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7842273 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd53 expref: 16 pid: 8697 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773199.557591:0:6479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1877761496055424:192.168.202.19@tcp:104: 00000100:00100000:0.0:1790773199.557658:0:6479:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d14265b000 going to sleep for 11 seconds 00000100:00100000:0.0:1790773199.561496:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773199.561603:0:8410:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484456448 00000100:00100000:3.0:1790773199.561612:0:8410:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484456448 00010000:00010000:3.0:1790773199.561661:0:8410:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7842273 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd53 expref: 17 pid: 8697 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773199.561666:0:6479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1877761496055424:192.168.202.19@tcp:104: 00010000:00010000:1.0:1790773199.561708:0:6479:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc78422c0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773199.561741:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 79 00000100:00100000:3.0:1790773199.561748:0:8410:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:110130ab-04fa-4d7c-984e-562032df4432+17:2398:x1877761484456448:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790773199.561761:0:8410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773199.561766:0:8410:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7842273 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd53 expref: 17 pid: 8697 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.561775:0:8410:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7842273 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd53 expref: 17 pid: 8697 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.561791:0:8410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7842273 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd53 expref: 17 pid: 8697 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.561802:0:8410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93d14363df00) 00010000:00010000:3.0:1790773199.561806:0:8410:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc78422c0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.561813:0:8410:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc78422c0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.561832:0:8410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc78422c0 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.561854:0:8410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790773199.561897:0:8410:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:110130ab-04fa-4d7c-984e-562032df4432+16:2398:x1877761484456448:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 149us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773199.561902:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 79 00010000:00010000:1.0:1790773199.561915:0:6479:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc78422c0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773199.561924:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc78422c0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790773199.562040:0:6479:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:1.0:1790773199.562161:0:6479:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:1.0:1790773199.562197:0:6479:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:1.0:1790773199.562481:0:6479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144440700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6479:1877761496055552:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1790773199.562526:0:6479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773199.562556:0:6479:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26bebf540 going to sleep for 11 seconds 00000100:00100000:3.0:1790773199.562577:0:12789:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496055552 00000100:00100000:3.0:1790773199.562581:0:12789:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496055552 00000100:00100000:3.0:1790773199.562656:0:12789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1790773199.562662:0:12789:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144442300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:6479:x1877761496055552:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1790773199.562759:0:12789:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144442300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:6479:x1877761496055552:12345-0@lo:1000:mdt00_001.0 Request processed in 98us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773199.562764:0:12789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1790773199.562837:0:6479:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:1.0:1790773199.562843:0:6479:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967311 00000004:00080000:1.0:1790773199.562859:0:6479:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93d27fa91f80, transno 4294967310 00000004:00080000:1.0:1790773199.562873:0:6479:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93d27fa93b80, transno 4294967311 00000100:00100000:1.0:1790773199.562879:0:6479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144440700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6479:1877761496055552:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1790773199.563793:0:6479:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:1.0:1790773199.563843:0:6479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144440700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6479:1877761496055680:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1790773199.563877:0:6479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773199.563908:0:6479:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26bebf780 going to sleep for 11 seconds 00000100:00100000:0.0:1790773199.564705:0:7666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496055680 00000100:00100000:0.0:1790773199.564714:0:7666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496055680 00000100:00100000:0.0:1790773199.564767:0:7666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1790773199.564776:0:7666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144440a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6479:x1877761496055680:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1790773199.565238:0:6479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144440700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6479:1877761496055680:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1790773199.565280:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc78422c0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.565288:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc78422c0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.565293:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc78422c0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.565296:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074bc00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773199.565299:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc78422c0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.565319:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc78422c0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.565333:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93d14363df00) 00010000:00010000:3.0:1790773199.565337:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790773199.565341:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc78422c0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.565347:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc78422c0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.565369:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc7842203 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.565376:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc7842203 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.565380:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc7842203 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.565383:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ac200 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773199.565385:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc7842203 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.565389:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc7842203 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.565395:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93d26ede0200) 00010000:00010000:3.0:1790773199.565398:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1790773199.565399:0:7666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144440a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6479:x1877761496055680:12345-0@lo:1000:mdt00_001.0 Request processed in 620us (1518us total) trans 4294967313 rc 0/0 00010000:00010000:3.0:1790773199.565403:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac800/0xabf1cc0bc784220a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd37 expref: 19 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773199.565414:0:7666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00010000:00010000:3.0:1790773199.565428:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac800/0xabf1cc0bc784220a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd37 expref: 19 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.565437:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac800/0xabf1cc0bc784220a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd37 expref: 19 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.565464:0:6479:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac800/0xabf1cc0bc784220a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd37 expref: 19 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773199.565486:0:6479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14304b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1877761496055808:192.168.202.19@tcp:105: 00000100:00100000:3.0:1790773199.565545:0:6479:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d143779c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790773199.568891:0:6479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14304b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1877761496055808:192.168.202.19@tcp:105: 00000100:00100000:0.0:1790773199.568891:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00010000:00010000:3.0:1790773199.568915:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc7842203 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.568924:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc7842203 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.568953:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc78422c7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.568966:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc78422c7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.568978:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc78422c7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.568988:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc78422c7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773199.569166:0:6482:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484456576 00000100:00100000:2.0:1790773199.569174:0:6482:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484456576 00000100:00100000:2.0:1790773199.569318:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 31 00010000:00010000:3.0:1790773199.569323:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc78422c7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.569332:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc78422c7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773199.569338:0:6481:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00010000:00010000:3.0:1790773199.569339:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ade00 already unused, calling callback (ffffffffc1adc4f0) 00000100:00100000:2.0:1790773199.569340:0:6482:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+20:11358:x1877761484456576:12345-192.168.202.19@tcp:49:lfs.0 00010000:00010000:3.0:1790773199.569345:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc78422c7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.569353:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc78422c7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773199.569355:0:6481:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00010000:00010000:3.0:1790773199.569369:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93d26ede0200) 00010000:00010000:3.0:1790773199.569372:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790773199.569375:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc78422c7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.569381:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc78422c7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.569390:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc78422b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.569395:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc78422b9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.569401:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc78422b9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.569405:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12bc00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773199.569413:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc78422b9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.569419:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc78422b9 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.569426:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93d26ede0200) 00010000:00010000:3.0:1790773199.569428:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790773199.569430:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc78422b9 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773199.569436:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc78422b9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773199.569469:0:6482:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+20:11358:x1877761484456576:12345-192.168.202.19@tcp:49:lfs.0 Request processed in 132us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773199.569476:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 31 00000100:00100000:3.0:1790773199.569835:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14304b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+19:11360:x1877761484456192:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 21727us (21929us total) trans 4294967408 rc 0/0 00000100:00100000:3.0:1790773199.569845:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 139 00000020:00080000:3.0:1790773199.569849:0:6479:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1790773199.570136:0:13749:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790773199.570140:0:13749:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790773199.571175:0:13749:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1790773199.571190:0:13749:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790773199.572297:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773199.572357:0:6482:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484456832 00000100:00100000:2.0:1790773199.572367:0:6482:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484456832 00000100:00100000:2.0:1790773199.572402:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 32 00000100:00100000:2.0:1790773199.572424:0:6482:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d279dbac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+19:11360:x1877761484456832:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1790773199.572708:0:6482:0:(mdd_object.c:4189:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1790773199.572740:0:6482:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:2.0:1790773199.572773:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc78422ce lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773199.572790:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc78422ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773199.572803:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc78422ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773199.572811:0:6482:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc78422ce lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773199.572818:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc78422ce lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773199.572830:0:6482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc78422ce lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773199.572850:0:6482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790773199.572923:0:6482:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d279dbac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+21:11360:x1877761484456832:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 Request processed in 502us (631us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1790773199.572931:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 32 00000020:00080000:2.0:1790773199.572935:0:6482:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1790773199.573372:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773199.573399:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484457088 00000100:00100000:0.0:1790773199.573404:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484457088 00000100:00100000:0.0:1790773199.573445:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 140 00000100:00100000:0.0:1790773199.573452:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+21:11358:x1877761484457088:12345-192.168.202.19@tcp:58:lfs.0 00000040:00080000:0.0:1790773199.573549:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1790773199.573613:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+21:11358:x1877761484457088:12345-192.168.202.19@tcp:58:lfs.0 Request processed in 161us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773199.573620:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 140 00010000:00010000:1.0:1790773199.573863:0:6467:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790773199.573871:0:6467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc78422ce lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773199.573879:0:6467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc5600 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:1.0:1790773199.573883:0:6467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc78422ce lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773199.573891:0:6467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc78422ce lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773199.573914:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93d14363df00) 00010000:00010000:1.0:1790773199.573916:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1790773199.573921:0:6467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc78422ce lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773199.573927:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc78422ce lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773199.573938:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773199.573940:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773199.573941:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773199.595446:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773199.595538:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484457216 00000100:00100000:1.0:1790773199.595548:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484457216 00000100:00100000:1.0:1790773199.595607:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 141 00000100:00100000:1.0:1790773199.595616:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+21:11362:x1877761484457216:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1790773199.595650:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773199.595670:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc78422d5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bd6f expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773199.595734:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc78422dc lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773199.595752:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc78422dc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773199.595764:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc78422dc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773199.595777:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc78422e3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773199.595797:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc78422e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773199.595803:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc78422e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773199.595888:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc78422ea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773199.595898:0:13768:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc78421f5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd30 expref: 22 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773199.595906:0:13768:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc78422ea lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773199.595936:0:13768:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc78421f5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd30 expref: 22 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773199.595949:0:13768:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc78421f5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd30 expref: 22 pid: 8697 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773199.595962:0:13768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144440e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13768:1877761496055936:192.168.202.19@tcp:104: 00000100:00100000:1.0:1790773199.596038:0:13768:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26bebf600 going to sleep for 11 seconds 00000100:00100000:1.0:1790773199.598285:0:13768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144440e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13768:1877761496055936:192.168.202.19@tcp:104: 00010000:00010000:1.0:1790773199.598312:0:13768:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc78422ea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773199.598325:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773199.598471:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484457472 00000100:00100000:0.0:1790773199.598478:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484457472 00000100:00100000:0.0:1790773199.598525:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 33 00000100:00100000:0.0:1790773199.598535:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:110130ab-04fa-4d7c-984e-562032df4432+23:6167:x1877761484457472:12345-192.168.202.19@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1790773199.598756:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:110130ab-04fa-4d7c-984e-562032df4432+24:6167:x1877761484457472:12345-192.168.202.19@tcp:35:ldlm_bl.0 Request processed in 222us (435us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1790773199.598764:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 33 00000100:00100000:0.0:1790773199.603402:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773199.603590:0:6465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484457600 00000100:00100000:1.0:1790773199.603613:0:6465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484457600 00010000:00010000:1.0:1790773199.603662:0:6465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc78421f5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd30 expref: 24 pid: 8697 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773199.603839:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 80 00000100:00100000:1.0:1790773199.603851:0:6465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d252ea6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:110130ab-04fa-4d7c-984e-562032df4432+24:2398:x1877761484457600:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790773199.603867:0:6465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790773199.603873:0:6465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc78421f5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd30 expref: 24 pid: 8697 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773199.603887:0:6465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc78421f5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd30 expref: 24 pid: 8697 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773199.603909:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc78421f5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd30 expref: 24 pid: 8697 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773199.603926:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93d26ede0200) 00010000:00010000:1.0:1790773199.603932:0:6465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc78422ea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773199.603941:0:6465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc78422ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773199.603948:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc78422ea lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773199.603979:0:6465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790773199.604035:0:6465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d252ea6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:110130ab-04fa-4d7c-984e-562032df4432+23:2398:x1877761484457600:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 187us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773199.604051:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 80 00010000:00010000:2.0:1790773199.605685:0:13768:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc78422ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773199.605700:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc78422ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790773199.605769:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1790773199.605774:0:13768:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790773199.605795:0:13768:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc78422ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773199.605809:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc78422ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773199.605819:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc78422dc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773199.605827:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc78422dc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773199.605835:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc78422dc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773199.605840:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12be00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:2.0:1790773199.605844:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc78422dc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773199.605851:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc78422dc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773199.605863:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93d14363d100) 00010000:00010000:2.0:1790773199.605866:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790773199.605870:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc78422dc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773199.605876:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc78422dc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773199.605902:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc78422e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773199.605909:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc78422e3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773199.605915:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc78422e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773199.605920:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12a800 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:2.0:1790773199.605924:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc78422e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773199.605929:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc78422e3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773199.605937:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff93d14363d800) 00010000:00010000:2.0:1790773199.605940:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790773199.605943:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc78422e3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773199.606004:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc78422e3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773199.606047:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc78422d5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd6f expref: 23 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773199.606062:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc78422ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd6f expref: 22 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773199.606080:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93d26ede0200) 00010000:00010000:2.0:1790773199.606082:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790773199.606085:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12ae00, rc 0) 00000100:00100000:2.0:1790773199.606148:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+22:11362:x1877761484457216:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 10532us (10711us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773199.606157:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 141 00010000:00010000:3.0:1790773199.693440:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1790773200.209057:0:8388:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:3.0:1790773200.209074:0:8388:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000040:00080000:2.0:1790773200.547996:0:14225:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790773200.548004:0:14225:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790773200.548029:0:14225:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1790773200.548035:0:14225:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1790773200.590430:0:13749:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790773200.590438:0:13749:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790773200.590473:0:13749:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1790773200.590480:0:13749:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790773200.590601:0:13749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa88e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13749:1877761496056064:192.168.202.19@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790773200.590747:0:13749:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ef8cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1790773200.604084:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773200.604121:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484457728 00000100:00100000:1.0:1790773200.604130:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484457728 00000100:00100000:1.0:1790773200.604197:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 142 00000100:00100000:1.0:1790773200.604227:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144441f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+23:11374:x1877761484457728:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790773200.604263:0:6479:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790773200.604559:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144441f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+23:11374:x1877761484457728:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 Request processed in 352us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773200.604567:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 142 00000100:00080000:1.0:1790773200.604591:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790773200.608037:0:13749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa88e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13749:1877761496056064:192.168.202.19@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790773200.617961:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773200.618044:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484457984 00000100:00100000:0.0:1790773200.618056:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484457984 00000100:00100000:0.0:1790773200.618122:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 143 00000100:00100000:0.0:1790773200.618134:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144440e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+22:11374:x1877761484457984:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790773200.618160:0:8697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773200.618182:0:8697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc78422f1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bd76 expref: -99 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773200.618308:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc78422f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773200.618336:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc78422f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773200.618351:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc78422f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790773200.618376:0:8697:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1790773200.618477:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc78422f1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd76 expref: 25 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773200.618493:0:8697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc78422f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd76 expref: 24 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773200.618502:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93d26ede0200) 00010000:00010000:0.0:1790773200.618505:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790773200.618509:0:8697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074aa00, rc 0) 00000100:00100000:0.0:1790773200.618564:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144440e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+24:11374:x1877761484457984:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 432us (614us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1790773200.618572:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 143 00000100:00100000:1.0:1790773200.627282:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773200.627340:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773200.627365:0:6463:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484458368 00000100:00100000:1.0:1790773200.627374:0:6463:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484458368 00000100:00100000:1.0:1790773200.627432:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:1.0:1790773200.627443:0:6463:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144443800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:110130ab-04fa-4d7c-984e-562032df4432+24:2400:x1877761484458368:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790773200.627470:0:6463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790773200.627494:0:6463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc78422f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd76 expref: 24 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773200.627510:0:6463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93d26ede0200) 00010000:00010000:1.0:1790773200.627516:0:6463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790773200.627569:0:6463:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144443800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:110130ab-04fa-4d7c-984e-562032df4432+23:2400:x1877761484458368:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 128us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773200.627587:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:0.0:1790773200.628790:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484458240 00000100:00100000:0.0:1790773200.628802:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484458240 00000100:00100000:0.0:1790773200.628851:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 144 00000100:00100000:0.0:1790773200.628859:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+23:11374:x1877761484458240:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1790773200.628930:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7842306 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773200.628949:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7842306 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773200.628959:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7842306 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773200.629147:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7842306 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773200.629161:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7842306 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773200.629168:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7842306 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773200.629174:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074ae00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773200.629178:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7842306 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773200.629186:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7842306 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773200.629195:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93d26ede0200) 00010000:00010000:0.0:1790773200.629198:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790773200.629228:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7842306 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773200.629235:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7842306 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773200.629397:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+24:11374:x1877761484458240:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 537us (2122us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1790773200.629406:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 144 00000040:00080000:2.0:1790773200.629792:0:13749:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790773200.629797:0:13749:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790773200.630294:0:13749:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1790773200.630308:0:13749:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790773200.635141:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773200.635240:0:6482:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484458624 00000100:00100000:3.0:1790773200.635250:0:6482:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484458624 00000100:00100000:3.0:1790773200.635301:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 34 00000100:00100000:3.0:1790773200.635311:0:6482:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144442d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+24:11374:x1877761484458624:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1790773200.635546:0:6482:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144442d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+25:11374:x1877761484458624:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 Request processed in 236us (415us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1790773200.635554:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 34 00010000:00010000:3.0:1790773200.717294:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773201.229925:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496056192:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790773201.230002:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773201.230138:0:8397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496056192 00000100:00100000:0.0:1790773201.230147:0:8397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496056192 00000100:00100000:0.0:1790773201.230234:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1790773201.230245:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14304b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496056192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790773201.230274:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790773201.230690:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14304b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496056192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 447us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773201.230698:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1790773201.230792:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496056192:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1790773201.230908:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790773201.231142:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496056320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790773201.231177:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773201.231297:0:11145:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496056320 00000100:00100000:0.0:1790773201.231302:0:11145:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496056320 00000100:00100000:0.0:1790773201.231650:0:11145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1790773201.231658:0:11145:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144443b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496056320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790773201.231674:0:11145:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790773201.231720:0:11145:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144443b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496056320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773201.231727:0:11145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:1.0:1790773201.231849:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790773201.232068:0:3605:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:2.0:1790773201.232074:0:3605:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:2.0:1790773201.232092:0:3605:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93d243ee3b80, transno 4294967302 00000004:00080000:2.0:1790773201.232107:0:3605:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:2.0:1790773201.232132:0:3605:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93d14304aa00, transno 4294967305 00000100:00100000:2.0:1790773201.232141:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496056320:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790773201.741671:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773202.769481:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790773202.862725:0:14276:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790773202.862735:0:14276:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790773202.862770:0:14276:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1790773202.862777:0:14276:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790773203.001526:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773203.001570:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773203.001611:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773203.001634:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773203.001651:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773203.001668:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773203.001707:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773203.001740:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484459008 00000100:00100000:0.0:1790773203.001749:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484459008 00000100:00100000:0.0:1790773203.001812:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484459520 00000100:00100000:0.0:1790773203.001815:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484459520 00000100:00100000:0.0:1790773203.001829:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484458880 00000100:00100000:0.0:1790773203.001832:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484458880 00000100:00100000:0.0:1790773203.001845:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484459392 00000100:00100000:0.0:1790773203.001848:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484459392 00000100:00100000:0.0:1790773203.001863:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 280 00000100:00100000:0.0:1790773203.001873:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+5:2397:x1877761484459008:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1790773203.001945:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+5:2397:x1877761484459008:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 73us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773203.001962:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 280 00000100:00100000:0.0:1790773203.001982:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 281 00000100:00100000:0.0:1790773203.001988:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2397:x1877761484459520:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1790773203.002013:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2397:x1877761484459520:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 26us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773203.002020:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 281 00000100:00100000:0.0:1790773203.002031:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 282 00000100:00100000:0.0:1790773203.002038:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+25:2397:x1877761484458880:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1790773203.002066:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+25:2397:x1877761484458880:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 29us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773203.002072:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 282 00000100:00100000:0.0:1790773203.002084:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 283 00000100:00100000:0.0:1790773203.002089:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2397:x1877761484459392:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1790773203.002114:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2397:x1877761484459392:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 25us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773203.002121:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 283 00000100:00100000:0.0:1790773203.002141:0:8394:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484459264 00000100:00100000:0.0:1790773203.002144:0:8394:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484459264 00000100:00100000:0.0:1790773203.002186:0:8394:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484459136 00000100:00100000:0.0:1790773203.002190:0:8394:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484459136 00000100:00100000:0.0:1790773203.002233:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 102 00000100:00100000:0.0:1790773203.002240:0:8394:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:110130ab-04fa-4d7c-984e-562032df4432+6:2397:x1877761484459264:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1790773203.002267:0:8394:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:110130ab-04fa-4d7c-984e-562032df4432+6:2397:x1877761484459264:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 29us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773203.002278:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 102 00000100:00100000:0.0:1790773203.002289:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 103 00000100:00100000:0.0:1790773203.002295:0:8394:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:110130ab-04fa-4d7c-984e-562032df4432+5:2397:x1877761484459136:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1790773203.002324:0:8394:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:110130ab-04fa-4d7c-984e-562032df4432+5:2397:x1877761484459136:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 29us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773203.002330:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 103 00000100:00080000:0.0:1790773203.004656:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790773203.004666:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790773203.004669:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790773203.004672:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790773203.005417:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484458752 00000100:00100000:3.0:1790773203.005438:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484458752 00000100:00100000:3.0:1790773203.005500:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 383 00000100:00100000:3.0:1790773203.005510:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d251208c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:2397:x1877761484458752:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1790773203.005578:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d251208c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:2397:x1877761484458752:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 69us (4062us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773203.005586:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 383 00000100:00100000:1.0:1790773203.047905:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773203.047997:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484459776 00000100:00100000:0.0:1790773203.048008:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484459776 00000100:00100000:0.0:1790773203.048070:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 145 00000100:00100000:0.0:1790773203.048081:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144442680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+25:11394:x1877761484459776:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:0.0:1790773203.048103:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773203.048126:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a600/0xabf1cc0bc784230d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bd7d expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773203.048260:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7842314 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773203.048277:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7842314 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773203.048299:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7842314 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790773203.048310:0:6479:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1790773203.048428:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a600/0xabf1cc0bc784230d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd7d expref: 28 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773203.048443:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7842314 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd7d expref: 27 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773203.048452:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93d26ede0200) 00010000:00010000:0.0:1790773203.048455:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1790773203.048458:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074a400, rc 0) 00000100:00100000:0.0:1790773203.048523:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144442680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+27:11394:x1877761484459776:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 443us (628us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1790773203.048530:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 145 00000100:00100000:0.0:1790773203.050751:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773203.051856:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484459904 00000100:00100000:1.0:1790773203.051869:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484459904 00000100:00100000:1.0:1790773203.052260:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 146 00000100:00100000:1.0:1790773203.052272:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+27:11394:x1877761484459904:12345-192.168.202.19@tcp:54:lfs.0 00010000:00010000:1.0:1790773203.052660:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7842322 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773203.052680:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7842322 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773203.052692:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7842322 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773203.052726:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7842322 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773203.052734:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7842322 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773203.052740:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7842322 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773203.052751:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12b600 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773203.052764:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7842322 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773203.052773:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7842322 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773203.052786:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93d26ede0200) 00010000:00010000:1.0:1790773203.052788:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790773203.052793:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7842322 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773203.052799:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7842322 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773203.052885:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+27:11394:x1877761484459904:12345-192.168.202.19@tcp:54:lfs.0 Request processed in 614us (2140us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773203.052894:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 146 00000100:00100000:2.0:1790773203.182932:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773203.186122:0:8393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484460032 00000100:00100000:0.0:1790773203.186140:0:8393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484460032 00000100:00100000:0.0:1790773203.186262:0:8393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 54 00000100:00100000:0.0:1790773203.186273:0:8393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:110130ab-04fa-4d7c-984e-562032df4432+6:2400:x1877761484460032:12345-192.168.202.19@tcp:101:cat.0 00010000:00010000:0.0:1790773203.186293:0:8393:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773203.186317:0:8393:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005dcf15f4/0xabf1cc0bc7842329 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bd84 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790773203.186348:0:8393:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6abd07ce, atime: 0x6abd07ce, ctime: 0x6abd07ce, blocks: 0x8 00010000:00010000:0.0:1790773203.186370:0:8393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=345s v=(0 0) 00010000:00010000:0.0:1790773203.186375:0:8393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790773203.186385:0:8393:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005dcf15f4/0xabf1cc0bc7842329 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd84 expref: 7 pid: 8393 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773203.186428:0:8393:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005dcf15f4/0xabf1cc0bc7842329 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd84 expref: 7 pid: 8393 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773203.186442:0:8393:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074a600, rc 0) 00000100:00100000:0.0:1790773203.186517:0:8393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:110130ab-04fa-4d7c-984e-562032df4432+7:2400:x1877761484460032:12345-192.168.202.19@tcp:101:cat.0 Request processed in 245us (3595us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773203.186525:0:8393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 54 00000100:00100000:2.0:1790773203.190169:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773203.190241:0:8400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484460160 00000100:00100000:0.0:1790773203.190255:0:8400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484460160 00002000:00100000:2.0:1790773203.190400:0:8400:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff93d27fa8b480 x1877761484460160/t0(0) o3->110130ab-04fa-4d7c-984e-562032df4432@192.168.202.19@tcp:39/0 lens 488/0 e 0 to 0 dl 1790773214 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790773203.190411:0:8400:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93d27fa8b480 with x1877761484460160 ext(0->4095) 00002000:00010000:2.0:1790773203.190418:0:8400:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93d27fa8b480 00000100:00100000:2.0:1790773203.190455:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 3 00000100:00100000:2.0:1790773203.190465:0:8400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:110130ab-04fa-4d7c-984e-562032df4432+7:2399:x1877761484460160:12345-192.168.202.19@tcp:3:cat.0 00000100:00100000:2.0:1790773203.190870:0:8400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:110130ab-04fa-4d7c-984e-562032df4432+7:2399:x1877761484460160:12345-192.168.202.19@tcp:3:cat.0 Request processed in 405us (707us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1790773203.190877:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 3 00002000:00100000:2.0:1790773203.190883:0:8400:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff93d27fa8b480 x1877761484460160/t0(0) o3->110130ab-04fa-4d7c-984e-562032df4432@192.168.202.19@tcp:39/0 lens 488/4536 e 0 to 0 dl 1790773214 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790773203.190889:0:8400:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93d27fa8b480 with x1877761484460160 ext(0->4095) 00002000:00010000:2.0:1790773203.190892:0:8400:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93d27fa8b480 00000100:00100000:2.0:1790773203.277527:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790773203.277552:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144441500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496056448:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790773203.277642:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773203.277942:0:12789:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496056448 00000100:00100000:3.0:1790773203.277950:0:12789:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496056448 00000100:00100000:3.0:1790773203.278009:0:12789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1790773203.278019:0:12789:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496056448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790773203.278055:0:12789:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1790773203.278110:0:12789:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496056448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773203.278118:0:12789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1790773203.278173:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144441500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496056448:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790773203.278378:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790773203.278403:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144440380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496056576:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790773203.278436:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773203.278567:0:8397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496056576 00000100:00100000:1.0:1790773203.278572:0:8397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496056576 00000100:00100000:1.0:1790773203.278628:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1790773203.278635:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14304aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496056576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790773203.278655:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1790773203.278690:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14304aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496056576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773203.278696:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1790773203.279032:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3605:1877761496056832:0@lo:400:kworker.0 00000100:00100000:2.0:1790773203.279065:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773203.279092:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3605:1877761496057344:0@lo:400:kworker.0 00000100:00100000:2.0:1790773203.279129:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773203.279156:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3605:1877761496057856:0@lo:400:kworker.0 00000100:00100000:2.0:1790773203.279178:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773203.279200:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1790773203.279228:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce0675b4-b0c5-48e7-b182-565e22fed04c:3605:1877761496056704:0@lo:400:kworker.0 00000100:00100000:2.0:1790773203.279255:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773203.279278:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3605:1877761496057216:0@lo:400:kworker.0 00000100:00100000:2.0:1790773203.279316:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773203.279335:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3605:1877761496057728:0@lo:400:kworker.0 00000100:00100000:2.0:1790773203.279355:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773203.279370:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496058240:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790773203.279392:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773203.279417:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496056832 00000100:00100000:2.0:1790773203.279421:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496056832 00000100:00100000:1.0:1790773203.279572:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496057344 00000100:00100000:1.0:1790773203.279576:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496057344 00000100:00100000:1.0:1790773203.279609:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496057856 00000100:00100000:1.0:1790773203.279613:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496057856 00000100:00100000:1.0:1790773203.279628:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496057216 00000100:00100000:1.0:1790773203.279638:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496057216 00000100:00100000:1.0:1790773203.279656:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496057728 00000100:00100000:1.0:1790773203.279659:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496057728 00000100:00100000:1.0:1790773203.279674:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1790773203.279680:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3605:x1877761496056832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773203.279728:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3605:x1877761496056832:12345-0@lo:400:kworker.0 Request processed in 48us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773203.279735:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1790773203.279751:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1790773203.279757:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3605:x1877761496057344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773203.279785:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3605:x1877761496057344:12345-0@lo:400:kworker.0 Request processed in 29us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773203.279791:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1790773203.279805:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1790773203.279811:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3605:x1877761496057856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773203.279837:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3605:x1877761496057856:12345-0@lo:400:kworker.0 Request processed in 27us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773203.279843:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1790773203.279854:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1790773203.279859:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3605:x1877761496057216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773203.279884:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3605:x1877761496057216:12345-0@lo:400:kworker.0 Request processed in 25us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773203.279890:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1790773203.279902:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1790773203.279908:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3605:x1877761496057728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773203.279934:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3605:x1877761496057728:12345-0@lo:400:kworker.0 Request processed in 27us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773203.279946:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1790773203.279969:0:6483:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496058240 00000100:00100000:1.0:1790773203.279973:0:6483:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496058240 00000100:00100000:1.0:1790773203.279997:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1790773203.280003:0:6483:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496058240:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790773203.280027:0:6483:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1790773203.280061:0:6483:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496058240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 58us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773203.280067:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:3.0:1790773203.280155:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790773203.280159:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790773203.280162:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790773203.280180:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496056960:0@lo:400:kworker.0 00000100:00100000:3.0:1790773203.280228:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773203.280250:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496057472:0@lo:400:kworker.0 00000100:00100000:3.0:1790773203.280274:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773203.280306:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496057984:0@lo:400:kworker.0 00000100:00100000:3.0:1790773203.280326:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773203.280362:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144440380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496056576:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790773203.280381:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1790773203.280387:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3606:1877761496057088:0@lo:400:kworker.0 00000100:00100000:3.0:1790773203.280410:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773203.280427:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496057600:0@lo:400:kworker.0 00000100:00100000:3.0:1790773203.280464:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773203.280479:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144443100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496058112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790773203.280500:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773203.280524:0:8906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496057472 00000100:00100000:3.0:1790773203.280528:0:8906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496057472 00000100:00100000:3.0:1790773203.280557:0:8906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496057984 00000100:00100000:3.0:1790773203.280560:0:8906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496057984 00000100:00100000:3.0:1790773203.280577:0:8906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496057600 00000100:00100000:3.0:1790773203.280580:0:8906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496057600 00000100:00100000:3.0:1790773203.280605:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1790773203.280612:0:8906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14304bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496057472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773203.280656:0:8906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14304bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496057472:12345-0@lo:400:kworker.0 Request processed in 44us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773203.280662:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1790773203.280676:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1790773203.280682:0:8906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14304a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3606:x1877761496057984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773203.280709:0:8906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14304a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3606:x1877761496057984:12345-0@lo:400:kworker.0 Request processed in 28us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773203.280715:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1790773203.280725:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1790773203.280731:0:8906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d280b79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496057600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773203.280758:0:8906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d280b79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496057600:12345-0@lo:400:kworker.0 Request processed in 28us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773203.280764:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1790773203.280886:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496058112 00000100:00100000:3.0:1790773203.280889:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496058112 00000100:00100000:3.0:1790773203.280911:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1790773203.280917:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143048380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3606:x1877761496058112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790773203.280929:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1790773203.280957:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143048380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3606:x1877761496058112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773203.280963:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:3.0:1790773203.280978:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790773203.280981:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790773203.280989:0:12789:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496056960 00000100:00100000:3.0:1790773203.280992:0:12789:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496056960 00000100:00100000:3.0:1790773203.281014:0:12789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1790773203.281020:0:12789:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14304ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496056960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773203.281059:0:12789:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14304ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496056960:12345-0@lo:400:kworker.0 Request processed in 39us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773203.281065:0:12789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1790773203.281098:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496057600:0@lo:400:kworker.0 00000100:00100000:3.0:1790773203.281113:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144443100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496058112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790773203.281122:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496056960:0@lo:400:kworker.0 00000100:00100000:3.0:1790773203.281132:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496057472:0@lo:400:kworker.0 00000100:00100000:3.0:1790773203.281139:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496057984:0@lo:400:kworker.0 00000100:00100000:3.0:1790773203.281179:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496057088 00000100:00100000:3.0:1790773203.281183:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496057088 00000100:00100000:3.0:1790773203.281229:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1790773203.281236:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143049500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1877761496057088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773203.281268:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143049500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1877761496057088:12345-0@lo:400:kworker.0 Request processed in 33us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773203.281274:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1790773203.281298:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3606:1877761496057088:0@lo:400:kworker.0 00000100:00100000:1.0:1790773203.281457:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3605:1877761496057216:0@lo:400:kworker.0 00000100:00100000:1.0:1790773203.281467:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3605:1877761496057728:0@lo:400:kworker.0 00000100:00100000:1.0:1790773203.281478:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496058240:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790773203.281488:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3605:1877761496056832:0@lo:400:kworker.0 00010000:00080000:1.0:1790773203.281500:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1444c6d80 x1877761496057344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773203.281509:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3605:1877761496057344:0@lo:400:kworker.0 00010000:00080000:1.0:1790773203.281519:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27fa90e00 x1877761496057856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773203.281527:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3605:1877761496057856:0@lo:400:kworker.0 00000100:00100000:2.0:1790773203.287686:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496056704 00000100:00100000:2.0:1790773203.287703:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496056704 00000100:00100000:2.0:1790773203.287798:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1790773203.287846:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26be9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3605:x1877761496056704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773203.288162:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26be9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3605:x1877761496056704:12345-0@lo:400:kworker.0 Request processed in 322us (8887us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773203.288191:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1790773203.289761:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce0675b4-b0c5-48e7-b182-565e22fed04c:3605:1877761496056704:0@lo:400:kworker.0 00010000:00010000:3.0:1790773203.790500:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773204.816007:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1790773205.347941:0:9475:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:0.0:1790773205.347955:0:9475:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:2.0:1790773205.348867:0:6457:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:2.0:1790773205.348904:0:6457:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93d26bebf540 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1790773205.348922:0:6457:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93d143e0f200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93d26bebfd80 00000020:00080000:2.0:1790773205.348927:0:6457:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93d143e0fb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93d143d8a000 00000020:00080000:2.0:1790773205.348957:0:6457:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1790773205.348968:0:6510:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1790773205.349520:0:6510:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:0.0:1790773205.351451:0:3591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc78422a4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773205.351481:0:3591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc78422a4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773205.351490:0:3591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc78422a4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773205.351496:0:3591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc4200 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773205.351501:0:3591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc78422a4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773205.351509:0:3591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc78422a4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773205.351538:0:3591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93d14363df00) 00010000:00010000:0.0:1790773205.351550:0:3591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773205.351556:0:3591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc78422a4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773205.351562:0:3591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc78422a4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773205.837814:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773206.349917:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496058368:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790773206.350050:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773206.350431:0:11145:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496058368 00000100:00100000:0.0:1790773206.350443:0:11145:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496058368 00000100:00100000:3.0:1790773206.350560:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496058496:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790773206.350574:0:11145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1790773206.350593:0:11145:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144440000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496058368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790773206.350637:0:11145:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790773206.350655:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773206.350722:0:11145:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144440000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496058368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 134us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773206.350747:0:11145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1790773206.350774:0:11145:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496058496 00000100:00100000:0.0:1790773206.350778:0:11145:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496058496 00000100:00100000:0.0:1790773206.350793:0:11145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1790773206.350798:0:11145:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143048000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496058496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790773206.350809:0:11145:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790773206.350853:0:11145:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143048000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496058496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773206.350860:0:11145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1790773206.351133:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496058368:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790773206.351464:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496058496:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1790773206.352298:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1790773206.797812:0:13749:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790773206.797829:0:13749:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790773206.797857:0:13749:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1790773206.797873:0:13749:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1790773206.863353:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790773206.864915:0:13753:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790773207.888125:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773208.127689:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773208.127739:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773208.127774:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773208.127793:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484460288 00000100:00100000:0.0:1790773208.127812:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484460288 00000100:00100000:0.0:1790773208.127888:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 385 00000100:00100000:0.0:1790773208.127901:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26be9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:2399:x1877761484460288:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1790773208.127988:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773208.128003:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26be9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:2399:x1877761484460288:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 101us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773208.128025:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 385 00000100:00100000:3.0:1790773208.128092:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773208.128131:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773208.128149:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484460544 00000100:00100000:2.0:1790773208.128156:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484460544 00000100:00100000:3.0:1790773208.128184:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773208.128248:0:8906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484460800 00000100:00100000:3.0:1790773208.128257:0:8906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484460800 00000100:00100000:2.0:1790773208.128259:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484461056 00000100:00100000:2.0:1790773208.128265:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484461056 00000100:00100000:2.0:1790773208.128296:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484460416 00000100:00100000:2.0:1790773208.128300:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484460416 00000100:00100000:2.0:1790773208.128333:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484460928 00000100:00100000:3.0:1790773208.128334:0:8906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484460672 00000100:00100000:2.0:1790773208.128339:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484460928 00000100:00100000:3.0:1790773208.128341:0:8906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484460672 00000100:00100000:2.0:1790773208.128370:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 290 00000100:00100000:2.0:1790773208.128382:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143049f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+5:2399:x1877761484460544:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1790773208.128393:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 107 00000100:00100000:3.0:1790773208.128408:0:8906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14304a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:110130ab-04fa-4d7c-984e-562032df4432+6:2399:x1877761484460800:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1790773208.128451:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143049f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+5:2399:x1877761484460544:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 70us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773208.128459:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 290 00000100:00100000:2.0:1790773208.128487:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 291 00000100:00100000:3.0:1790773208.128488:0:8906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14304a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:110130ab-04fa-4d7c-984e-562032df4432+6:2399:x1877761484460800:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 78us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773208.128498:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143048700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2399:x1877761484461056:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1790773208.128503:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 107 00000100:00100000:3.0:1790773208.128531:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 108 00000100:00100000:2.0:1790773208.128546:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143048700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2399:x1877761484461056:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 46us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773208.128547:0:8906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14304a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:110130ab-04fa-4d7c-984e-562032df4432+5:2399:x1877761484460672:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1790773208.128568:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 291 00000100:00100000:2.0:1790773208.128585:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 292 00000100:00100000:2.0:1790773208.128603:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14304bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+13:2399:x1877761484460416:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1790773208.128628:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14304bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+13:2399:x1877761484460416:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 28us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773208.128635:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 292 00000100:00100000:2.0:1790773208.128646:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 293 00000100:00100000:2.0:1790773208.128653:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14304b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2399:x1877761484460928:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1790773208.128677:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14304b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2399:x1877761484460928:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 24us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773208.128683:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 293 00000100:00080000:2.0:1790773208.128829:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790773208.128835:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790773208.128837:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790773208.128840:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790773208.134811:0:8906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14304a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:110130ab-04fa-4d7c-984e-562032df4432+5:2399:x1877761484460672:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 6265us (6676us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773208.134823:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 108 00000100:00100000:0.0:1790773208.397730:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496058880:0@lo:400:kworker.0 00000100:00100000:0.0:1790773208.397842:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773208.397927:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3605:1877761496059392:0@lo:400:kworker.0 00000100:00100000:0.0:1790773208.397958:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773208.397981:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3605:1877761496059904:0@lo:400:kworker.0 00000100:00100000:0.0:1790773208.398004:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773208.398459:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1790773208.398468:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3605:1877761496058752:0@lo:400:kworker.0 00000100:00100000:0.0:1790773208.398497:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773208.398519:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3605:1877761496059264:0@lo:400:kworker.0 00000100:00100000:0.0:1790773208.398542:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773208.398573:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3605:1877761496059776:0@lo:400:kworker.0 00000100:00100000:0.0:1790773208.398597:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773208.398634:0:6483:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496058880 00000100:00100000:0.0:1790773208.398644:0:6483:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496058880 00000100:00100000:0.0:1790773208.398770:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1790773208.398780:0:6483:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496058880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773208.398856:0:6483:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496058880:12345-0@lo:400:kworker.0 Request processed in 77us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773208.398864:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1790773208.398895:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496059392 00000100:00100000:0.0:1790773208.399245:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496059392 00000100:00100000:0.0:1790773208.399289:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496059904 00000100:00100000:0.0:1790773208.399292:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496059904 00000100:00100000:0.0:1790773208.399318:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496058752 00000100:00100000:0.0:1790773208.399321:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496058752 00000100:00100000:0.0:1790773208.399332:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496059264 00000100:00100000:0.0:1790773208.399334:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496059264 00000100:00100000:0.0:1790773208.399576:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496059776 00000100:00100000:0.0:1790773208.399580:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496059776 00000100:00100000:0.0:1790773208.399599:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1790773208.399606:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3605:x1877761496059392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773208.399654:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3605:x1877761496059392:12345-0@lo:400:kworker.0 Request processed in 48us (1694us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773208.399661:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1790773208.399675:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1790773208.399681:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3605:x1877761496059904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773208.399794:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3605:x1877761496059904:12345-0@lo:400:kworker.0 Request processed in 114us (1789us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773208.399801:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1790773208.399813:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1790773208.399819:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3605:x1877761496058752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773208.399847:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3605:x1877761496058752:12345-0@lo:400:kworker.0 Request processed in 28us (1350us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773208.399853:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1790773208.399864:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1790773208.399870:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3605:x1877761496059264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773208.399898:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3605:x1877761496059264:12345-0@lo:400:kworker.0 Request processed in 28us (1355us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773208.399913:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1790773208.399923:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1790773208.399936:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3605:x1877761496059776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773208.399966:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3605:x1877761496059776:12345-0@lo:400:kworker.0 Request processed in 30us (1368us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773208.399971:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1790773208.400494:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3605:1877761496058752:0@lo:400:kworker.0 00000100:00100000:0.0:1790773208.400509:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3605:1877761496059264:0@lo:400:kworker.0 00000100:00100000:0.0:1790773208.400519:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3605:1877761496059776:0@lo:400:kworker.0 00000100:00100000:0.0:1790773208.400533:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496058880:0@lo:400:kworker.0 00010000:00080000:0.0:1790773208.400558:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1445c8700 x1877761496059392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773208.400572:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3605:1877761496059392:0@lo:400:kworker.0 00010000:00080000:0.0:1790773208.400584:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1445cb480 x1877761496059904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773208.400593:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3605:1877761496059904:0@lo:400:kworker.0 00000100:00080000:1.0:1790773208.400719:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790773208.400725:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790773208.401419:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790773208.401632:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce0675b4-b0c5-48e7-b182-565e22fed04c:3607:1877761496058624:0@lo:400:kworker.0 00000100:00100000:3.0:1790773208.401735:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773208.401780:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877761496059136:0@lo:400:kworker.0 00000100:00100000:3.0:1790773208.401811:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773208.401849:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496059648:0@lo:400:kworker.0 00000100:00100000:3.0:1790773208.401875:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773208.401895:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496060160:0@lo:400:kworker.0 00000100:00100000:3.0:1790773208.401915:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773208.401941:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1790773208.401948:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496059008:0@lo:400:kworker.0 00000100:00100000:3.0:1790773208.401973:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773208.401991:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496059520:0@lo:400:kworker.0 00000100:00100000:3.0:1790773208.402009:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773208.402026:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496060032:0@lo:400:kworker.0 00000100:00100000:3.0:1790773208.402045:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773208.402071:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790773208.402079:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496060416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790773208.402101:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773208.402174:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496058624 00000100:00100000:3.0:1790773208.402181:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496058624 00000100:00100000:3.0:1790773208.402242:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1790773208.402253:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26be9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3607:x1877761496058624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773208.402297:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26be9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3607:x1877761496058624:12345-0@lo:400:kworker.0 Request processed in 47us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773208.402304:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1790773208.402335:0:8393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496059648 00000100:00100000:3.0:1790773208.402339:0:8393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496059648 00000100:00100000:3.0:1790773208.402368:0:8393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496060160 00000100:00100000:3.0:1790773208.402371:0:8393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496060160 00000100:00100000:3.0:1790773208.402385:0:8393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496059520 00000100:00100000:3.0:1790773208.402387:0:8393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496059520 00000100:00100000:3.0:1790773208.402409:0:8393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496060032 00000100:00100000:3.0:1790773208.402412:0:8393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496060032 00000100:00100000:3.0:1790773208.402426:0:8393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1790773208.402431:0:8393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143049880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496059648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773208.402464:0:8393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143049880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496059648:12345-0@lo:400:kworker.0 Request processed in 33us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773208.402470:0:8393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1790773208.402480:0:8393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1790773208.402486:0:8393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496060160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773208.402512:0:8393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496060160:12345-0@lo:400:kworker.0 Request processed in 26us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773208.402517:0:8393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1790773208.402528:0:8393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1790773208.402533:0:8393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496059520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773208.402574:0:8393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496059520:12345-0@lo:400:kworker.0 Request processed in 41us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773208.402580:0:8393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1790773208.402590:0:8393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1790773208.402596:0:8393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14378c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496060032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773208.402622:0:8393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14378c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496060032:12345-0@lo:400:kworker.0 Request processed in 26us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773208.402627:0:8393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1790773208.402646:0:12789:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496059008 00000100:00100000:3.0:1790773208.402650:0:12789:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496059008 00000100:00100000:3.0:1790773208.402673:0:12789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1790773208.402679:0:12789:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496059008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773208.402719:0:12789:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496059008:12345-0@lo:400:kworker.0 Request processed in 40us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773208.402725:0:12789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1790773208.402751:0:11145:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496060416 00000100:00100000:3.0:1790773208.402754:0:11145:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496060416 00000100:00100000:3.0:1790773208.402776:0:11145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1790773208.402783:0:11145:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f977100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496060416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790773208.402804:0:11145:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1790773208.402837:0:11145:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f977100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496060416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773208.402843:0:11145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1790773208.402869:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1434b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496060544:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790773208.402892:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773208.402910:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790773208.402915:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1434bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496060672:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790773208.402935:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773208.402975:0:3604:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:3.0:1790773208.402980:0:3604:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:3.0:1790773208.403004:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496060416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790773208.403695:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496059008:0@lo:400:kworker.0 00000100:00100000:3.0:1790773208.403707:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496059520:0@lo:400:kworker.0 00000100:00100000:3.0:1790773208.403716:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496060032:0@lo:400:kworker.0 00000100:00100000:3.0:1790773208.403725:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce0675b4-b0c5-48e7-b182-565e22fed04c:3607:1877761496058624:0@lo:400:kworker.0 00000100:00100000:3.0:1790773208.403733:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496059648:0@lo:400:kworker.0 00000100:00100000:3.0:1790773208.403753:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496060160:0@lo:400:kworker.0 00000100:00100000:3.0:1790773208.403781:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496059136 00000100:00100000:3.0:1790773208.403785:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496059136 00000100:00100000:3.0:1790773208.403816:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1790773208.403823:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143049180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877761496059136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773208.403873:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143049180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877761496059136:12345-0@lo:400:kworker.0 Request processed in 51us (2060us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773208.403879:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1790773208.403906:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877761496059136:0@lo:400:kworker.0 00000100:00100000:1.0:1790773208.405063:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496060288:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790773208.405152:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790773208.405232:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790773208.405239:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790773208.405258:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496060544 00000100:00100000:1.0:1790773208.405266:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496060544 00000100:00100000:1.0:1790773208.405315:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1790773208.405324:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496060544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790773208.405367:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1790773208.405423:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496060544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (2528us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773208.405430:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1790773208.405462:0:7666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496060672 00000100:00100000:1.0:1790773208.405466:0:7666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496060672 00000100:00100000:1.0:1790773208.405491:0:7666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496060288 00000100:00100000:1.0:1790773208.405494:0:7666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496060288 00000100:00100000:1.0:1790773208.405514:0:7666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1790773208.405520:0:7666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496060672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790773208.405564:0:7666:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1790773208.405601:0:7666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496060672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (2665us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773208.405607:0:7666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1790773208.405639:0:7666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1790773208.405645:0:7666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144441180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496060288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790773208.405667:0:7666:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1790773208.405715:0:7666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144441180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496060288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773208.405721:0:7666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1790773208.406088:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1434bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496060672:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790773208.406113:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1434b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496060544:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790773208.406161:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496060288:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1790773208.910366:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773209.934321:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773210.366600:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773210.366812:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484461184 00000100:00100000:0.0:1790773210.366823:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484461184 00000100:00100000:0.0:1790773210.367000:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 147 00000100:00100000:0.0:1790773210.367011:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+13:11047:x1877761484461184:12345-192.168.202.19@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1790773210.367113:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+13:11047:x1877761484461184:12345-192.168.202.19@tcp:60:lhsmtool_posix.0 Request processed in 105us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773210.367120:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 147 00000100:00100000:3.0:1790773210.369303:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773210.370156:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484461312 00000100:00100000:0.0:1790773210.370169:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484461312 00000100:00080000:1.0:1790773210.370249:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790773210.370254:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790773210.376443:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 148 00000100:00100000:0.0:1790773210.376460:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+5:11047:x1877761484461312:12345-192.168.202.19@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1790773210.376586:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+5:11047:x1877761484461312:12345-192.168.202.19@tcp:60:lhsmtool_posix.0 Request processed in 131us (7294us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773210.377247:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 148 00000100:00100000:3.0:1790773210.384945:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773210.385042:0:6482:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484461568 00000100:00100000:2.0:1790773210.385052:0:6482:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484461568 00000100:00100000:2.0:1790773210.385103:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 35 00000100:00100000:2.0:1790773210.385112:0:6482:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+13:11047:x1877761484461568:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790773210.385654:0:6482:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+14:11047:x1877761484461568:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 Request processed in 541us (721us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1790773210.385663:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 35 00000001:00080000:2.0:1790773210.387386:0:6457:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:2.0:1790773210.387399:0:6457:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1790773210.387434:0:6510:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1790773210.387446:0:6510:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1790773210.957493:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773211.478058:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790773211.478082:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496060800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790773211.478158:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773211.478252:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496060800 00000100:00100000:2.0:1790773211.478270:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496060800 00000100:00100000:0.0:1790773211.478628:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1790773211.478640:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496060800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790773211.478675:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790773211.478726:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496060800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773211.478734:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1790773211.478786:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496060800:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1790773211.478914:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790773211.479121:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496060928:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790773211.479150:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773211.479537:0:11145:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496060928 00000100:00100000:0.0:1790773211.479543:0:11145:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496060928 00000100:00100000:0.0:1790773211.479580:0:11145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1790773211.479587:0:11145:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496060928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790773211.479600:0:11145:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790773211.479632:0:11145:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496060928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773211.479638:0:11145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:2.0:1790773211.479682:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790773211.479706:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496060928:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1790773211.983250:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790773212.229419:0:14474:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 09:00:10 (1790773210) 00010000:00010000:0.0:1790773213.011906:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773213.231384:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773213.231434:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773213.231470:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773213.231510:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773213.231537:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773213.231581:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484461952 00000100:00100000:2.0:1790773213.231591:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484461952 00000100:00100000:2.0:1790773213.231648:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484462464 00000100:00100000:2.0:1790773213.231651:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484462464 00000100:00100000:2.0:1790773213.231665:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484461824 00000100:00100000:2.0:1790773213.231668:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484461824 00000100:00100000:2.0:1790773213.231685:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 300 00000100:00100000:2.0:1790773213.231695:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+5:2398:x1877761484461952:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1790773213.231771:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+5:2398:x1877761484461952:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 78us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773213.231779:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 300 00000100:00100000:2.0:1790773213.231796:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 301 00000100:00100000:2.0:1790773213.231802:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2398:x1877761484462464:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1790773213.231843:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2398:x1877761484462464:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 41us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773213.231864:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 301 00000100:00100000:2.0:1790773213.231877:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 302 00000100:00100000:2.0:1790773213.231883:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+13:2398:x1877761484461824:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1790773213.231911:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+13:2398:x1877761484461824:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 28us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773213.231917:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 302 00000100:00080000:2.0:1790773213.231932:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790773213.231936:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790773213.232263:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484461696 00000100:00100000:0.0:1790773213.232268:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484461696 00000100:00100000:0.0:1790773213.232299:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 387 00000100:00100000:0.0:1790773213.232306:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26be9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:2398:x1877761484461696:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1790773213.232333:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26be9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:2398:x1877761484461696:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 27us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773213.232340:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 387 00000100:00100000:3.0:1790773213.232468:0:8393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484462208 00000100:00100000:3.0:1790773213.232473:0:8393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484462208 00000100:00100000:3.0:1790773213.232527:0:8393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 113 00000100:00100000:3.0:1790773213.232536:0:8393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:110130ab-04fa-4d7c-984e-562032df4432+6:2398:x1877761484462208:12345-192.168.202.19@tcp:400:kworker.0 00000100:00080000:0.0:1790773213.232613:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790773213.232919:0:8393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:110130ab-04fa-4d7c-984e-562032df4432+6:2398:x1877761484462208:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 384us (1447us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773213.232927:0:8393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 113 00000100:00100000:2.0:1790773213.238934:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773213.238989:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773213.239130:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484462336 00000100:00100000:0.0:1790773213.239140:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484462336 00000100:00100000:0.0:1790773213.239245:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 303 00000100:00100000:0.0:1790773213.239254:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2398:x1877761484462336:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1790773213.239342:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2398:x1877761484462336:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 89us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773213.239350:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 303 00000100:00100000:3.0:1790773213.239680:0:8394:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484462080 00000100:00100000:3.0:1790773213.239685:0:8394:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484462080 00000100:00100000:3.0:1790773213.239727:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 114 00000100:00100000:3.0:1790773213.239735:0:8394:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143dece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:110130ab-04fa-4d7c-984e-562032df4432+5:2398:x1877761484462080:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1790773213.239777:0:8394:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143dece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:110130ab-04fa-4d7c-984e-562032df4432+5:2398:x1877761484462080:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 43us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773213.239800:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 114 00000100:00080000:2.0:1790773213.240465:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790773213.240470:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790773213.517534:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144441c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496061056:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790773213.517617:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773213.517915:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790773213.517924:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496061184:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790773213.517953:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773213.518032:0:7666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496061056 00000100:00100000:1.0:1790773213.518040:0:7666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496061056 00000100:00100000:1.0:1790773213.518091:0:7666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496061184 00000100:00100000:1.0:1790773213.518094:0:7666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496061184 00000100:00100000:1.0:1790773213.518114:0:7666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1790773213.518122:0:7666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496061056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790773213.518157:0:7666:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1790773213.518236:0:7666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496061056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 114us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773213.518243:0:7666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1790773213.518260:0:7666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1790773213.518266:0:7666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496061184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790773213.518283:0:7666:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1790773213.518310:0:7666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496061184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 44us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773213.518330:0:7666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1790773213.518465:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496061312:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790773213.518517:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773213.518554:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3604:1877761496061824:0@lo:400:kworker.0 00000100:00100000:3.0:1790773213.518589:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773213.518607:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce0675b4-b0c5-48e7-b182-565e22fed04c:3605:1877761496061440:0@lo:400:kworker.0 00000100:00100000:3.0:1790773213.518613:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14453e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3604:1877761496062336:0@lo:400:kworker.0 00000100:00100000:3.0:1790773213.521850:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773213.521966:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3606:1877761496061568:0@lo:400:kworker.0 00000100:00100000:1.0:1790773213.522045:0:8397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496061312 00000100:00100000:1.0:1790773213.522052:0:8397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496061312 00000100:00100000:1.0:1790773213.522122:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1790773213.522131:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496061312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790773213.522170:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1790773213.522258:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496061312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 118us (3731us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773213.522266:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1790773213.523723:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790773213.523770:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790773213.523800:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3605:1877761496061952:0@lo:400:kworker.0 00000100:00100000:2.0:1790773213.523867:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877761496061696:0@lo:400:kworker.0 00000100:00100000:2.0:1790773213.523900:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496061440 00000100:00100000:2.0:1790773213.523907:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496061440 00000100:00100000:2.0:1790773213.523944:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1790773213.523952:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26be9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3605:x1877761496061440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773213.523994:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26be9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3605:x1877761496061440:12345-0@lo:400:kworker.0 Request processed in 43us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773213.524014:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1790773213.526647:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496061824 00000100:00100000:1.0:1790773213.526664:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496061824 00000100:00100000:1.0:1790773213.526734:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496062336 00000100:00100000:1.0:1790773213.526739:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496062336 00000100:00100000:1.0:1790773213.526766:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1790773213.526775:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3604:x1877761496061824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773213.526841:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790773213.526880:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790773213.526892:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496061952 00000100:00100000:2.0:1790773213.526895:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496061952 00000100:00100000:2.0:1790773213.526919:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1790773213.526925:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3604:x1877761496062336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773213.526977:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3604:x1877761496062336:12345-0@lo:400:kworker.0 Request processed in 52us (5135us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773213.526984:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1790773213.527003:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1790773213.527009:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14453f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3605:x1877761496061952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773213.527038:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14453f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3605:x1877761496061952:12345-0@lo:400:kworker.0 Request processed in 30us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773213.527044:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00080000:2.0:1790773213.527059:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1790773213.527089:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f9f6d80 x1877761496061952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773213.527106:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3605:1877761496061952:0@lo:400:kworker.0 00000100:00100000:2.0:1790773213.527118:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14453ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3605:1877761496062464:0@lo:400:kworker.0 00000100:00100000:2.0:1790773213.527151:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773213.527169:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496062464 00000100:00100000:2.0:1790773213.527173:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496062464 00000100:00100000:2.0:1790773213.527230:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1790773213.527237:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14453f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3605:x1877761496062464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773213.527300:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14453f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3605:x1877761496062464:12345-0@lo:400:kworker.0 Request processed in 64us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773213.527306:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00080000:2.0:1790773213.527331:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1790773213.527348:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d14453ca80 x1877761496062464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773213.527358:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14453ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3605:1877761496062464:0@lo:400:kworker.0 00000100:00100000:2.0:1790773213.527385:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce0675b4-b0c5-48e7-b182-565e22fed04c:3605:1877761496061440:0@lo:400:kworker.0 00000100:00100000:2.0:1790773213.527415:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773213.527437:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496062208:0@lo:400:kworker.0 00000100:00100000:2.0:1790773213.527477:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773213.527508:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496062720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790773213.528293:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773213.528341:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496062720 00000100:00100000:2.0:1790773213.528346:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496062720 00000100:00100000:2.0:1790773213.528387:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1790773213.528394:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14453fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496062720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790773213.528415:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1790773213.528523:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14453fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496062720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773213.528530:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1790773213.528620:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496061696 00000100:00100000:2.0:1790773213.528624:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496061696 00000100:00100000:2.0:1790773213.528642:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1790773213.528648:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14453ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877761496061696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773213.528690:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14453ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877761496061696:12345-0@lo:400:kworker.0 Request processed in 42us (1274us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773213.528696:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1790773213.528726:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877761496061696:0@lo:400:kworker.0 00000100:00100000:2.0:1790773213.528742:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496062720:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1790773213.528760:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790773213.528782:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773213.528805:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496062080:0@lo:400:kworker.0 00000100:00100000:2.0:1790773213.528831:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773213.528851:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14453ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496062592:0@lo:400:kworker.0 00000100:00100000:2.0:1790773213.528870:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773213.528899:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496061184:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790773213.528914:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144441c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496061056:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790773213.528936:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496061568 00000100:00100000:2.0:1790773213.528939:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496061568 00000100:00100000:2.0:1790773213.528956:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1790773213.528962:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14453e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1877761496061568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773213.528996:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14453e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1877761496061568:12345-0@lo:400:kworker.0 Request processed in 34us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773213.529003:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1790773213.529030:0:8392:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496062208 00000100:00100000:2.0:1790773213.529034:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3606:1877761496061568:0@lo:400:kworker.0 00000100:00100000:0.0:1790773213.529036:0:8392:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496062208 00000100:00100000:2.0:1790773213.529070:0:8906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496062080 00000100:00100000:2.0:1790773213.529075:0:8906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496062080 00000100:00100000:0.0:1790773213.529077:0:8392:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496062592 00000100:00100000:0.0:1790773213.529082:0:8392:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496062592 00000100:00100000:0.0:1790773213.529532:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1790773213.529542:0:8392:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14453ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496062208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773213.529589:0:8392:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14453ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496062208:12345-0@lo:400:kworker.0 Request processed in 50us (2111us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773213.529596:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1790773213.529622:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1790773213.529628:0:8392:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14453d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496062080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773213.529663:0:8392:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14453d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496062080:12345-0@lo:400:kworker.0 Request processed in 36us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773213.529669:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1790773213.529680:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1790773213.531124:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496062080:0@lo:400:kworker.0 00000100:00100000:0.0:1790773213.531316:0:8392:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14453c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496062592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773213.531381:0:8392:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14453c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496062592:12345-0@lo:400:kworker.0 Request processed in 72us (2509us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773213.531388:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:0.0:1790773213.531418:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790773213.531440:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496062208:0@lo:400:kworker.0 00000100:00100000:2.0:1790773213.531602:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14453ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496062592:0@lo:400:kworker.0 00000100:00100000:3.0:1790773213.533557:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14453e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3604:1877761496062336:0@lo:400:kworker.0 00000100:00100000:3.0:1790773213.533591:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496061312:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790773213.533901:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3604:x1877761496061824:12345-0@lo:400:kworker.0 Request processed in 7124us (15308us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773213.533912:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1790773213.534001:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3604:1877761496061824:0@lo:400:kworker.0 00000100:00100000:2.0:1790773213.929817:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773213.933468:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484462720 00000100:00100000:1.0:1790773213.933486:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484462720 00000100:00100000:1.0:1790773213.933581:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 149 00000100:00100000:1.0:1790773213.933592:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14453ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+13:12113:x1877761484462720:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790773213.933616:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773213.933638:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7842330 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bd8b expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773213.933740:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc7842337 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773213.933755:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc7842337 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773213.933770:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc7842337 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773213.933783:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b400/0xabf1cc0bc784233e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773213.933790:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b400/0xabf1cc0bc784233e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773213.933795:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b400/0xabf1cc0bc784233e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773213.933881:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc7842345 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773213.933888:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc7842345 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773213.933894:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc7842345 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790773213.933902:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1790773213.933979:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc7842337 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773213.933991:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc7842337 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773213.933996:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc7842337 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773213.934000:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12b200 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773213.934004:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc7842337 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773213.934009:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc7842337 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773213.934018:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93d280936b00) 00010000:00010000:1.0:1790773213.934020:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790773213.934024:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc7842337 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773213.934028:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc7842337 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773213.934038:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b400/0xabf1cc0bc784233e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773213.934042:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b400/0xabf1cc0bc784233e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773213.934045:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b400/0xabf1cc0bc784233e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773213.934048:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12b400 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773213.934054:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b400/0xabf1cc0bc784233e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773213.934058:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b400/0xabf1cc0bc784233e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773213.934062:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff93d14363dd00) 00010000:00010000:1.0:1790773213.934063:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790773213.934065:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b400/0xabf1cc0bc784233e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773213.934068:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b400/0xabf1cc0bc784233e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773213.935065:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7842330 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd8b expref: 16 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773213.935086:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc7842345 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd8b expref: 15 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773213.935094:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93d26ede0500) 00010000:00010000:1.0:1790773213.935096:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790773213.935099:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12a200, rc 0) 00000100:00100000:1.0:1790773213.935170:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14453ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+15:12113:x1877761484462720:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 1579us (5363us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1790773213.935179:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 149 00000100:00100000:1.0:1790773213.938648:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773213.938699:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773213.938799:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484462976 00000100:00100000:0.0:1790773213.938811:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484462976 00000100:00100000:0.0:1790773213.938890:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 150 00000100:00100000:0.0:1790773213.938901:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144441c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+15:12113:x1877761484462976:12345-192.168.202.19@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1790773213.939021:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144441c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+15:12113:x1877761484462976:12345-192.168.202.19@tcp:59:lhsmtool_posix.0 Request processed in 122us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773213.939029:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 150 00000100:00100000:3.0:1790773213.939402:0:6465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484462848 00000100:00100000:3.0:1790773213.939407:0:6465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484462848 00000100:00100000:3.0:1790773213.939459:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00100000:3.0:1790773213.939467:0:6465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144442a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:110130ab-04fa-4d7c-984e-562032df4432+15:2400:x1877761484462848:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790773213.939479:0:6465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773213.939514:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc7842345 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd8b expref: 15 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773213.939535:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93d26ede0500) 00010000:00010000:3.0:1790773213.939541:0:6465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790773213.939565:0:6465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144442a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:110130ab-04fa-4d7c-984e-562032df4432+14:2400:x1877761484462848:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 100us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773213.939571:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00100000:0.0:1790773213.952806:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773213.952916:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484463104 00000100:00100000:1.0:1790773213.952941:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484463104 00000100:00100000:1.0:1790773213.953017:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 151 00000100:00100000:1.0:1790773213.953027:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+5:12113:x1877761484463104:12345-192.168.202.19@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1790773213.953141:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+5:12113:x1877761484463104:12345-192.168.202.19@tcp:59:lhsmtool_posix.0 Request processed in 115us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773213.953148:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 151 00000040:00080000:3.0:1790773213.965484:0:13749:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790773213.965506:0:13749:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790773213.965986:0:13749:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1790773213.965997:0:13749:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1790773214.032521:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790773214.035726:0:13753:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790773215.061019:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790773216.013506:0:13749:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790773216.013516:0:13749:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790773216.013623:0:13749:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1790773216.013632:0:13749:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1790773216.082156:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790773216.082910:0:13753:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1790773216.589507:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790773216.589530:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14453f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496062848:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790773216.589606:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773216.589880:0:11145:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496062848 00000100:00100000:2.0:1790773216.589941:0:11145:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496062848 00000100:00080000:1.0:1790773216.590063:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790773216.590155:0:11145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1790773216.590282:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496062976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790773216.590315:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773216.590465:0:11145:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14453c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496062848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790773216.590510:0:11145:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790773216.590555:0:11145:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14453c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496062848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 392us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773216.590562:0:11145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1790773216.592675:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496062976 00000100:00100000:1.0:1790773216.592694:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496062976 00000100:00100000:0.0:1790773216.592755:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14453f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496062848:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790773216.592762:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1790773216.592771:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496062976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790773216.592790:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790773216.592870:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496062976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (2554us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773216.592876:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1790773216.593299:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496062976:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790773216.593319:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790773216.736082:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773216.736123:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484463232 00000100:00100000:3.0:1790773216.736134:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484463232 00000100:00100000:3.0:1790773216.736305:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 152 00000100:00100000:3.0:1790773216.736317:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+14:12155:x1877761484463232:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:3.0:1790773216.736340:0:8697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773216.736360:0:8697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc7842353 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bd92 expref: -99 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773216.736423:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc784235a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773216.736438:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc784235a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773216.736453:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc784235a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773216.736478:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc7842361 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773216.736486:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc7842361 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773216.736504:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc7842361 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773216.736551:0:8697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc784235a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773216.736558:0:8697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc784235a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773216.736565:0:8697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc784235a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773216.736570:0:8697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ade00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773216.736575:0:8697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc784235a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773216.736583:0:8697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc784235a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773216.736595:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d26ede0f00) 00010000:00010000:3.0:1790773216.736599:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790773216.736604:0:8697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc784235a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773216.736610:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc784235a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773216.736628:0:8697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc7842361 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773216.736633:0:8697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc7842361 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773216.736644:0:8697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc7842361 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773216.736649:0:8697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ad200 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773216.736651:0:8697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc7842361 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773216.736657:0:8697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc7842361 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773216.736664:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff93d250704b00) 00010000:00010000:3.0:1790773216.736666:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790773216.736669:0:8697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc7842361 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773216.736674:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc7842361 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773216.736705:0:8697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc7842353 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd92 expref: 15 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773216.736715:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d26ede0f00) 00010000:00010000:3.0:1790773216.736718:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790773216.736721:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc7842353 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd92 expref: 15 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773216.736730:0:8697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d1434ac200, rc 0) 00000100:00100000:3.0:1790773216.737131:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+14:12155:x1877761484463232:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 815us (1067us total) trans 0 rc 301/301 00000100:00100000:3.0:1790773216.737148:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 152 00000100:00080000:3.0:1790773216.737177:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790773216.745783:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773216.745886:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484463488 00000100:00100000:0.0:1790773216.745956:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484463488 00000100:00100000:0.0:1790773216.746008:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 153 00000100:00100000:0.0:1790773216.746018:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144441880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+14:12155:x1877761484463488:12345-192.168.202.19@tcp:36:lfs.0 00010000:00010000:0.0:1790773216.746088:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773216.746117:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b800/0xabf1cc0bc7841cb5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbbd expref: 14 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773216.746133:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d26ede0f00) 00010000:00010000:0.0:1790773216.746142:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790773216.746366:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7842368 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773216.746380:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7842368 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773216.746390:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7842368 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773216.746401:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784236f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773216.746407:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784236f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773216.746414:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784236f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773216.746860:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842376 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773216.746879:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842376 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773216.747064:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842376 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790773216.747095:0:6479:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007a799200 reply state 00000000b8257700 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842376 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773216.747107:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842376 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773216.747114:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93d26ede0c00) 00010000:00010000:0.0:1790773216.747117:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790773216.747120:0:6479:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1790773216.747125:0:6479:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1790773216.747133:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7842368 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773216.747140:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7842368 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773216.747147:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7842368 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773216.747153:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074b000 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773216.747158:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7842368 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773216.747177:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7842368 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773216.747196:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d26ede0b00) 00010000:00010000:0.0:1790773216.747198:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773216.747225:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7842368 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773216.747232:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7842368 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790773216.747250:0:6479:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007a799200 reply state 00000000b8257700 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784236f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773216.747259:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784236f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773216.747264:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff93d26ede0e00) 00010000:00010000:0.0:1790773216.747266:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790773216.747268:0:6479:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1790773216.747351:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144441880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+15:12155:x1877761484463488:12345-192.168.202.19@tcp:36:lfs.0 Request processed in 1333us (1573us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1790773216.747359:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 153 00000100:00100000:3.0:1790773216.894104:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773216.894548:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484463616 00000100:00100000:0.0:1790773216.894558:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484463616 00000100:00100000:0.0:1790773216.894616:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 154 00000100:00100000:0.0:1790773216.894626:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+15:12163:x1877761484463616:12345-192.168.202.19@tcp:101:lctl.0 00010000:00010000:0.0:1790773216.894651:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773216.894674:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc784237d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bd99 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773216.894739:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b800/0xabf1cc0bc7842384 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773216.894766:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b800/0xabf1cc0bc7842384 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773216.894777:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b800/0xabf1cc0bc7842384 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790773216.894823:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1790773216.894827:0:13768:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790773216.894846:0:13768:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b800/0xabf1cc0bc7842384 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773216.894869:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc784237d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd99 expref: 17 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773216.894889:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b800/0xabf1cc0bc7842384 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd99 expref: 16 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773216.894898:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d26ede0b00) 00010000:00010000:0.0:1790773216.894901:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790773216.894970:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074b800, rc 0) 00000100:00100000:0.0:1790773216.895087:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+16:12163:x1877761484463616:12345-192.168.202.19@tcp:101:lctl.0 Request processed in 462us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773216.895095:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 154 00000100:00100000:3.0:1790773216.990334:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773216.990543:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484463744 00000100:00100000:1.0:1790773216.990554:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484463744 00000100:00100000:1.0:1790773216.990625:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 155 00000100:00100000:1.0:1790773216.990635:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+16:12169:x1877761484463744:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:1.0:1790773216.990656:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773216.990675:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc784238b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bda0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773216.990765:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7842392 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773216.990783:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7842392 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773216.990796:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7842392 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773216.990808:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7842399 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773216.990814:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7842399 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773216.990820:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7842399 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773216.990913:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc78423a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773216.990921:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc78423a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773216.990928:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc78423a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790773216.990964:0:6480:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1790773216.990968:0:6480:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790773216.990988:0:6480:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc78423a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773216.991012:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7842392 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773216.991018:0:6480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7842392 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773216.991025:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7842392 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773216.991031:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12a400 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773216.991035:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7842392 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773216.991043:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7842392 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773216.991055:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d26ede0b00) 00010000:00010000:1.0:1790773216.991058:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790773216.991062:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7842392 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773216.991068:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7842392 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773216.991081:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7842399 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773216.991087:0:6480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7842399 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773216.991092:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7842399 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773216.991103:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12bc00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773216.991106:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7842399 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773216.991111:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7842399 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773216.991118:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff93d26ede0e00) 00010000:00010000:1.0:1790773216.991120:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790773216.991122:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7842399 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773216.991128:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12bc00/0xabf1cc0bc7842399 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773216.991155:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc784238b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bda0 expref: 18 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773216.991169:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc78423a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bda0 expref: 17 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773216.991176:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93d26ede0c00) 00010000:00010000:1.0:1790773216.991178:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1790773216.991181:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12be00, rc 0) 00000100:00100000:1.0:1790773216.991315:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+17:12169:x1877761484463744:12345-192.168.202.19@tcp:101:bash.0 Request processed in 680us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773216.991322:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 155 00000100:00100000:1.0:1790773216.998073:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773216.998536:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484464000 00000100:00100000:0.0:1790773216.998548:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484464000 00000100:00100000:0.0:1790773216.998640:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 156 00000100:00100000:0.0:1790773216.998651:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144440700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+17:12169:x1877761484464000:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:0.0:1790773216.998674:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773216.998702:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc78423a7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bda7 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773216.998805:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc78423ae lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773216.998819:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc78423ae lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773216.998830:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc78423ae lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773216.998845:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78423b5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773216.998852:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78423b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773216.998858:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78423b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790773216.999587:0:6478:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:0.0:1790773216.999718:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc78423bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773216.999728:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc78423bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773216.999736:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc78423bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773216.999764:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc78423ae lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773216.999782:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc78423ae lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773216.999789:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc78423ae lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773216.999795:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074aa00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773216.999799:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc78423ae lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773216.999806:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc78423ae lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773216.999818:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93d26ede0c00) 00010000:00010000:0.0:1790773216.999821:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773216.999826:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc78423ae lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773216.999832:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc78423ae lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790773216.999846:0:6478:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003ab6068f reply state 00000000922ebdc4 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78423b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773216.999855:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78423b5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773216.999862:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93d26ede0f00) 00010000:00010000:0.0:1790773216.999864:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790773216.999867:0:6478:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790773216.999910:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc78423a7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bda7 expref: 20 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773216.999932:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc78423bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bda7 expref: 19 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773216.999940:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d26ede0100) 00010000:00010000:0.0:1790773216.999942:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790773216.999945:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074ae00, rc 0) 00000100:00100000:0.0:1790773217.000013:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144440700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+20:12169:x1877761484464000:12345-192.168.202.19@tcp:101:bash.0 Request processed in 1364us (1953us total) trans 4294967419 rc 0/0 00000100:00100000:0.0:1790773217.000022:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 156 00000100:00100000:3.0:1790773217.012880:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773217.013324:0:8906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484464128 00000100:00100000:2.0:1790773217.013337:0:8906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484464128 00000100:00100000:2.0:1790773217.013490:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 55 00000100:00100000:2.0:1790773217.013502:0:8906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:110130ab-04fa-4d7c-984e-562032df4432+5:2399:x1877761484464128:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:2.0:1790773217.013521:0:8906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773217.013543:0:8906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000715485c4/0xabf1cc0bc78423ca lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bdae expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790773217.013570:0:8906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790773217.013590:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=359s v=(0 0) 00010000:00010000:2.0:1790773217.013595:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790773217.013606:0:8906:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000715485c4/0xabf1cc0bc78423ca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdae expref: 6 pid: 8906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773217.013646:0:8906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000715485c4/0xabf1cc0bc78423ca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdae expref: 6 pid: 8906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773217.013659:0:8906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26efc5000, rc 0) 00000100:00100000:2.0:1790773217.013731:0:8906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:110130ab-04fa-4d7c-984e-562032df4432+6:2399:x1877761484464128:12345-192.168.202.19@tcp:101:bash.0 Request processed in 232us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773217.013740:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 55 00000100:00080000:3.0:1790773217.014879:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790773217.019394:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773217.027309:0:8907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484464256 00000100:00100000:0.0:1790773217.027327:0:8907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484464256 00000100:00100000:0.0:1790773217.027796:0:8907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 56 00000100:00100000:0.0:1790773217.027809:0:8907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:110130ab-04fa-4d7c-984e-562032df4432+6:12169:x1877761484464256:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:0.0:1790773217.027830:0:8907:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773217.027851:0:8907:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000bccd597/0xabf1cc0bc78423d1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bdb5 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.027883:0:8907:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000715485c4/0xabf1cc0bc78423ca lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdae expref: 7 pid: 8906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.027911:0:8907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790773217.027916:0:8907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790773217.027923:0:8907:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bccd597/0xabf1cc0bc78423d1 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdb5 expref: 7 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.027995:0:8907:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000715485c4/0xabf1cc0bc78423ca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdae expref: 7 pid: 8906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.028010:0:8907:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000715485c4/0xabf1cc0bc78423ca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdae expref: 7 pid: 8906 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773217.028027:0:8907:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:8907:1877761496063104:192.168.202.19@tcp:104: 00000100:00100000:0.0:1790773217.028148:0:8907:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d143012b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790773217.032893:0:8907:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:8907:1877761496063104:192.168.202.19@tcp:104: 00010000:00010000:0.0:1790773217.032937:0:8907:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000bccd597/0xabf1cc0bc78423d1 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdb5 expref: 7 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.032957:0:8907:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074b000, rc 0) 00000100:00100000:0.0:1790773217.033023:0:8907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:110130ab-04fa-4d7c-984e-562032df4432+7:12169:x1877761484464256:12345-192.168.202.19@tcp:101:bash.0 Request processed in 5216us (13637us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773217.033033:0:8907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 56 00000100:00100000:3.0:1790773217.033661:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773217.035611:0:6463:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484464384 00000100:00100000:0.0:1790773217.035624:0:6463:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484464384 00010000:00010000:0.0:1790773217.035672:0:6463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000715485c4/0xabf1cc0bc78423ca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdae expref: 7 pid: 8906 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773217.035728:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 81 00000100:00100000:0.0:1790773217.035739:0:6463:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:110130ab-04fa-4d7c-984e-562032df4432+7:2397:x1877761484464384:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790773217.035775:0:6463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773217.035799:0:6463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000715485c4/0xabf1cc0bc78423ca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdae expref: 7 pid: 8906 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.035815:0:6463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000715485c4/0xabf1cc0bc78423ca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdae expref: 7 pid: 8906 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.035841:0:6463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000715485c4/0xabf1cc0bc78423ca lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdae expref: 7 pid: 8906 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.035859:0:6463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790773217.035926:0:6463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790773217.035937:0:6463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000bccd597/0xabf1cc0bc78423d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdb5 expref: 6 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.035948:0:6463:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bccd597/0xabf1cc0bc78423d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdb5 expref: 6 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.036528:0:6463:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000bccd597/0xabf1cc0bc78423d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdb5 expref: 6 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773217.036544:0:6463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445c8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6463:1877761496063232:192.168.202.19@tcp:105: 00000100:00100000:0.0:1790773217.036620:0:6463:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d143012b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790773217.044641:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773217.046760:0:14187:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484464640 00000100:00100000:1.0:1790773217.046773:0:14187:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484464640 00000100:00100000:1.0:1790773217.046845:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 36 00000100:00100000:1.0:1790773217.046856:0:14187:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:110130ab-04fa-4d7c-984e-562032df4432+20:12169:x1877761484464640:12345-192.168.202.19@tcp:35:bash.0 00000100:00100000:1.0:1790773217.047344:0:14187:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:110130ab-04fa-4d7c-984e-562032df4432+21:12169:x1877761484464640:12345-192.168.202.19@tcp:35:bash.0 Request processed in 349us (2571us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1790773217.047523:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 36 00000100:00100000:0.0:1790773217.047781:0:6463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445c8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6463:1877761496063232:192.168.202.19@tcp:105: 00010000:00010000:0.0:1790773217.047803:0:6463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790773217.047846:0:6463:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:110130ab-04fa-4d7c-984e-562032df4432+6:2397:x1877761484464384:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 12109us (14187us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773217.047854:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 81 00010000:00010000:2.0:1790773217.103104:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773217.223110:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773217.224984:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484464896 00000100:00100000:3.0:1790773217.225008:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484464896 00000100:00100000:3.0:1790773217.225407:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 157 00000100:00100000:3.0:1790773217.225421:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144443100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+21:12179:x1877761484464896:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:3.0:1790773217.225508:0:8697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773217.225538:0:8697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc78423d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bdbc expref: -99 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790773217.225706:0:8697:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1790773217.225859:0:8697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc78423d8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdbc expref: 23 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773217.225876:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d26ede0b00) 00010000:00010000:3.0:1790773217.225880:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790773217.225886:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc78423d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdbc expref: 23 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773217.225910:0:8697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d1434ac200, rc 0) 00000100:00100000:3.0:1790773217.226055:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144443100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+22:12179:x1877761484464896:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 636us (2960us total) trans 4294967421 rc 301/301 00000100:00100000:3.0:1790773217.226065:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 157 00000100:00100000:3.0:1790773217.231399:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773217.231886:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484465152 00000100:00100000:1.0:1790773217.231900:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484465152 00000100:00100000:1.0:1790773217.231975:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 37 00000100:00100000:1.0:1790773217.231985:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:110130ab-04fa-4d7c-984e-562032df4432+22:12179:x1877761484465152:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:1.0:1790773217.232831:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:110130ab-04fa-4d7c-984e-562032df4432+23:12179:x1877761484465152:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 841us (1438us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1790773217.232845:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 37 00000100:00100000:0.0:1790773217.404906:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773217.405103:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484465280 00000100:00100000:2.0:1790773217.405119:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484465280 00000100:00100000:2.0:1790773217.405255:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 158 00000100:00100000:2.0:1790773217.405269:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+23:12185:x1877761484465280:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1790773217.405312:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773217.405345:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc78423e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bdc3 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773217.405440:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc78423ed lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773217.406020:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc78423ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773217.406040:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc78423ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790773217.406116:0:6479:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1790773217.406120:0:6479:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790773217.406174:0:6479:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc78423ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773217.406357:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc78423e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdc3 expref: 25 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773217.406384:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc78423ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdc3 expref: 24 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773217.406395:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93d26ede0c00) 00010000:00010000:2.0:1790773217.406399:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790773217.406404:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26efc4800, rc 0) 00000100:00100000:2.0:1790773217.407779:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+24:12185:x1877761484465280:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 2499us (2874us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773217.407794:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 158 00000100:00100000:0.0:1790773217.423070:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773217.423445:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484465536 00000100:00100000:1.0:1790773217.423468:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484465536 00000100:00100000:1.0:1790773217.423733:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 159 00000100:00100000:1.0:1790773217.423745:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+24:12185:x1877761484465536:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1790773217.423776:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773217.423805:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc78423f4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bdca expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773217.423971:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc78423fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773217.423988:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc78423fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773217.424023:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc78423fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790773217.424038:0:6478:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1790773217.424373:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc78423f4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdca expref: 27 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773217.424396:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc78423fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdca expref: 26 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773217.424407:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d26ede0100) 00010000:00010000:1.0:1790773217.424410:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790773217.424414:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12b200, rc 0) 00000100:00100000:1.0:1790773217.424577:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+26:12185:x1877761484465536:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 833us (1521us total) trans 4294967423 rc 0/0 00000100:00100000:1.0:1790773217.424587:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 159 00000100:00100000:1.0:1790773217.433945:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773217.434005:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773217.434095:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484465792 00000100:00100000:0.0:1790773217.434109:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484465792 00000100:00100000:0.0:1790773217.434196:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 160 00000100:00100000:0.0:1790773217.434230:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+26:12185:x1877761484465792:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:0.0:1790773217.434264:0:8697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773217.434294:0:8697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc7842409 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bdd1 expref: -99 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.434435:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc7842410 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.434472:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc7842410 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.434486:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc7842410 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790773217.434805:0:8697:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1790773217.434948:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc7842409 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdd1 expref: 29 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.434969:0:8697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc7842410 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdd1 expref: 28 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.435002:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d26ede0100) 00010000:00010000:0.0:1790773217.435006:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1790773217.435010:0:8697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074a800, rc 0) 00000100:00100000:0.0:1790773217.435102:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+28:12185:x1877761484465792:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 895us (1095us total) trans 4294967424 rc 0/0 00000100:00100000:0.0:1790773217.435111:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 160 00000100:00100000:3.0:1790773217.435858:0:8410:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484465920 00000100:00100000:3.0:1790773217.435869:0:8410:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484465920 00000100:00100000:3.0:1790773217.435940:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00100000:3.0:1790773217.435951:0:8410:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144440380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:110130ab-04fa-4d7c-984e-562032df4432+28:2400:x1877761484465920:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790773217.435967:0:8410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773217.435989:0:8410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc78423fb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdca expref: 28 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773217.436006:0:8410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d26ede0100) 00010000:00010000:3.0:1790773217.436010:0:8410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790773217.436053:0:8410:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144440380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:110130ab-04fa-4d7c-984e-562032df4432+27:2400:x1877761484465920:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 104us (2123us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773217.436061:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00100000:1.0:1790773217.452310:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773217.452422:0:8394:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484466048 00000100:00100000:0.0:1790773217.452437:0:8394:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484466048 00000100:00100000:0.0:1790773217.452538:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 57 00000100:00100000:0.0:1790773217.452550:0:8394:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1434b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:110130ab-04fa-4d7c-984e-562032df4432+6:2399:x1877761484466048:12345-192.168.202.19@tcp:1:lfs.0 00010000:00010000:0.0:1790773217.452619:0:8394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c2206ad/0xabf1cc0bc784241e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.452647:0:8394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000bccd597/0xabf1cc0bc78423d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdb5 expref: 6 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.452657:0:8394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1790773217.452662:0:8394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790773217.452668:0:8394:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c2206ad/0xabf1cc0bc784241e lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.452714:0:8394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000bccd597/0xabf1cc0bc78423d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdb5 expref: 6 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.452731:0:8394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000bccd597/0xabf1cc0bc78423d1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdb5 expref: 6 pid: 8907 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773217.452772:0:8394:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8394:1877761496063360:192.168.202.19@tcp:104: 00000100:00100000:0.0:1790773217.452884:0:8394:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d141fd2300 going to sleep for 11 seconds 00000100:00100000:0.0:1790773217.463333:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773217.463857:0:8399:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484466176 00000100:00100000:2.0:1790773217.463872:0:8399:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484466176 00002000:00100000:2.0:1790773217.463940:0:8399:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff93d1445cad80 x1877761484466176/t0(0) o4->110130ab-04fa-4d7c-984e-562032df4432@192.168.202.19@tcp:53/0 lens 504/0 e 0 to 0 dl 1790773228 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790773217.463954:0:8399:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93d1445cad80 with x1877761484466176 ext(0->12) 00010000:00010000:2.0:1790773217.463967:0:8399:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000bccd597/0xabf1cc0bc78423d1 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdb5 expref: 7 pid: 8907 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773217.463990:0:8399:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000bccd597/0xabf1cc0bc78423d1 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdb5 expref: 7 pid: 8907 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790773217.464000:0:8399:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93d1445cad80 00000100:00100000:2.0:1790773217.464045:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 2 00000100:00100000:2.0:1790773217.464090:0:8399:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:110130ab-04fa-4d7c-984e-562032df4432+7:2397:x1877761484466176:12345-192.168.202.19@tcp:4:lfs.0 00000100:00100000:2.0:1790773217.466064:0:8399:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:110130ab-04fa-4d7c-984e-562032df4432+9:2397:x1877761484466176:12345-192.168.202.19@tcp:4:lfs.0 Request processed in 1974us (2733us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1790773217.466095:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 2 00002000:00100000:2.0:1790773217.466113:0:8399:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff93d1445cad80 x1877761484466176/t4294967306(0) o4->110130ab-04fa-4d7c-984e-562032df4432@192.168.202.19@tcp:53/0 lens 504/448 e 0 to 0 dl 1790773228 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790773217.466125:0:8399:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93d1445cad80 with x1877761484466176 ext(0->12) 00010000:00010000:2.0:1790773217.466138:0:8399:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000bccd597/0xabf1cc0bc78423d1 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdb5 expref: 9 pid: 8907 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773217.466367:0:8394:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8394:1877761496063360:192.168.202.19@tcp:104: 00010000:00010000:3.0:1790773217.466400:0:8394:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007c2206ad/0xabf1cc0bc784241e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773217.469070:0:8399:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000bccd597/0xabf1cc0bc78423d1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdb5 expref: 9 pid: 8907 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790773217.469352:0:8399:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93d1445cad80 00000100:00100000:1.0:1790773217.473110:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773217.473629:0:6464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484466304 00000100:00100000:0.0:1790773217.473645:0:6464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484466304 00010000:00010000:0.0:1790773217.473710:0:6464:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000bccd597/0xabf1cc0bc78423d1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdb5 expref: 9 pid: 8907 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773217.473770:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 82 00000100:00100000:0.0:1790773217.473781:0:6464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1434bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:110130ab-04fa-4d7c-984e-562032df4432+9:2397:x1877761484466304:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790773217.473802:0:6464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1790773217.473829:0:6464:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1790773217.473832:0:6464:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1790773217 00002000:00010000:0.0:1790773217.473835:0:6464:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1790773217 00002000:00010000:0.0:1790773217.473838:0:6464:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1790773217 00002000:00010000:0.0:1790773217.473910:0:6464:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1790773217.473919:0:6464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000bccd597/0xabf1cc0bc78423d1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdb5 expref: 9 pid: 8907 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.473938:0:6464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000bccd597/0xabf1cc0bc78423d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdb5 expref: 9 pid: 8907 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.473974:0:6464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bccd597/0xabf1cc0bc78423d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdb5 expref: 9 pid: 8907 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.474025:0:6464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790773217.474031:0:6464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790773217.474039:0:6464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007c2206ad/0xabf1cc0bc784241e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.474052:0:6464:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c2206ad/0xabf1cc0bc784241e lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.474397:0:6464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790773217.474624:0:6464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1434bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:110130ab-04fa-4d7c-984e-562032df4432+8:2397:x1877761484466304:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 842us (1527us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773217.474635:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 82 00010000:00010000:3.0:1790773217.477832:0:8394:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007c2206ad/0xabf1cc0bc784241e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773217.477933:0:8394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c2206ad/0xabf1cc0bc784241e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773217.478016:0:8394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c2206ad/0xabf1cc0bc784241e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773217.478027:0:8394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c2206ad/0xabf1cc0bc784241e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773217.478039:0:8394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c2206ad/0xabf1cc0bc784241e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773217.478048:0:8394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074bc00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:3.0:1790773217.478054:0:8394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c2206ad/0xabf1cc0bc784241e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773217.478064:0:8394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c2206ad/0xabf1cc0bc784241e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773217.478091:0:8394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c2206ad/0xabf1cc0bc784241e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773217.478100:0:8394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c2206ad/0xabf1cc0bc784241e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773217.478532:0:8394:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1434b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:110130ab-04fa-4d7c-984e-562032df4432+7:2399:x1877761484466048:12345-192.168.202.19@tcp:1:lfs.0 Request processed in 25975us (26229us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773217.478545:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 57 00000100:00100000:1.0:1790773217.491544:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773217.498622:0:6482:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484466560 00000100:00100000:2.0:1790773217.498639:0:6482:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484466560 00000100:00100000:2.0:1790773217.498711:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 38 00000100:00100000:2.0:1790773217.498722:0:6482:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d279dbb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+27:12185:x1877761484466560:12345-192.168.202.19@tcp:35:lfs.0 00000004:00010000:2.0:1790773217.498797:0:6482:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc7842410 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdd1 expref: 27 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790773217.499415:0:6482:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:2.0:1790773217.499501:0:6482:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1790773217.499815:0:6482:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:2.0:1790773217.500992:0:6482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7842425 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773217.501017:0:6482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc78423bc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bda7 expref: 31 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773217.501027:0:6482:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7842425 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773217.501083:0:6482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc78423bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bda7 expref: 31 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773217.501101:0:6482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc78423bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bda7 expref: 31 pid: 6478 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773217.501118:0:6482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14453d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6482:1877761496063488:192.168.202.19@tcp:104: 00000100:00100000:2.0:1790773217.502030:0:6482:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279e96480 going to sleep for 11 seconds 00000100:00100000:2.0:1790773217.512669:0:6482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14453d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6482:1877761496063488:192.168.202.19@tcp:104: 00010000:00010000:2.0:1790773217.512705:0:6482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7842425 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773217.524424:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773217.524643:0:6463:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484466688 00000100:00100000:0.0:1790773217.524655:0:6463:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484466688 00010000:00010000:0.0:1790773217.524696:0:6463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc78423bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bda7 expref: 32 pid: 6478 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773217.524736:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 83 00000100:00100000:0.0:1790773217.524746:0:6463:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2412ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:110130ab-04fa-4d7c-984e-562032df4432+32:2397:x1877761484466688:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790773217.524762:0:6463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773217.524770:0:6463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc78423bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bda7 expref: 32 pid: 6478 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.524783:0:6463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc78423bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bda7 expref: 32 pid: 6478 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.524827:0:6463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc78423bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bda7 expref: 32 pid: 6478 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.524857:0:6463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d26ede0100) 00010000:00010000:0.0:1790773217.524862:0:6463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7842425 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.524872:0:6463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7842425 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.524880:0:6463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7842425 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.524916:0:6463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790773217.524985:0:6463:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2412ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:110130ab-04fa-4d7c-984e-562032df4432+31:2397:x1877761484466688:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 241us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773217.524992:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 83 00010000:00010000:2.0:1790773217.525172:0:6482:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7842425 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773217.525319:0:6482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7842425 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790773217.525438:0:6482:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:2.0:1790773217.525583:0:6482:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:2.0:1790773217.525686:0:6482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14453d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6482:1877761496063616:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1790773217.525738:0:6482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773217.525768:0:6482:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279e96a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790773217.525863:0:7666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496063616 00000100:00100000:0.0:1790773217.525869:0:7666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496063616 00000100:00100000:0.0:1790773217.525905:0:7666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1790773217.525912:0:7666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14453dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6482:x1877761496063616:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790773217.525995:0:7666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14453dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6482:x1877761496063616:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 83us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773217.526001:0:7666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1790773217.526418:0:6482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14453d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6482:1877761496063616:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1790773217.526532:0:6482:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:0.0:1790773217.526569:0:6482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445c8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6482:1877761496063744:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790773217.526607:0:6482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773217.526625:0:6482:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d141fd2780 going to sleep for 11 seconds 00000100:00100000:0.0:1790773217.526640:0:12789:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496063744 00000100:00100000:0.0:1790773217.526644:0:12789:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496063744 00000100:00100000:0.0:1790773217.526668:0:12789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1790773217.526675:0:12789:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:6482:x1877761496063744:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790773217.526768:0:12789:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:6482:x1877761496063744:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 93us (159us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1790773217.526775:0:12789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1790773217.526807:0:6482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445c8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6482:1877761496063744:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1790773217.529167:0:6482:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:0.0:1790773217.529263:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7842425 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.529276:0:6482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7842425 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.529284:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7842425 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.529291:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc5000 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773217.529295:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7842425 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.529303:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7842425 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.529319:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d26ede0100) 00010000:00010000:0.0:1790773217.529322:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1790773217.529341:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7842425 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.529348:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7842425 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790773217.529486:0:6482:0:(mdd_object.c:4189:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1790773217.529560:0:6482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:0.0:1790773217.529572:0:6482:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 360331366584ns, next at 361331364444ns, rc = 0 00000001:00080000:0.0:1790773217.529578:0:6482:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:0.0:1790773217.529603:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d26ede0100) 00010000:00010000:0.0:1790773217.529606:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1790773217.529627:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc7842410 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdd1 expref: 35 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773217.529756:0:6482:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d279dbb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+34:12185:x1877761484466560:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 31035us (38222us total) trans 4294967433 rc 0/0 00000100:00100000:0.0:1790773217.529768:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 38 00000020:00080000:0.0:1790773217.529773:0:6482:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1790773217.542436:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773217.542557:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484466816 00000100:00100000:2.0:1790773217.542568:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484466816 00000100:00100000:2.0:1790773217.542637:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 161 00000100:00100000:2.0:1790773217.542648:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2412af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+34:12185:x1877761484466816:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1790773217.542674:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773217.542698:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc784242c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bdd8 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773217.542759:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc784242c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdd8 expref: 35 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773217.542774:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc784242c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdd8 expref: 35 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773217.542792:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d28095b400) 00010000:00010000:2.0:1790773217.542796:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790773217.542799:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26efc5600, rc 0) 00000100:00100000:2.0:1790773217.542862:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2412af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+35:12185:x1877761484466816:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 216us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773217.542870:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 161 00000100:00100000:1.0:1790773217.548899:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773217.548985:0:14187:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484467072 00000100:00100000:3.0:1790773217.548995:0:14187:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484467072 00000100:00100000:3.0:1790773217.549050:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 39 00000100:00100000:3.0:1790773217.549072:0:14187:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2412ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:110130ab-04fa-4d7c-984e-562032df4432+35:12185:x1877761484467072:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:3.0:1790773217.549633:0:14187:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2412ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:110130ab-04fa-4d7c-984e-562032df4432+36:12185:x1877761484467072:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 561us (742us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1790773217.549641:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 39 00000100:00100000:1.0:1790773217.702309:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773217.702465:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484467328 00000100:00100000:0.0:1790773217.702477:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484467328 00000100:00100000:0.0:1790773217.702543:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 162 00000100:00100000:0.0:1790773217.702552:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2412ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+36:12195:x1877761484467328:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:0.0:1790773217.702587:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773217.702607:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc7842433 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bddf expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790773217.702719:0:6478:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1790773217.702818:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc7842433 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bddf expref: 38 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.702861:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d26ede0b00) 00010000:00010000:0.0:1790773217.702864:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790773217.702870:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc7842433 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bddf expref: 38 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.702883:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074a800, rc 0) 00000100:00100000:0.0:1790773217.702947:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2412ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+37:12195:x1877761484467328:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 397us (647us total) trans 4294967435 rc 301/301 00000100:00100000:0.0:1790773217.702955:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 162 00000100:00100000:1.0:1790773217.706640:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773217.706723:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484467456 00000100:00100000:0.0:1790773217.706732:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484467456 00000100:00100000:0.0:1790773217.706791:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 163 00000100:00100000:0.0:1790773217.706810:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144499f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+37:12195:x1877761484467456:12345-192.168.202.19@tcp:34:lfs.0 00010000:00010000:0.0:1790773217.706896:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7842441 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.706914:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7842441 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.706926:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7842441 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.706938:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7842448 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.706945:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7842448 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.706969:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7842448 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.707037:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc784244f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.707046:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc784244f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.707053:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc784244f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790773217.707098:0:8697:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc784244f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.707111:0:8697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7842441 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.707118:0:8697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7842441 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.707138:0:8697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7842441 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.707145:0:8697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074ae00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773217.707156:0:8697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7842441 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.707165:0:8697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7842441 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.707177:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93d26ede0c00) 00010000:00010000:0.0:1790773217.707186:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773217.707191:0:8697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7842441 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.707197:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7842441 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.707239:0:8697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7842448 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.707245:0:8697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7842448 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.707251:0:8697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7842448 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.707257:0:8697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074b000 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773217.707260:0:8697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7842448 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.707266:0:8697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7842448 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.707274:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93d26ede0f00) 00010000:00010000:0.0:1790773217.707276:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773217.707279:0:8697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7842448 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.707284:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7842448 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.707294:0:8697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc784244f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.707307:0:8697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc784244f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.707312:0:8697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc784244f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.707317:0:8697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074bc00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773217.707319:0:8697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc784244f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.707324:0:8697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc784244f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.707332:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d28095b400) 00010000:00010000:0.0:1790773217.707334:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773217.707337:0:8697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc784244f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773217.707343:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc784244f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773217.707417:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144499f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+37:12195:x1877761484467456:12345-192.168.202.19@tcp:34:lfs.0 Request processed in 617us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773217.707425:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 163 00000100:00100000:3.0:1790773217.709821:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773217.710317:0:6482:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484467712 00000100:00100000:0.0:1790773217.710330:0:6482:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484467712 00000100:00100000:0.0:1790773217.710393:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 40 00000100:00100000:0.0:1790773217.710403:0:6482:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+37:12195:x1877761484467712:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:0.0:1790773217.710663:0:6482:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+38:12195:x1877761484467712:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 260us (855us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1790773217.710685:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 40 00000100:00100000:1.0:1790773217.757600:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773217.757782:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484467968 00000100:00100000:3.0:1790773217.757797:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484467968 00000100:00100000:3.0:1790773217.757884:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 164 00000100:00100000:3.0:1790773217.757897:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144499180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+38:12198:x1877761484467968:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:3.0:1790773217.757932:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773217.757957:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc7842456 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bde6 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773217.758056:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc784245d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773217.758075:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc784245d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773217.758088:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc784245d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773217.758100:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc7842464 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773217.758107:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc7842464 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773217.758114:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc7842464 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773217.758440:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc784246b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773217.758451:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc784246b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773217.758466:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc784246b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790773217.758479:0:6480:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1790773217.758649:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc784245d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773217.758658:0:6480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc784245d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773217.758665:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc784245d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773217.758672:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ad200 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773217.758677:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc784245d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773217.758685:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc784245d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773217.758700:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93d26ede0c00) 00010000:00010000:3.0:1790773217.758703:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790773217.758710:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc784245d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773217.758729:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc784245d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773217.758752:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc7842464 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773217.758759:0:6480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc7842464 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773217.758765:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc7842464 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773217.758770:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ade00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773217.758774:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc7842464 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773217.758779:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc7842464 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773217.758787:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93d26ede0f00) 00010000:00010000:3.0:1790773217.758790:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790773217.758792:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc7842464 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773217.758798:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc7842464 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773217.758845:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc7842456 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bde6 expref: 41 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773217.758862:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc784246b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bde6 expref: 40 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773217.758876:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d28095b400) 00010000:00010000:3.0:1790773217.758878:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790773217.758881:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d1434ad400, rc 0) 00000100:00100000:3.0:1790773217.759044:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144499180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+40:12198:x1877761484467968:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 1149us (1459us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1790773217.759053:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 164 00000100:00100000:2.0:1790773217.765101:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773217.765311:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484468096 00000100:00100000:1.0:1790773217.765326:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484468096 00000100:00100000:1.0:1790773217.765404:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 165 00000100:00100000:1.0:1790773217.765416:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14453d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+40:12198:x1877761484468096:12345-192.168.202.19@tcp:54:lfs.0 00010000:00010000:1.0:1790773217.765647:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7842479 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773217.765673:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7842479 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773217.765688:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7842479 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773217.765734:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7842479 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773217.765744:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7842479 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773217.765754:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7842479 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773217.765761:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12a400 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773217.765767:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7842479 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773217.765775:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7842479 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773217.765790:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d28095b400) 00010000:00010000:1.0:1790773217.765794:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790773217.765819:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7842479 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773217.765827:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7842479 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773217.765981:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14453d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+40:12198:x1877761484468096:12345-192.168.202.19@tcp:54:lfs.0 Request processed in 567us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773217.765991:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 165 00000100:00100000:1.0:1790773217.769126:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773217.769318:0:14187:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484468352 00000100:00100000:3.0:1790773217.769331:0:14187:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484468352 00000100:00100000:3.0:1790773217.769448:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 41 00000100:00100000:3.0:1790773217.769490:0:14187:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144499c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:110130ab-04fa-4d7c-984e-562032df4432+40:12198:x1877761484468352:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:3.0:1790773217.769817:0:14187:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144499c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:110130ab-04fa-4d7c-984e-562032df4432+41:12198:x1877761484468352:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 356us (704us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1790773217.769826:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 41 00010000:00010000:3.0:1790773218.126548:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773218.256088:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773218.256242:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484468608 00000100:00100000:2.0:1790773218.256257:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484468608 00000100:00100000:2.0:1790773218.256351:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 166 00000100:00100000:2.0:1790773218.256389:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+41:12230:x1877761484468608:12345-192.168.202.19@tcp:101:cat.0 00010000:00010000:2.0:1790773218.256427:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773218.256474:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc7842480 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bded expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773218.256713:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc7842487 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773218.256733:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc7842487 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773218.256750:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc7842487 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790773218.256764:0:6479:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1790773218.256908:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc7842480 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bded expref: 44 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773218.256934:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc7842487 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bded expref: 43 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773218.256945:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d28095b400) 00010000:00010000:2.0:1790773218.256948:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790773218.256952:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26efc5c00, rc 0) 00000100:00100000:2.0:1790773218.258741:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+43:12230:x1877761484468608:12345-192.168.202.19@tcp:101:cat.0 Request processed in 2343us (2654us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1790773218.258756:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 166 00000100:00080000:3.0:1790773218.259515:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790773218.275257:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773218.275486:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773218.275634:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484468864 00000100:00100000:1.0:1790773218.275650:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484468864 00000100:00100000:1.0:1790773218.275726:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 42 00000100:00100000:1.0:1790773218.275740:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14453ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:110130ab-04fa-4d7c-984e-562032df4432+43:12230:x1877761484468864:12345-192.168.202.19@tcp:35:cat.0 00000100:00100000:3.0:1790773218.275953:0:6465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484468992 00000100:00100000:3.0:1790773218.275959:0:6465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484468992 00000100:00100000:3.0:1790773218.276006:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 13 00000100:00100000:3.0:1790773218.276014:0:6465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d252ea4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:110130ab-04fa-4d7c-984e-562032df4432+45:2398:x1877761484468992:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790773218.276028:0:6465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773218.276058:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc7842487 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bded expref: 45 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773218.276065:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14453ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:110130ab-04fa-4d7c-984e-562032df4432+45:12230:x1877761484468864:12345-192.168.202.19@tcp:35:cat.0 Request processed in 329us (3872us total) trans 4294967440 rc 0/0 00000100:00100000:1.0:1790773218.276073:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 42 00010000:00010000:3.0:1790773218.276089:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d28095b400) 00010000:00010000:3.0:1790773218.276096:0:6465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790773218.276126:0:6465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d252ea4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:110130ab-04fa-4d7c-984e-562032df4432+43:2398:x1877761484468992:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 113us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773218.276133:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 13 00000100:00100000:0.0:1790773218.362380:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773218.362438:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773218.362501:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773218.362535:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773218.362558:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773218.362574:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773218.362601:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773218.362632:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484469376 00000100:00100000:0.0:1790773218.362646:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484469376 00000100:00100000:1.0:1790773218.362693:0:8392:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484469632 00000100:00100000:1.0:1790773218.362698:0:8392:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484469632 00000100:00100000:0.0:1790773218.362715:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484469888 00000100:00100000:0.0:1790773218.362717:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484469888 00000100:00100000:1.0:1790773218.362731:0:8392:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484469504 00000100:00100000:0.0:1790773218.362731:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484469248 00000100:00100000:1.0:1790773218.362733:0:8392:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484469504 00000100:00100000:0.0:1790773218.362733:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484469248 00000100:00100000:0.0:1790773218.362745:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484469760 00000100:00100000:0.0:1790773218.362747:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484469760 00000100:00100000:1.0:1790773218.362758:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 118 00000100:00100000:0.0:1790773218.362762:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 310 00000100:00100000:1.0:1790773218.362768:0:8392:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:110130ab-04fa-4d7c-984e-562032df4432+6:2400:x1877761484469632:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1790773218.362768:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+5:2400:x1877761484469376:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1790773218.362867:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484469120 00000100:00100000:2.0:1790773218.362872:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484469120 00000100:00100000:2.0:1790773218.362910:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 389 00000100:00100000:2.0:1790773218.362917:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26be9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:2400:x1877761484469120:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1790773218.362985:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+5:2400:x1877761484469376:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 216us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773218.362993:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 310 00000100:00100000:0.0:1790773218.363015:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 311 00000100:00100000:0.0:1790773218.363021:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2400:x1877761484469888:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1790773218.363092:0:8393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 119 00000100:00100000:3.0:1790773218.363102:0:8393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144443800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:110130ab-04fa-4d7c-984e-562032df4432+7:2400:x1877761484469504:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773218.368083:0:8392:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:110130ab-04fa-4d7c-984e-562032df4432+6:2400:x1877761484469632:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 5294us (5559us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773218.368103:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 118 00000100:00100000:1.0:1790773218.368673:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 312 00000100:00100000:1.0:1790773218.368694:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+43:2400:x1877761484469248:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1790773218.368801:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26be9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:2400:x1877761484469120:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 5881us (6432us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773218.368884:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 389 00000100:00100000:1.0:1790773218.369270:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+43:2400:x1877761484469248:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 585us (6708us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773218.369279:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 312 00000100:00100000:1.0:1790773218.369304:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 313 00000100:00100000:1.0:1790773218.369312:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144442a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2400:x1877761484469760:12345-192.168.202.19@tcp:400:kworker.0 00000100:00080000:2.0:1790773218.369619:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790773218.369680:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790773218.369686:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790773218.371486:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2400:x1877761484469888:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 8449us (8935us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773218.371525:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 311 00000100:00100000:1.0:1790773218.371610:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144442a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2400:x1877761484469760:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 2295us (9004us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773218.371621:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 313 00000100:00100000:3.0:1790773218.374041:0:8393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144443800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:110130ab-04fa-4d7c-984e-562032df4432+7:2400:x1877761484469504:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 10923us (11447us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773218.374060:0:8393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 119 00000100:00100000:2.0:1790773218.402102:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773218.402343:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484470144 00000100:00100000:0.0:1790773218.402357:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484470144 00000100:00100000:0.0:1790773218.402435:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 167 00000100:00100000:0.0:1790773218.402448:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14453df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+43:12236:x1877761484470144:12345-192.168.202.19@tcp:101:dd.0 00010000:00010000:0.0:1790773218.402496:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773218.402501:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790773218.402540:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc78423ed lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdc3 expref: 43 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.402565:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93d26ede0c00) 00010000:00010000:0.0:1790773218.402572:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790773218.402590:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc7842495 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bdf4 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.402732:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc784249c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.402747:0:6479:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc784246b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bde6 expref: 43 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.402757:0:6479:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc784249c lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.402796:0:6479:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc784246b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bde6 expref: 43 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.402812:0:6479:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc784246b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bde6 expref: 43 pid: 6480 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773218.402847:0:6479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144440380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1877761496063872:192.168.202.19@tcp:104: 00000100:00100000:0.0:1790773218.402973:0:6479:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d141fd2000 going to sleep for 11 seconds 00000100:00100000:2.0:1790773218.405877:0:6479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144440380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1877761496063872:192.168.202.19@tcp:104: 00010000:00010000:2.0:1790773218.405917:0:6479:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc784249c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773218.406879:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773218.406967:0:6464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484470272 00000100:00100000:0.0:1790773218.406977:0:6464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484470272 00010000:00010000:0.0:1790773218.407025:0:6464:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc784246b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bde6 expref: 44 pid: 6480 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773218.407090:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 84 00000100:00100000:0.0:1790773218.407102:0:6464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14453c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:110130ab-04fa-4d7c-984e-562032df4432+44:2398:x1877761484470272:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790773218.407119:0:6464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773218.407126:0:6464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc784246b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bde6 expref: 44 pid: 6480 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.407139:0:6464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc784246b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bde6 expref: 44 pid: 6480 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.407169:0:6464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc784246b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bde6 expref: 44 pid: 6480 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.407195:0:6464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d28095b400) 00010000:00010000:0.0:1790773218.407200:0:6464:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc784249c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.407741:0:6464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc784249c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.407774:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc784249c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.407814:0:6464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790773218.407886:0:6464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14453c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:110130ab-04fa-4d7c-984e-562032df4432+43:2398:x1877761484470272:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 784us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773218.407896:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 84 00010000:00010000:2.0:1790773218.407974:0:6479:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc784249c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773218.407983:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc784249c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790773218.408006:0:6479:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1790773218.408181:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc7842495 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdf4 expref: 44 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773218.408201:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc784249c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdf4 expref: 43 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773218.408262:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d28095b400) 00010000:00010000:2.0:1790773218.408265:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790773218.408267:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074a800, rc 0) 00000100:00100000:2.0:1790773218.408298:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14453df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+43:12236:x1877761484470144:12345-192.168.202.19@tcp:101:dd.0 Request processed in 5853us (6210us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1790773218.408306:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 167 00000100:00100000:0.0:1790773218.410999:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773218.411103:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484470400 00000100:00100000:2.0:1790773218.411116:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484470400 00000100:00100000:2.0:1790773218.411200:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 168 00000100:00100000:2.0:1790773218.411257:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144442d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+43:12236:x1877761484470400:12345-192.168.202.19@tcp:101:dd.0 00010000:00010000:2.0:1790773218.411293:0:8697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773218.411321:0:8697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4600/0xabf1cc0bc78424aa lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bdfb expref: -99 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773218.411371:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc78424b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773218.411389:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc78424b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773218.411402:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc78424b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773218.411781:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4600/0xabf1cc0bc78424aa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdfb expref: 45 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773218.411804:0:8697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc78424b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdfb expref: 44 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773218.411823:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d28095b400) 00010000:00010000:2.0:1790773218.411827:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790773218.411831:0:8697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26efc5800, rc 0) 00000100:00100000:2.0:1790773218.411915:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144442d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+44:12236:x1877761484470400:12345-192.168.202.19@tcp:101:dd.0 Request processed in 661us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773218.411924:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 168 00000100:00100000:1.0:1790773218.425673:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773218.425876:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484470656 00000100:00100000:0.0:1790773218.425887:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484470656 00000100:00100000:0.0:1790773218.425962:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 169 00000100:00100000:0.0:1790773218.425973:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143d9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+44:12236:x1877761484470656:12345-192.168.202.19@tcp:36:dd.0 00010000:00010000:0.0:1790773218.427927:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc78424b8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.427955:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc78424b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.427966:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc78424b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790773218.428033:0:6478:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:0.0:1790773218.428052:0:6478:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000006b7728af reply state 00000000298f4c5d transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc78424b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.428061:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc78424b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.428077:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d28095b400) 00010000:00010000:0.0:1790773218.428093:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790773218.428098:0:6478:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790773218.428261:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143d9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+47:12236:x1877761484470656:12345-192.168.202.19@tcp:36:dd.0 Request processed in 2284us (2597us total) trans 4294967443 rc 0/0 00000100:00100000:0.0:1790773218.428272:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 169 00000020:00080000:0.0:1790773218.428280:0:6478:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1790773218.637623:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14453d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496064000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790773218.637732:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773218.638076:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144440380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496064128:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790773218.638119:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773218.638175:0:8397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496064000 00000100:00100000:0.0:1790773218.638185:0:8397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496064000 00000100:00100000:0.0:1790773218.638304:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1790773218.638315:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14453f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496064000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790773218.638360:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1790773218.638414:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14453f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496064000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773218.638422:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1790773218.638461:0:7666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496064128 00000100:00100000:0.0:1790773218.638465:0:7666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496064128 00000100:00100000:0.0:1790773218.638505:0:7666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1790773218.638512:0:7666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496064128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790773218.638547:0:7666:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1790773218.638587:0:7666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496064128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773218.638593:0:7666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1790773218.638640:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144440380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496064128:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790773218.639045:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790773218.639058:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143d9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496064256:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790773218.639099:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773218.639134:0:12789:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496064256 00000100:00100000:1.0:1790773218.639139:0:12789:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496064256 00000100:00100000:1.0:1790773218.639186:0:12789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1790773218.639194:0:12789:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143d9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496064256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790773218.639270:0:12789:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1790773218.639311:0:12789:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143d9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496064256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 118us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773218.639318:0:12789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1790773218.639359:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143d9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496064256:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1790773218.639784:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790773218.639826:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14453d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496064000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790773218.642310:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3604:1877761496064768:0@lo:400:kworker.0 00000100:00100000:3.0:1790773218.642407:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773218.642447:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3604:1877761496065280:0@lo:400:kworker.0 00000100:00100000:3.0:1790773218.642482:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773218.642500:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce0675b4-b0c5-48e7-b182-565e22fed04c:3605:1877761496064384:0@lo:400:kworker.0 00000100:00100000:3.0:1790773218.642527:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877761496064640:0@lo:400:kworker.0 00000100:00100000:2.0:1790773218.642974:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496064768 00000100:00100000:2.0:1790773218.642985:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496064768 00000100:00100000:2.0:1790773218.643061:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496065280 00000100:00100000:2.0:1790773218.643065:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496065280 00000100:00100000:2.0:1790773218.643091:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1790773218.643102:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d243ee2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3604:x1877761496064768:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1790773218.645318:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790773218.645366:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1790773218.645392:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d243ee1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3604:x1877761496065280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773218.645816:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773218.645891:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496065152:0@lo:400:kworker.0 00000100:00100000:3.0:1790773218.645967:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773218.646007:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143d9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496065664:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790773218.646038:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773218.646068:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1790773218.646077:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3607:1877761496064512:0@lo:400:kworker.0 00000100:00100000:3.0:1790773218.646127:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773218.646144:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496065024:0@lo:400:kworker.0 00000100:00100000:0.0:1790773218.647464:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773218.647634:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773218.647696:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2412ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496065536:0@lo:400:kworker.0 00000100:00100000:3.0:1790773218.647753:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773218.647813:0:11145:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496065664 00000100:00100000:3.0:1790773218.647823:0:11145:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496065664 00000100:00100000:3.0:1790773218.647895:0:11145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1790773218.647905:0:11145:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d243ee3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496065664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790773218.647938:0:11145:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1790773218.647991:0:11145:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d243ee3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496065664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (1951us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773218.647999:0:11145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:3.0:1790773218.648027:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790773218.648050:0:8907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496065152 00000100:00100000:3.0:1790773218.648054:0:8907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496065152 00000100:00100000:3.0:1790773218.648084:0:8907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496065024 00000100:00100000:3.0:1790773218.648086:0:8907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496065024 00000100:00100000:3.0:1790773218.648103:0:8907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496065536 00000100:00100000:3.0:1790773218.648105:0:8907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496065536 00000100:00100000:3.0:1790773218.648116:0:8907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1790773218.648122:0:8907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d243ee1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3607:x1877761496065152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773218.650613:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496064640 00000100:00100000:3.0:1790773218.650621:0:8907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d243ee1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3607:x1877761496065152:12345-0@lo:400:kworker.0 Request processed in 2487us (4643us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773218.650629:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496064640 00000100:00100000:3.0:1790773218.650635:0:8907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1790773218.650673:0:8907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1790773218.650679:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496064512 00000100:00100000:2.0:1790773218.650682:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496064512 00000100:00100000:3.0:1790773218.650683:0:8907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144537100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496065024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773218.650696:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1790773218.650703:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d243ee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877761496064640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773218.651676:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1790773218.651697:0:8392:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144534000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496065536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773218.656129:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496064384 00000100:00100000:0.0:1790773218.656159:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496064384 00000100:00100000:0.0:1790773218.656578:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:0.0:1790773218.656590:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3605:x1877761496064384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773218.656689:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3605:x1877761496064384:12345-0@lo:400:kworker.0 Request processed in 102us (9249us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773218.656697:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:0.0:1790773218.656927:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce0675b4-b0c5-48e7-b182-565e22fed04c:3605:1877761496064384:0@lo:400:kworker.0 00000100:00100000:0.0:1790773218.656943:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3605:1877761496064896:0@lo:400:kworker.0 00000100:00100000:0.0:1790773218.656986:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773218.657002:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1434bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3605:1877761496065408:0@lo:400:kworker.0 00000100:00100000:0.0:1790773218.657024:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773218.657071:0:6478:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:0.0:1790773218.657081:0:6478:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_005' 00000100:00100000:0.0:1790773218.657950:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496064896 00000100:00100000:0.0:1790773218.657962:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496064896 00000100:00100000:0.0:1790773218.658014:0:6478:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:0.0:1790773218.658021:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496065408 00000100:00100000:0.0:1790773218.658023:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496065408 00000100:00100000:0.0:1790773218.658037:0:6478:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:0.0:1790773218.658045:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1790773218.658055:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144534380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1877761496064512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773218.658127:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144534380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1877761496064512:12345-0@lo:400:kworker.0 Request processed in 73us (11999us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773218.658134:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1790773218.658162:0:6478:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:0.0:1790773218.658191:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1790773218.658197:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144440380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3605:x1877761496064896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773218.658552:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144440380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3605:x1877761496064896:12345-0@lo:400:kworker.0 Request processed in 354us (1566us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773218.658559:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00010000:00080000:0.0:1790773218.658604:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1444c5c00 x1877761496064896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773218.658619:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3605:1877761496064896:0@lo:400:kworker.0 00000100:00100000:0.0:1790773218.658641:0:6478:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:0.0:1790773218.658646:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1790773218.658652:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3605:x1877761496065408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773218.658683:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3605:x1877761496065408:12345-0@lo:400:kworker.0 Request processed in 31us (1658us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773218.658689:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00010000:00080000:0.0:1790773218.658709:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1434bb800 x1877761496065408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773218.658719:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1434bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3605:1877761496065408:0@lo:400:kworker.0 00000100:00100000:3.0:1790773218.658840:0:8907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144537100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496065024:12345-0@lo:400:kworker.0 Request processed in 8157us (11203us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773218.658852:0:8907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:3.0:1790773218.658884:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790773218.658891:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790773218.658933:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3607:1877761496064512:0@lo:400:kworker.0 00000100:00100000:3.0:1790773218.658948:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496065024:0@lo:400:kworker.0 00000100:00100000:3.0:1790773218.658974:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143d9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496065664:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790773218.658991:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496065152:0@lo:400:kworker.0 00000100:00100000:3.0:1790773218.659091:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d243ee2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3604:x1877761496064768:12345-0@lo:400:kworker.0 Request processed in 15990us (16684us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773218.659099:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1790773218.659134:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3604:1877761496064768:0@lo:400:kworker.0 00000100:00100000:3.0:1790773218.659654:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d243ee1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3604:x1877761496065280:12345-0@lo:400:kworker.0 Request processed in 14274us (17168us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773218.659664:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1790773218.659704:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3604:1877761496065280:0@lo:400:kworker.0 00000100:00100000:2.0:1790773218.661588:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d243ee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877761496064640:12345-0@lo:400:kworker.0 Request processed in 10874us (15762us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773218.661605:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1790773218.661677:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877761496064640:0@lo:400:kworker.0 00000100:00100000:1.0:1790773218.663049:0:8392:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144534000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496065536:12345-0@lo:400:kworker.0 Request processed in 11351us (15284us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773218.663065:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1790773218.663257:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2412ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496065536:0@lo:400:kworker.0 00000100:00100000:3.0:1790773218.793834:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773218.794868:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484470784 00000100:00100000:0.0:1790773218.794886:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484470784 00000100:00100000:0.0:1790773218.794976:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 170 00000100:00100000:0.0:1790773218.794989:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144535180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+47:12250:x1877761484470784:12345-192.168.202.19@tcp:101:stat.0 00010000:00010000:0.0:1790773218.795025:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773218.795053:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc78424bf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6be02 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.795185:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc78424c6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.795695:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc78424c6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.795717:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc78424c6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773218.795841:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4600/0xabf1cc0bc78424cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773218.795853:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4600/0xabf1cc0bc78424cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773218.795861:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4600/0xabf1cc0bc78424cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773218.795981:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc78424d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773218.795996:0:6478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc784249c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdf4 expref: 48 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773218.796005:0:6478:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc78424d4 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773218.796056:0:6478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc784249c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdf4 expref: 48 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773218.796075:0:6478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc784249c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdf4 expref: 48 pid: 6479 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773218.796094:0:6478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14453d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1877761496065792:192.168.202.19@tcp:104: 00000100:00100000:2.0:1790773218.796282:0:6478:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279e96600 going to sleep for 11 seconds 00000100:00100000:3.0:1790773218.801997:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773218.802111:0:14187:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484471040 00000100:00100000:1.0:1790773218.802123:0:14187:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484471040 00000100:00100000:1.0:1790773218.802193:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 43 00000100:00100000:1.0:1790773218.802231:0:14187:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144535c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:110130ab-04fa-4d7c-984e-562032df4432+49:6167:x1877761484471040:12345-192.168.202.19@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1790773218.802848:0:14187:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144535c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:110130ab-04fa-4d7c-984e-562032df4432+50:6167:x1877761484471040:12345-192.168.202.19@tcp:35:ldlm_bl.0 Request processed in 644us (867us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1790773218.802858:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 43 00000100:00100000:2.0:1790773218.804325:0:6478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14453d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1877761496065792:192.168.202.19@tcp:104: 00010000:00010000:2.0:1790773218.804374:0:6478:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc78424d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773218.808957:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773218.809055:0:8410:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484471168 00000100:00100000:3.0:1790773218.809069:0:8410:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484471168 00010000:00010000:3.0:1790773218.809116:0:8410:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc784249c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdf4 expref: 50 pid: 6479 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773218.809176:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 85 00000100:00100000:3.0:1790773218.809185:0:8410:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143d9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:110130ab-04fa-4d7c-984e-562032df4432+50:2398:x1877761484471168:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790773218.809275:0:8410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773218.809284:0:8410:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc784249c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdf4 expref: 50 pid: 6479 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773218.809301:0:8410:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc784249c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdf4 expref: 50 pid: 6479 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773218.809329:0:8410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc784249c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdf4 expref: 50 pid: 6479 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773218.809347:0:8410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d28095b400) 00010000:00010000:3.0:1790773218.809353:0:8410:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc78424d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773218.809584:0:8410:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc78424d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773218.809594:0:8410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc78424d4 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773218.809636:0:8410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790773218.809718:0:8410:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143d9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:110130ab-04fa-4d7c-984e-562032df4432+49:2398:x1877761484471168:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 531us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773218.809727:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 85 00010000:00010000:2.0:1790773218.810034:0:6478:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc78424d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773218.810045:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc78424d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790773218.810114:0:6478:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1790773218.810118:0:6478:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790773218.810144:0:6478:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc78424d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773218.810169:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc78424d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773218.810181:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc78424c6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773218.810189:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc78424c6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773218.810196:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc78424c6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773218.810625:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074bc00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:2.0:1790773218.810633:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc78424c6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773218.810643:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc78424c6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773218.810657:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93d26ede0c00) 00010000:00010000:2.0:1790773218.810676:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790773218.810682:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc78424c6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773218.810689:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc78424c6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773218.810706:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4600/0xabf1cc0bc78424cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773218.810712:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4600/0xabf1cc0bc78424cd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773218.810718:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4600/0xabf1cc0bc78424cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773218.810723:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc4600 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:2.0:1790773218.810726:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4600/0xabf1cc0bc78424cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773218.810731:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4600/0xabf1cc0bc78424cd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773218.810739:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93d26ede0f00) 00010000:00010000:2.0:1790773218.810742:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790773218.810744:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4600/0xabf1cc0bc78424cd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773218.810749:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4600/0xabf1cc0bc78424cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773218.810792:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc78424bf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be02 expref: 49 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773218.810822:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc78424d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be02 expref: 48 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773218.810830:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d28095b400) 00010000:00010000:2.0:1790773218.810833:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790773218.810835:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26efc4c00, rc 0) 00000100:00100000:2.0:1790773218.810894:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144535180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+48:12250:x1877761484470784:12345-192.168.202.19@tcp:101:stat.0 Request processed in 15908us (17078us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773218.810904:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 170 00000100:00100000:1.0:1790773218.931292:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773218.931763:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484471424 00000100:00100000:3.0:1790773218.931779:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484471424 00000100:00100000:3.0:1790773218.931855:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 171 00000100:00100000:3.0:1790773218.931866:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143d9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+48:12256:x1877761484471424:12345-192.168.202.19@tcp:36:truncate.0 00010000:00010000:3.0:1790773218.931970:0:8697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773218.932008:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc78424d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be02 expref: 48 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773218.932032:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d28095b400) 00010000:00010000:3.0:1790773218.932037:0:8697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790773218.932434:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc78424db lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773218.932462:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc78424db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773218.932475:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc78424db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790773218.944973:0:8697:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:2.0:1790773218.945151:0:8697:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005bd4d3f5 reply state 00000000f1c18341 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc78424db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773218.945181:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc78424db lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773218.945193:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d28095b400) 00010000:00010000:2.0:1790773218.945196:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790773218.945201:0:8697:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790773218.945394:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143d9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+50:12256:x1877761484471424:12345-192.168.202.19@tcp:36:truncate.0 Request processed in 13523us (14110us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1790773218.945406:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 171 00000020:00080000:2.0:1790773218.945414:0:8697:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000001:00080000:3.0:1790773218.958955:0:6457:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967446 is committed 00000004:00080000:3.0:1790773218.959012:0:6457:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00010000:00010000:0.0:1790773218.959176:0:3590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784236f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.959192:0:3590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784236f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.959201:0:3590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784236f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.959243:0:3590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074b400 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773218.959249:0:3590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784236f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.959259:0:3590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784236f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.959280:0:3590:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff93d26ede0e00) 00010000:00010000:0.0:1790773218.959283:0:3590:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773218.959289:0:3590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784236f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.959295:0:3590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784236f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.959349:0:3590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842376 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.959355:0:3590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842376 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.959360:0:3590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842376 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.959366:0:3590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074b200 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773218.959368:0:3590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842376 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.959374:0:3590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842376 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.959382:0:3590:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93d26ede0c00) 00010000:00010000:0.0:1790773218.959384:0:3590:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773218.959387:0:3590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842376 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.959393:0:3590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842376 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.959409:0:3590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78423b5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.959416:0:3590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78423b5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.959422:0:3590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78423b5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.959433:0:3590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074be00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773218.959436:0:3590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78423b5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.959442:0:3590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78423b5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.959461:0:3590:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93d26ede0f00) 00010000:00010000:0.0:1790773218.959464:0:3590:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773218.959467:0:3590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78423b5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.959474:0:3590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78423b5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.959502:0:3590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc78424b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.959508:0:3590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc78424b8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.959514:0:3590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc78424b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.959519:0:3590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074ae00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773218.959521:0:3590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc78424b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.959527:0:3590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc78424b8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.959547:0:3590:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d28095b400) 00010000:00010000:0.0:1790773218.959549:0:3590:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773218.959553:0:3590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc78424b8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.959558:0:3590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc78424b8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.959570:0:3590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc78424db lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.959576:0:3590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc78424db lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.959592:0:3590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc78424db lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.959598:0:3590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ac200 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773218.959601:0:3590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc78424db lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.959608:0:3590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc78424db lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.959616:0:3590:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d28095b400) 00010000:00010000:0.0:1790773218.959618:0:3590:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773218.959621:0:3590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc78424db lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.959626:0:3590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc78424db lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773218.973407:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790773218.973453:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143d9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496065920:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1790773218.973593:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773218.973673:0:8907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496065920 00000100:00100000:0.0:1790773218.973683:0:8907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496065920 00000100:00100000:0.0:1790773218.973750:0:8907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790773218.973759:0:8907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3605:x1877761496065920:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1790773218.973797:0:8907:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00002000:00010000:0.0:1790773218.973846:0:8907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6abd07e1, atime: 0x6abd07e1, ctime: 0x6abd07e1, blocks: 0x8 00010000:00010000:0.0:1790773218.973856:0:8907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bccd597/0xabf1cc0bc78424e2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.973890:0:8907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=361s v=(0 0) 00010000:00010000:0.0:1790773218.973895:0:8907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790773218.973903:0:8907:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bccd597/0xabf1cc0bc78424e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.973923:0:8907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000bccd597/0xabf1cc0bc78424e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.973935:0:8907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bccd597/0xabf1cc0bc78424e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.973945:0:8907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000bccd597/0xabf1cc0bc78424e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.973996:0:8907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790773218.974253:0:8907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3605:x1877761496065920:12345-0@lo:6:osp-syn-0-0.0 Request processed in 478us (653us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1790773218.974263:0:8907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00010000:0.0:1790773218.974300:0:8409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790773218.974308:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000bccd597/0xabf1cc0bc78424e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.974318:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074b000 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:0.0:1790773218.974324:0:8409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000bccd597/0xabf1cc0bc78424e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.974335:0:8409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000bccd597/0xabf1cc0bc78424e2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.974356:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000bccd597/0xabf1cc0bc78424e2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.974365:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bccd597/0xabf1cc0bc78424e2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773218.974391:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773218.974393:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773218.974396:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1790773218.974435:0:3605:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93d143d9ca80/2, rc 0, transno 4294967308 00000100:00100000:0.0:1790773218.974443:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143d9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496065920:0@lo:6:osp-syn-0-0.0 00000020:00080000:3.0:1790773218.975814:0:6457:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93d141fd2c00 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1790773218.975826:0:6457:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93d27c08f300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93d141fd26c0 00000020:00080000:3.0:1790773218.975830:0:6457:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93d27c08fe00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93d144506200 00000020:00080000:1.0:1790773218.976021:0:6510:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1790773218.976103:0:6510:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:1.0:1790773219.150057:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773219.187628:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773219.188534:0:14584:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484471552 00000100:00100000:0.0:1790773219.188551:0:14584:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484471552 00000100:00100000:0.0:1790773219.188647:0:14584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 172 00000100:00100000:0.0:1790773219.188660:0:14584:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144535880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:110130ab-04fa-4d7c-984e-562032df4432+16:12270:x1877761484471552:12345-192.168.202.19@tcp:101:stat.0 00010000:00010000:0.0:1790773219.188695:0:14584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773219.188723:0:14584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc78424e9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6be09 expref: -99 pid: 14584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773219.188806:0:14584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc78424f0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773219.188822:0:14584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc78424f0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773219.188834:0:14584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc78424f0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773219.188850:0:14584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78424f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773219.188856:0:14584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78424f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773219.188862:0:14584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78424f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773219.188954:0:14584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc78424fe lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773219.188962:0:14584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc78424fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773219.188993:0:14584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc78424fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790773219.189047:0:14584:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1790773219.189052:0:14584:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790773219.189076:0:14584:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc78424fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773219.189089:0:14584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc78424fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773219.189099:0:14584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc78424f0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773219.189106:0:14584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc78424f0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773219.189113:0:14584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc78424f0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773219.189119:0:14584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074ae00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773219.189125:0:14584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc78424f0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773219.189134:0:14584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc78424f0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773219.189147:0:14584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93d26ede0c00) 00010000:00010000:0.0:1790773219.189151:0:14584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773219.189157:0:14584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc78424f0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773219.189175:0:14584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc78424f0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773219.189191:0:14584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78424f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773219.189198:0:14584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78424f7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773219.189286:0:14584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78424f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773219.189293:0:14584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074be00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773219.189296:0:14584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78424f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773219.189303:0:14584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78424f7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773219.189312:0:14584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93d26ede0100) 00010000:00010000:0.0:1790773219.189315:0:14584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773219.189319:0:14584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78424f7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773219.189328:0:14584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78424f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773219.189369:0:14584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc78424e9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be09 expref: 18 pid: 14584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773219.189395:0:14584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc78424fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be09 expref: 17 pid: 14584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773219.189403:0:14584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d28095b400) 00010000:00010000:0.0:1790773219.189405:0:14584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790773219.189408:0:14584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074b200, rc 0) 00000100:00100000:1.0:1790773219.189778:0:14584:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144535880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:110130ab-04fa-4d7c-984e-562032df4432+17:12270:x1877761484471552:12345-192.168.202.19@tcp:101:stat.0 Request processed in 1119us (2163us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773219.189788:0:14584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 172 00000100:00100000:0.0:1790773219.290937:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773219.291045:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484471808 00000100:00100000:3.0:1790773219.291059:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484471808 00000100:00100000:3.0:1790773219.291186:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 173 00000100:00100000:3.0:1790773219.291200:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+17:12280:x1877761484471808:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:3.0:1790773219.291278:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773219.291306:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc7842505 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6be10 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790773219.291478:0:6479:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1790773219.291800:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc7842505 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be10 expref: 19 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773219.291818:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d26ede0b00) 00010000:00010000:3.0:1790773219.291822:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790773219.291827:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc7842505 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be10 expref: 19 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773219.291851:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d1434ade00, rc 0) 00000100:00100000:3.0:1790773219.291995:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+18:12280:x1877761484471808:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 798us (1071us total) trans 4294967447 rc 301/301 00000100:00100000:3.0:1790773219.292004:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 173 00000100:00100000:2.0:1790773219.297101:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773219.297191:0:6482:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484472064 00000100:00100000:0.0:1790773219.297489:0:6482:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484472064 00000100:00100000:0.0:1790773219.297558:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 44 00000100:00100000:0.0:1790773219.297570:0:6482:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d279db8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+18:12280:x1877761484472064:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:0.0:1790773219.297934:0:6482:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d279db8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+19:12280:x1877761484472064:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 364us (847us total) trans 4294967448 rc 0/0 00000100:00100000:0.0:1790773219.297944:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 44 00000100:00100000:1.0:1790773219.350373:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773219.350719:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484472320 00000100:00100000:3.0:1790773219.350734:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484472320 00000100:00100000:3.0:1790773219.350816:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 174 00000100:00100000:3.0:1790773219.350828:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143d9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+19:12286:x1877761484472320:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:3.0:1790773219.350862:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773219.350901:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc7842513 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6be17 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773219.351058:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc784251a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773219.351076:0:13768:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc78424fe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be09 expref: 20 pid: 14584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773219.351111:0:13768:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc784251a lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773219.351167:0:13768:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc78424fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be09 expref: 20 pid: 14584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773219.351185:0:13768:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc78424fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be09 expref: 20 pid: 14584 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773219.351202:0:13768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144536a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13768:1877761496066048:192.168.202.19@tcp:104: 00000100:00100000:3.0:1790773219.351349:0:13768:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26c742300 going to sleep for 11 seconds 00000100:00100000:3.0:1790773219.354437:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773219.354997:0:10300:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484472448 00000100:00100000:2.0:1790773219.355012:0:10300:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484472448 00010000:00010000:2.0:1790773219.355069:0:10300:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc78424fe lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be09 expref: 21 pid: 14584 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773219.355159:0:10300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 86 00000100:00100000:2.0:1790773219.355171:0:10300:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144535f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:110130ab-04fa-4d7c-984e-562032df4432+21:2398:x1877761484472448:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790773219.355192:0:10300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790773219.355201:0:10300:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc78424fe lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be09 expref: 21 pid: 14584 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.355427:0:10300:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc78424fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be09 expref: 21 pid: 14584 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.355473:0:10300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d28095b400) 00010000:00010000:2.0:1790773219.355614:0:10300:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc784251a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.355628:0:10300:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc784251a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.355638:0:10300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc784251a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.355665:0:10300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790773219.355787:0:10300:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144535f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:110130ab-04fa-4d7c-984e-562032df4432+21:2398:x1877761484472448:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 616us (1366us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773219.355797:0:10300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 86 00010000:00010000:1.0:1790773219.356315:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc78424fe lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be09 expref: 20 pid: 14584 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773219.356338:0:13768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144536a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13768:1877761496066048:192.168.202.19@tcp:104: 00010000:00010000:1.0:1790773219.356383:0:13768:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc784251a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773219.356394:0:13768:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc784251a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773219.356401:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc784251a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790773219.356428:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1790773219.356829:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc7842513 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be17 expref: 21 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773219.356853:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc784251a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be17 expref: 20 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773219.356861:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d28095b400) 00010000:00010000:1.0:1790773219.356864:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790773219.356867:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d1434ade00, rc 0) 00000100:00100000:1.0:1790773219.356921:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143d9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+20:12286:x1877761484472320:12345-192.168.202.19@tcp:101:bash.0 Request processed in 6095us (6565us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1790773219.356931:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 174 00000100:00100000:1.0:1790773219.372959:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773219.373063:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484472704 00000100:00100000:2.0:1790773219.373074:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484472704 00000100:00100000:2.0:1790773219.373134:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 175 00000100:00100000:2.0:1790773219.373154:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143d9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+20:12286:x1877761484472704:12345-192.168.202.19@tcp:36:bash.0 00010000:00010000:2.0:1790773219.373594:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc7842528 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.373612:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc7842528 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.373624:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc7842528 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790773219.373671:0:6480:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:2.0:1790773219.373695:0:6480:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000090005513 reply state 00000000244f0419 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc7842528 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.373708:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc7842528 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.373716:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d28095b400) 00010000:00010000:2.0:1790773219.373718:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790773219.373722:0:6480:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790773219.373817:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143d9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+23:12286:x1877761484472704:12345-192.168.202.19@tcp:36:bash.0 Request processed in 673us (868us total) trans 4294967451 rc 0/0 00000100:00100000:2.0:1790773219.373824:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 175 00000020:00080000:2.0:1790773219.373830:0:6480:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1790773219.378568:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773219.378749:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484472832 00000100:00100000:2.0:1790773219.378760:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484472832 00000100:00100000:2.0:1790773219.378825:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 176 00000100:00100000:2.0:1790773219.378834:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+23:12286:x1877761484472832:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:2.0:1790773219.378860:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773219.378880:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc784252f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6be1e expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.378992:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc7842536 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.379007:0:6478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc784251a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be17 expref: 24 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.379016:0:6478:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc7842536 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.379052:0:6478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc784251a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be17 expref: 24 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.379066:0:6478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc784251a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be17 expref: 24 pid: 13768 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773219.379080:0:6478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14453d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1877761496066176:192.168.202.19@tcp:104: 00000100:00100000:2.0:1790773219.379379:0:6478:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279e96cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790773219.382327:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773219.382599:0:6464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484472960 00000100:00100000:0.0:1790773219.382608:0:6464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484472960 00010000:00010000:0.0:1790773219.382645:0:6464:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc784251a lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be17 expref: 25 pid: 13768 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773219.382685:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 87 00000100:00100000:0.0:1790773219.382694:0:6464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144534700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:110130ab-04fa-4d7c-984e-562032df4432+25:2397:x1877761484472960:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790773219.382712:0:6464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773219.382718:0:6464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc784251a lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be17 expref: 25 pid: 13768 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773219.382748:0:6464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc784251a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be17 expref: 25 pid: 13768 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773219.382769:0:6464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d28095b400) 00010000:00010000:0.0:1790773219.382774:0:6464:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc7842536 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773219.382784:0:6464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc7842536 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773219.382791:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc7842536 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773219.382808:0:6464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790773219.382861:0:6464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144534700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:110130ab-04fa-4d7c-984e-562032df4432+25:2397:x1877761484472960:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 167us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773219.382867:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 87 00010000:00010000:2.0:1790773219.382962:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc784251a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be17 expref: 24 pid: 13768 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773219.382984:0:6478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14453d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1877761496066176:192.168.202.19@tcp:104: 00010000:00010000:2.0:1790773219.383003:0:6478:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc7842536 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.383011:0:6478:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc7842536 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.383026:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc7842536 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790773219.383074:0:6478:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1790773219.383079:0:6478:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790773219.383095:0:6478:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc7842536 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.383122:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc784252f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be1e expref: 24 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.383136:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc7842536 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be1e expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.383155:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d28095b400) 00010000:00010000:2.0:1790773219.383157:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790773219.383160:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26efc4200, rc 0) 00000100:00100000:2.0:1790773219.383184:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+23:12286:x1877761484472832:12345-192.168.202.19@tcp:101:bash.0 Request processed in 4352us (4627us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773219.383201:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 176 00000100:00100000:1.0:1790773219.386515:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773219.386653:0:14187:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484473216 00000100:00100000:3.0:1790773219.386664:0:14187:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484473216 00000100:00100000:3.0:1790773219.386717:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 45 00000100:00100000:3.0:1790773219.386727:0:14187:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143d9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:110130ab-04fa-4d7c-984e-562032df4432+23:12286:x1877761484473216:12345-192.168.202.19@tcp:35:bash.0 00000100:00100000:3.0:1790773219.386970:0:14187:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143d9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:110130ab-04fa-4d7c-984e-562032df4432+24:12286:x1877761484473216:12345-192.168.202.19@tcp:35:bash.0 Request processed in 244us (463us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1790773219.386978:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 45 00000100:00100000:1.0:1790773219.459743:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773219.459942:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484473472 00000100:00100000:2.0:1790773219.459952:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484473472 00000100:00100000:2.0:1790773219.460046:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 177 00000100:00100000:2.0:1790773219.460057:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+24:12296:x1877761484473472:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1790773219.460081:0:8697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773219.460102:0:8697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc784253d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6be25 expref: -99 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790773219.460296:0:8697:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1790773219.460393:0:8697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc784253d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be25 expref: 26 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.460405:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d26ede0b00) 00010000:00010000:2.0:1790773219.460407:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790773219.460411:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc784253d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be25 expref: 26 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.460420:0:8697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26efc4800, rc 0) 00000100:00100000:2.0:1790773219.460507:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+25:12296:x1877761484473472:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 451us (769us total) trans 4294967453 rc 301/301 00000100:00100000:2.0:1790773219.460513:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 177 00000100:00100000:0.0:1790773219.463561:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773219.463650:0:14584:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484473600 00000100:00100000:1.0:1790773219.463660:0:14584:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484473600 00000100:00100000:1.0:1790773219.463744:0:14584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 178 00000100:00100000:1.0:1790773219.463754:0:14584:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144499c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:110130ab-04fa-4d7c-984e-562032df4432+25:12296:x1877761484473600:12345-192.168.202.19@tcp:34:lfs.0 00010000:00010000:1.0:1790773219.463836:0:14584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc784254b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773219.463859:0:14584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc784254b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773219.463868:0:14584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc784254b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773219.463877:0:14584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc7842552 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773219.463883:0:14584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc7842552 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773219.463890:0:14584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc7842552 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773219.463966:0:14584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7842559 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773219.463976:0:14584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7842559 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773219.463984:0:14584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7842559 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790773219.464029:0:14584:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7842559 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773219.464041:0:14584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc784254b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773219.464058:0:14584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc784254b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773219.464064:0:14584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc784254b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773219.464070:0:14584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12b200 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773219.464075:0:14584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc784254b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773219.464083:0:14584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc784254b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773219.464094:0:14584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93d26ede0c00) 00010000:00010000:1.0:1790773219.464097:0:14584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790773219.464101:0:14584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc784254b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773219.464107:0:14584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc784254b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773219.464120:0:14584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc7842552 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773219.464126:0:14584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc7842552 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773219.464132:0:14584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc7842552 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773219.464137:0:14584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12ba00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773219.464146:0:14584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc7842552 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773219.464152:0:14584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc7842552 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773219.464160:0:14584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93d14363dc00) 00010000:00010000:1.0:1790773219.464163:0:14584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790773219.464166:0:14584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc7842552 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773219.464172:0:14584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc7842552 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773219.464197:0:14584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7842559 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773219.464406:0:14584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7842559 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773219.464412:0:14584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7842559 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773219.464414:0:14584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12b600 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773219.464416:0:14584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7842559 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773219.464420:0:14584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7842559 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773219.464426:0:14584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d28095b400) 00010000:00010000:1.0:1790773219.464427:0:14584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790773219.464435:0:14584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7842559 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773219.464439:0:14584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7842559 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773219.464570:0:14584:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144499c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:110130ab-04fa-4d7c-984e-562032df4432+25:12296:x1877761484473600:12345-192.168.202.19@tcp:34:lfs.0 Request processed in 815us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773219.464579:0:14584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 178 00000100:00100000:3.0:1790773219.467190:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773219.467454:0:6482:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484473856 00000100:00100000:0.0:1790773219.467464:0:6482:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484473856 00000100:00100000:0.0:1790773219.467579:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 46 00000100:00100000:0.0:1790773219.467589:0:6482:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144536300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+25:12296:x1877761484473856:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:0.0:1790773219.467795:0:6482:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144536300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+26:12296:x1877761484473856:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 206us (612us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1790773219.467803:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 46 00000100:00100000:0.0:1790773219.518785:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773219.518985:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484474112 00000100:00100000:3.0:1790773219.518995:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484474112 00000100:00100000:3.0:1790773219.519058:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 179 00000100:00100000:3.0:1790773219.519068:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1434bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+26:12299:x1877761484474112:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:3.0:1790773219.519113:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773219.519134:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7842560 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6be2c expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773219.519466:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc7842567 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773219.519482:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc7842567 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773219.519494:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc7842567 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773219.519510:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc784256e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773219.519517:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc784256e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773219.519524:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc784256e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773219.519628:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc7842575 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773219.519638:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc7842575 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773219.519644:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc7842575 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790773219.519653:0:6479:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1790773219.519746:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc7842567 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773219.519755:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc7842567 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773219.519762:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc7842567 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773219.519768:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ade00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773219.519773:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc7842567 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773219.519780:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc7842567 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773219.519792:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93d26ede0c00) 00010000:00010000:3.0:1790773219.519795:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790773219.519799:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc7842567 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773219.519804:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc7842567 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773219.519818:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc784256e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773219.519824:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc784256e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773219.519830:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc784256e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773219.519835:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ad200 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773219.519844:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc784256e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773219.520114:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc784256e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773219.520126:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93d27c346700) 00010000:00010000:3.0:1790773219.520128:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790773219.520190:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc784256e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773219.520198:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc784256e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773219.520337:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7842560 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be2c expref: 29 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773219.520352:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc7842575 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be2c expref: 28 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773219.520360:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d28095b400) 00010000:00010000:3.0:1790773219.520362:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790773219.520365:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d1434ac200, rc 0) 00000100:00100000:3.0:1790773219.520433:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1434bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+28:12299:x1877761484474112:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 1366us (1659us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1790773219.520453:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 179 00000100:00100000:1.0:1790773219.524980:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773219.525244:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484474240 00000100:00100000:3.0:1790773219.525255:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484474240 00000100:00100000:3.0:1790773219.525323:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 180 00000100:00100000:3.0:1790773219.525334:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143d9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+28:12299:x1877761484474240:12345-192.168.202.19@tcp:54:lfs.0 00010000:00010000:3.0:1790773219.525826:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc7842583 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773219.525844:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc7842583 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773219.525868:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc7842583 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773219.525905:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc7842583 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773219.525912:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc7842583 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773219.525918:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc7842583 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773219.525924:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ad400 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773219.525929:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc7842583 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773219.525937:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc7842583 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773219.525955:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d28095b400) 00010000:00010000:3.0:1790773219.525958:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790773219.525963:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc7842583 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773219.525970:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc7842583 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773219.526067:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143d9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+28:12299:x1877761484474240:12345-192.168.202.19@tcp:54:lfs.0 Request processed in 734us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773219.526076:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 180 00000100:00100000:1.0:1790773219.526614:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773219.526638:0:6465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484474368 00000100:00100000:1.0:1790773219.526644:0:6465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484474368 00000100:00100000:1.0:1790773219.526679:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 14 00000100:00100000:1.0:1790773219.526687:0:6465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143d9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:110130ab-04fa-4d7c-984e-562032df4432+28:2398:x1877761484474368:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790773219.526698:0:6465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790773219.526712:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc7842575 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be2c expref: 28 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773219.526725:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d28095b400) 00010000:00010000:1.0:1790773219.526728:0:6465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790773219.526747:0:6465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143d9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:110130ab-04fa-4d7c-984e-562032df4432+27:2398:x1877761484474368:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 62us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773219.526753:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 14 00000100:00100000:1.0:1790773219.533684:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773219.533756:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484474624 00000100:00100000:0.0:1790773219.533779:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484474624 00000100:00100000:0.0:1790773219.533828:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 47 00000100:00100000:0.0:1790773219.533835:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143d9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:110130ab-04fa-4d7c-984e-562032df4432+27:12299:x1877761484474624:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:0.0:1790773219.534114:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143d9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:110130ab-04fa-4d7c-984e-562032df4432+28:12299:x1877761484474624:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 278us (439us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1790773219.534123:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 47 00000100:00100000:0.0:1790773219.775432:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773219.775577:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484474880 00000100:00100000:2.0:1790773219.775588:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484474880 00000100:00100000:2.0:1790773219.775651:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 181 00000100:00100000:2.0:1790773219.775661:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+28:12317:x1877761484474880:12345-192.168.202.19@tcp:101:cat.0 00010000:00010000:2.0:1790773219.775685:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773219.775705:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc784258a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6be33 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.775813:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc7842591 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.775829:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc7842591 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.775861:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc7842591 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790773219.775873:0:6480:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1790773219.775978:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc784258a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be33 expref: 31 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.775998:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc7842591 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be33 expref: 30 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.776007:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d28095b400) 00010000:00010000:2.0:1790773219.776010:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1790773219.776013:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26efc5c00, rc 0) 00000100:00100000:2.0:1790773219.776090:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+30:12317:x1877761484474880:12345-192.168.202.19@tcp:101:cat.0 Request processed in 430us (670us total) trans 4294967457 rc 0/0 00000100:00100000:2.0:1790773219.776098:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 181 00000100:00100000:3.0:1790773219.843642:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773219.845259:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484475008 00000100:00100000:2.0:1790773219.845274:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484475008 00000100:00100000:2.0:1790773219.845348:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 182 00000100:00100000:2.0:1790773219.845358:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144534a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+30:12318:x1877761484475008:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1790773219.845383:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773219.845403:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc784259f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6be3a expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.845496:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc78425a6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.845530:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc78425a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.845540:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc78425a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790773219.845584:0:6478:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1790773219.845588:0:6478:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790773219.845605:0:6478:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc78425a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.845631:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc784259f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be3a expref: 32 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.845649:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc78425a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be3a expref: 31 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.845658:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93d26ede0c00) 00010000:00010000:2.0:1790773219.845661:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790773219.845665:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26efc4e00, rc 0) 00000100:00100000:2.0:1790773219.845735:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144534a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+31:12318:x1877761484475008:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 377us (2101us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773219.845741:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 182 00000100:00100000:0.0:1790773219.850816:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773219.851629:0:14187:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484475392 00000100:00100000:3.0:1790773219.851641:0:14187:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484475392 00000100:00100000:3.0:1790773219.851765:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 48 00000100:00100000:3.0:1790773219.851777:0:14187:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:110130ab-04fa-4d7c-984e-562032df4432+31:12318:x1877761484475392:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:3.0:1790773219.852080:0:14187:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:110130ab-04fa-4d7c-984e-562032df4432+32:12318:x1877761484475392:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 305us (1272us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1790773219.852088:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 48 00000100:00100000:0.0:1790773219.881110:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773219.881249:0:10300:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484475520 00000100:00100000:2.0:1790773219.881260:0:10300:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484475520 00000100:00100000:2.0:1790773219.881330:0:10300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 15 00000100:00100000:2.0:1790773219.881340:0:10300:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:110130ab-04fa-4d7c-984e-562032df4432+32:12318:x1877761484475520:12345-192.168.202.19@tcp:103:lfs.0 00010000:00010000:2.0:1790773219.881361:0:10300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1790773219.881401:0:10300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc7842536 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be1e expref: 32 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.881422:0:10300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc7842591 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be33 expref: 31 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.881433:0:10300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc784242c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdd8 expref: 30 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.881453:0:10300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d28095b400) 00010000:00010000:2.0:1790773219.881459:0:10300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790773219.881522:0:10300:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:110130ab-04fa-4d7c-984e-562032df4432+29:12318:x1877761484475520:12345-192.168.202.19@tcp:103:lfs.0 Request processed in 184us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773219.881530:0:10300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 15 00000100:00100000:2.0:1790773219.891339:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773219.891920:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484475648 00000100:00100000:3.0:1790773219.891931:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484475648 00000100:00100000:3.0:1790773219.892001:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 183 00000100:00100000:3.0:1790773219.892012:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14453d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+29:12318:x1877761484475648:12345-192.168.202.19@tcp:58:lfs.0 00010000:00010000:3.0:1790773219.892144:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc78425ad lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773219.892162:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc78425ad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773219.892174:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc78425ad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790773219.892328:0:13768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1790773219.892404:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14453d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+29:12318:x1877761484475648:12345-192.168.202.19@tcp:58:lfs.0 Request processed in 393us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773219.892427:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 183 00000100:00100000:1.0:1790773219.931044:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773219.931154:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484475776 00000100:00100000:2.0:1790773219.931164:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484475776 00000100:00100000:2.0:1790773219.931271:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 184 00000100:00100000:2.0:1790773219.931283:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143d9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+29:12320:x1877761484475776:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1790773219.931305:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773219.931328:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc78425b4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6be41 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.931401:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc78425bb lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.931417:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc78425bb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.931461:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc78425bb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.931479:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc78425c2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.931485:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc78425c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.931492:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc78425c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.931561:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc78425c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.931571:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc78425c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.931578:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc78425c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790773219.931621:0:6480:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1790773219.931625:0:6480:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790773219.931641:0:6480:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc78425c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.931653:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc78425c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.931661:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc78425bb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.931678:0:6480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc78425bb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.931685:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc78425bb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.931690:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc5c00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:2.0:1790773219.931695:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc78425bb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.931702:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc78425bb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.931713:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93d26ede0c00) 00010000:00010000:2.0:1790773219.931716:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790773219.931721:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc78425bb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.931726:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc78425bb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.931741:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc78425c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.931747:0:6480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc78425c2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.931752:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc78425c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.931757:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc4200 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:2.0:1790773219.931765:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc78425c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.931771:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc78425c2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.931778:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93d28095b300) 00010000:00010000:2.0:1790773219.931780:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790773219.931783:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc78425c2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.931789:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc78425c2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.931822:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc78425b4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be41 expref: 31 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.931835:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc78425c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be41 expref: 30 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773219.931842:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d28095b400) 00010000:00010000:2.0:1790773219.931844:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790773219.931846:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26efc4800, rc 0) 00000100:00100000:2.0:1790773219.931914:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143d9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+30:12320:x1877761484475776:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 634us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773219.931922:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 184 00000040:00080000:3.0:1790773220.109380:0:13749:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790773220.109390:0:13749:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790773220.109415:0:13749:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1790773220.109423:0:13749:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790773220.109576:0:13749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144534e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13749:1877761496066304:192.168.202.19@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790773220.109648:0:13749:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26c742480 going to sleep for 11 seconds 00000100:00100000:3.0:1790773220.119475:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773220.119512:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484475904 00000100:00100000:3.0:1790773220.119520:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484475904 00000100:00100000:3.0:1790773220.119576:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 185 00000100:00100000:3.0:1790773220.119587:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144537480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+31:12331:x1877761484475904:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790773220.119621:0:6478:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790773220.119731:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144537480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+31:12331:x1877761484475904:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 Request processed in 146us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773220.119739:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 185 00000100:00080000:3.0:1790773220.119760:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790773220.119930:0:13749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144534e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13749:1877761496066304:192.168.202.19@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790773220.126496:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773220.126571:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484476032 00000100:00100000:3.0:1790773220.126582:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484476032 00000100:00100000:3.0:1790773220.126643:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 186 00000100:00100000:3.0:1790773220.126653:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+30:12331:x1877761484476032:12345-192.168.202.19@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1790773220.126724:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc78425d0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.126745:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc78425d0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.126776:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc78425d0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.126791:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc78425d7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.126799:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc78425d7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.126804:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc78425d7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.126831:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc78425de lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.126840:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc78425de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.126846:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc78425de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790773220.126897:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1790773220.126901:0:13768:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790773220.126915:0:13768:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc78425de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.126926:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc78425d0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.126933:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc78425d0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.126950:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc78425d0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.126956:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ad400 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773220.126962:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc78425d0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.126970:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc78425d0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.126983:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93d26ede0500) 00010000:00010000:3.0:1790773220.126986:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790773220.126992:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc78425d0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.126999:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc78425d0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.127016:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc78425d7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.127023:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc78425d7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.127029:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc78425d7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.127034:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ad200 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773220.127037:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc78425d7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.127054:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc78425d7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.127061:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff93d27c346700) 00010000:00010000:3.0:1790773220.127063:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790773220.127066:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc78425d7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.127071:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc78425d7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.127087:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc78425de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.127093:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc78425de lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.127099:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc78425de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.127104:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ade00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773220.127106:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc78425de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.127112:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc78425de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.127119:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d28095b400) 00010000:00010000:3.0:1790773220.127122:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790773220.127125:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc78425de lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.127153:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc78425de lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773220.127261:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+30:12331:x1877761484476032:12345-192.168.202.19@tcp:34:lhsmtool_posix.0 Request processed in 609us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773220.127269:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 186 00000100:00100000:3.0:1790773220.129857:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773220.129928:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484476288 00000100:00100000:0.0:1790773220.129936:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484476288 00000100:00100000:0.0:1790773220.129994:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 187 00000100:00100000:0.0:1790773220.130004:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144537800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+30:12331:x1877761484476288:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790773220.130024:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773220.130042:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc78425e5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6be48 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.130157:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc78425ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.130172:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc78425ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.130191:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc78425ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790773220.130262:0:6480:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1790773220.130338:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc78425ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.130346:0:6480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc78425ec lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.130353:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc78425ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.130359:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074ae00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773220.130363:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc78425ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.130371:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc78425ec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.130383:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d28095b400) 00010000:00010000:0.0:1790773220.130386:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790773220.130390:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc78425ec lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.130395:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc78425ec lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.130433:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc78425e5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be48 expref: 32 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.130454:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93d26ede0500) 00010000:00010000:0.0:1790773220.130457:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790773220.130468:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc78425e5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be48 expref: 32 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.130837:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074b400, rc 0) 00000100:00100000:0.0:1790773220.130933:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144537800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+31:12331:x1877761484476288:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 929us (1083us total) trans 4294967459 rc 301/301 00000100:00100000:0.0:1790773220.130940:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 187 00000100:00100000:3.0:1790773220.133242:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773220.133314:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484476416 00000100:00100000:1.0:1790773220.133323:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484476416 00000100:00100000:1.0:1790773220.133373:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 188 00000100:00100000:1.0:1790773220.133396:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144536d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+31:12331:x1877761484476416:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790773220.133431:0:6478:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790773220.133862:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144536d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+31:12331:x1877761484476416:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 Request processed in 466us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773220.133870:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 188 00000100:00100000:3.0:1790773220.136353:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773220.136490:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484476672 00000100:00100000:0.0:1790773220.136501:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484476672 00000100:00100000:0.0:1790773220.136560:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 189 00000100:00100000:0.0:1790773220.136572:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144537b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+31:12331:x1877761484476672:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790773220.136593:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773220.136597:0:13768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790773220.136626:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc78425a6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be3a expref: 31 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.136645:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93d26ede0c00) 00010000:00010000:0.0:1790773220.136651:0:13768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790773220.136665:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc78425fa lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6be4f expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790773220.137062:0:13768:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:0.0:1790773220.137248:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7842601 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.137261:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7842601 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.137270:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7842601 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.137332:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc78425fa lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be4f expref: 33 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.137347:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7842601 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be4f expref: 32 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.137355:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93d26ede0f00) 00010000:00010000:0.0:1790773220.137357:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790773220.137360:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074b000, rc 0) 00000100:00100000:0.0:1790773220.137411:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144537b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+32:12331:x1877761484476672:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 841us (1065us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1790773220.137418:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 189 00000100:00100000:3.0:1790773220.143074:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773220.143158:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484476928 00000100:00100000:1.0:1790773220.143168:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484476928 00000100:00100000:1.0:1790773220.143251:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 190 00000100:00100000:1.0:1790773220.143262:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144536680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+32:12331:x1877761484476928:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790773220.143318:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790773220.143345:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7842601 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be4f expref: 32 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773220.143362:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93d26ede0f00) 00010000:00010000:1.0:1790773220.143373:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790773220.143394:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc784260f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773220.143405:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc784260f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773220.143415:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc784260f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773220.143429:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7842616 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x3dae00ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773220.143446:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7842616 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x3dae00ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773220.143466:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7842616 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x3dae00ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773220.143520:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc784260f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773220.143527:0:6480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc784260f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773220.143533:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc784260f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773220.143539:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12ba00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773220.143542:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc784260f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773220.143550:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc784260f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773220.143557:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93d26ede0c00) 00010000:00010000:1.0:1790773220.143560:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790773220.143564:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc784260f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773220.143569:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc784260f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773220.143577:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7842616 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x3dae00ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773220.143583:0:6480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7842616 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x3dae00ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773220.143594:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7842616 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x3dae00ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773220.143599:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12b600 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773220.143602:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7842616 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x3dae00ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773220.143607:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7842616 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x3dae00ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773220.143615:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x3dae00ce (ffff93d14363dc00) 00010000:00010000:1.0:1790773220.143617:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790773220.143620:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7842616 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x3dae00ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773220.143625:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7842616 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x3dae00ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773220.143693:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144536680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+31:12331:x1877761484476928:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 433us (626us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790773220.143700:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 190 00000100:00100000:0.0:1790773220.152385:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773220.152762:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484477056 00000100:00100000:2.0:1790773220.152773:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484477056 00000100:00100000:2.0:1790773220.152830:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 191 00000100:00100000:2.0:1790773220.152841:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+31:12331:x1877761484477056:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790773220.152872:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773220.152895:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc784261d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6be56 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773220.152931:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc7842624 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773220.152945:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc7842624 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773220.152957:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc7842624 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773220.153055:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc784261d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be56 expref: 33 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773220.153071:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc7842624 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be56 expref: 32 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773220.153080:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93d28095b300) 00010000:00010000:2.0:1790773220.153083:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790773220.153086:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26efc4200, rc 0) 00000100:00100000:2.0:1790773220.153151:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+32:12331:x1877761484477056:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 311us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773220.153157:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 191 00000100:00100000:2.0:1790773220.161049:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773220.161132:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484477312 00000100:00100000:0.0:1790773220.161143:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484477312 00000100:00100000:0.0:1790773220.161229:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 192 00000100:00100000:0.0:1790773220.161240:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14453e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+32:12331:x1877761484477312:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790773220.161320:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc784262b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.161337:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc784262b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.161349:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc784262b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790773220.161727:0:13768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:0.0:1790773220.161747:0:13768:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 362963541022ns, next at 363963538940ns, rc = 0 00000004:00010000:0.0:1790773220.161797:0:13768:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003a8ac0cd reply state 0000000008e80d57 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc784262b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.161810:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc784262b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.161819:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93d28095b300) 00010000:00010000:0.0:1790773220.161821:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1790773220.161824:0:13768:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790773220.161921:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14453e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+34:12331:x1877761484477312:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 683us (882us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1790773220.161929:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 192 00000100:00100000:2.0:1790773220.164303:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773220.165969:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484477440 00000100:00100000:3.0:1790773220.165982:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484477440 00000100:00100000:3.0:1790773220.166038:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 193 00000100:00100000:3.0:1790773220.166047:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14453ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+34:12331:x1877761484477440:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790773220.166071:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773220.166091:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc7842632 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6be5d expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.166160:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc7842632 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be5d expref: 35 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.166175:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc7842632 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be5d expref: 35 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.166225:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93d28095b300) 00010000:00010000:3.0:1790773220.166229:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790773220.166240:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d1434ade00, rc 0) 00000100:00100000:3.0:1790773220.166303:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14453ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+35:12331:x1877761484477440:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 257us (2007us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773220.166311:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 193 00010000:00010000:3.0:1790773220.180221:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773220.185317:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773220.185444:0:8394:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484477568 00000100:00100000:2.0:1790773220.185479:0:8394:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484477568 00000100:00100000:2.0:1790773220.185547:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 59 00000100:00100000:2.0:1790773220.185558:0:8394:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144535500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:110130ab-04fa-4d7c-984e-562032df4432+6:2397:x1877761484477568:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1790773220.185790:0:8394:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144535500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:110130ab-04fa-4d7c-984e-562032df4432+7:2397:x1877761484477568:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 Request processed in 234us (481us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1790773220.185798:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 59 00000100:00080000:3.0:1790773220.186886:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790773220.190525:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773220.191038:0:6482:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484477824 00000100:00100000:1.0:1790773220.191048:0:6482:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484477824 00000100:00100000:1.0:1790773220.191107:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 49 00000100:00100000:1.0:1790773220.191117:0:6482:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144534e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+35:12331:x1877761484477824:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790773220.191400:0:6482:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144534e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+36:12331:x1877761484477824:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 Request processed in 283us (882us total) trans 4294967462 rc 0/0 00000100:00100000:1.0:1790773220.191408:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 49 00000100:00100000:2.0:1790773220.209759:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773220.209963:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484478080 00000100:00100000:1.0:1790773220.209974:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484478080 00000100:00100000:1.0:1790773220.210039:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 194 00000100:00100000:1.0:1790773220.210049:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+36:12331:x1877761484478080:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1790773220.210185:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+36:12331:x1877761484478080:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 130us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773220.210193:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 194 00000100:00100000:3.0:1790773220.226304:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773220.226906:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484478208 00000100:00100000:0.0:1790773220.226917:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484478208 00000100:00100000:0.0:1790773220.226979:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 195 00000100:00100000:0.0:1790773220.226988:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144536a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+36:12331:x1877761484478208:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790773220.227008:0:8697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773220.227027:0:8697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7842639 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6be64 expref: -99 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.227110:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc7842640 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.227134:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc7842640 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.227148:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc7842640 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790773220.227396:0:8697:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790773220.227412:0:8697:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc7842640 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.227447:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7842639 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be64 expref: 38 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.227462:0:8697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc7842640 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be64 expref: 37 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.227471:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93d28095b300) 00010000:00010000:0.0:1790773220.227474:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1790773220.227478:0:8697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074aa00, rc 0) 00000100:00100000:0.0:1790773220.228280:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144536a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+37:12331:x1877761484478208:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 1290us (1984us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773220.228289:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 195 00000100:00100000:1.0:1790773220.235576:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773220.238375:0:8392:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484478336 00000100:00100000:3.0:1790773220.238390:0:8392:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484478336 00000100:00100000:3.0:1790773220.239294:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 60 00000100:00100000:3.0:1790773220.239307:0:8392:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143d9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:110130ab-04fa-4d7c-984e-562032df4432+7:2397:x1877761484478336:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790773220.239326:0:8392:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773220.239345:0:8392:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d73d19b3/0xabf1cc0bc7842647 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6be6b expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790773220.239372:0:8392:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abd07e4, blocks: 0x0 00010000:00010000:3.0:1790773220.239391:0:8392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=363s v=(0 0) 00010000:00010000:3.0:1790773220.239396:0:8392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773220.239406:0:8392:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d73d19b3/0xabf1cc0bc7842647 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be6b expref: 8 pid: 8392 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.239425:0:8392:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d73d19b3/0xabf1cc0bc7842647 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be6b expref: 8 pid: 8392 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.239450:0:8392:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d1434ad200, rc 0) 00000100:00100000:3.0:1790773220.239531:0:8392:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143d9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:110130ab-04fa-4d7c-984e-562032df4432+8:2397:x1877761484478336:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 226us (3966us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773220.239539:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 60 00000100:00100000:2.0:1790773220.253857:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773220.254765:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484478592 00000100:00100000:3.0:1790773220.254777:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484478592 00000100:00100000:3.0:1790773220.254852:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 196 00000100:00100000:3.0:1790773220.254863:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+37:12331:x1877761484478592:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790773220.255160:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+37:12331:x1877761484478592:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 291us (1306us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773220.255170:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 196 00000100:00100000:3.0:1790773220.259746:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773220.260002:0:8393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484478720 00000100:00100000:0.0:1790773220.260012:0:8393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484478720 00000100:00100000:0.0:1790773220.260069:0:8393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 61 00000100:00100000:0.0:1790773220.260079:0:8393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144535c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:110130ab-04fa-4d7c-984e-562032df4432+8:12331:x1877761484478720:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790773220.260098:0:8393:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773220.260118:0:8393:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083c4e23b/0xabf1cc0bc784264e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6be72 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.260168:0:8393:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d73d19b3/0xabf1cc0bc7842647 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be6b expref: 9 pid: 8392 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.260253:0:8393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790773220.260258:0:8393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790773220.260265:0:8393:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083c4e23b/0xabf1cc0bc784264e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be72 expref: 9 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.260301:0:8393:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d73d19b3/0xabf1cc0bc7842647 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be6b expref: 9 pid: 8392 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.260315:0:8393:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d73d19b3/0xabf1cc0bc7842647 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be6b expref: 9 pid: 8392 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773220.260330:0:8393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8393:1877761496066432:192.168.202.19@tcp:104: 00000100:00100000:0.0:1790773220.264368:0:8393:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d141fd2540 going to sleep for 11 seconds 00000100:00100000:0.0:1790773220.267709:0:8393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8393:1877761496066432:192.168.202.19@tcp:104: 00010000:00010000:0.0:1790773220.267745:0:8393:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000083c4e23b/0xabf1cc0bc784264e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be72 expref: 9 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.267765:0:8393:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074ae00, rc 0) 00000100:00100000:0.0:1790773220.267820:0:8393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144535c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:110130ab-04fa-4d7c-984e-562032df4432+9:12331:x1877761484478720:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 7742us (8084us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773220.267828:0:8393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 61 00000100:00100000:2.0:1790773220.275529:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773220.275647:0:8410:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484478848 00000100:00100000:3.0:1790773220.275725:0:8410:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484478848 00010000:00010000:3.0:1790773220.275768:0:8410:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d73d19b3/0xabf1cc0bc7842647 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be6b expref: 9 pid: 8392 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773220.275915:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 88 00000100:00100000:3.0:1790773220.275937:0:8410:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d255829850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:110130ab-04fa-4d7c-984e-562032df4432+9:2397:x1877761484478848:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790773220.275954:0:8410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773220.275974:0:8410:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d73d19b3/0xabf1cc0bc7842647 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be6b expref: 9 pid: 8392 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.275989:0:8410:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d73d19b3/0xabf1cc0bc7842647 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be6b expref: 9 pid: 8392 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.276013:0:8410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d73d19b3/0xabf1cc0bc7842647 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be6b expref: 9 pid: 8392 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.276109:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773220.276114:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773220.276123:0:8410:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000083c4e23b/0xabf1cc0bc784264e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be72 expref: 8 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.276142:0:8410:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083c4e23b/0xabf1cc0bc784264e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be72 expref: 8 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.276420:0:8410:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000083c4e23b/0xabf1cc0bc784264e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be72 expref: 8 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773220.276446:0:8410:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2412ad500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8410:1877761496066560:192.168.202.19@tcp:105: 00000100:00100000:3.0:1790773220.276527:0:8410:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26c742cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790773220.278772:0:8410:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2412ad500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8410:1877761496066560:192.168.202.19@tcp:105: 00010000:00010000:0.0:1790773220.278796:0:8410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790773220.279024:0:8410:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d255829850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:110130ab-04fa-4d7c-984e-562032df4432+8:2397:x1877761484478848:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 3099us (3502us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773220.279034:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 88 00000100:00100000:2.0:1790773220.283610:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773220.283828:0:8398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484478976 00000100:00100000:0.0:1790773220.283840:0:8398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484478976 00002000:00100000:0.0:1790773220.283894:0:8398:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff93d27fa97b80 x1877761484478976/t0(0) o4->110130ab-04fa-4d7c-984e-562032df4432@192.168.202.19@tcp:56/0 lens 504/0 e 0 to 0 dl 1790773231 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790773220.283905:0:8398:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93d27fa97b80 with x1877761484478976 ext(0->8) 00002000:00010000:0.0:1790773220.283911:0:8398:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93d27fa97b80 00000100:00100000:0.0:1790773220.283955:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00100000:0.0:1790773220.283965:0:8398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:110130ab-04fa-4d7c-984e-562032df4432+8:2398:x1877761484478976:12345-192.168.202.19@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1790773220.287071:0:8398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:110130ab-04fa-4d7c-984e-562032df4432+10:2398:x1877761484478976:12345-192.168.202.19@tcp:4:lhsmtool_posix.0 Request processed in 3098us (3461us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1790773220.287086:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 4 00002000:00100000:2.0:1790773220.287099:0:8398:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff93d27fa97b80 x1877761484478976/t4294967315(0) o4->110130ab-04fa-4d7c-984e-562032df4432@192.168.202.19@tcp:56/0 lens 504/448 e 0 to 0 dl 1790773231 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790773220.287109:0:8398:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93d27fa97b80 with x1877761484478976 ext(0->8) 00002000:00010000:2.0:1790773220.287115:0:8398:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93d27fa97b80 00000100:00100000:2.0:1790773220.290970:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773220.291070:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484479104 00000100:00100000:1.0:1790773220.291079:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484479104 00000100:00100000:1.0:1790773220.291128:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 197 00000100:00100000:1.0:1790773220.291138:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+37:12331:x1877761484479104:12345-192.168.202.19@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1790773220.293304:0:6457:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:2.0:1790773220.293317:0:6457:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:2.0:1790773220.293369:0:6457:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:2.0:1790773220.293528:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+21:12331:x1877761484479104:12345-192.168.202.19@tcp:44:lhsmtool_posix.0 Request processed in 2388us (2564us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773220.293537:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 197 00000100:00100000:2.0:1790773220.293568:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790773220.293584:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496066688:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1790773220.293641:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773220.293682:0:8906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496066688 00000100:00100000:2.0:1790773220.293689:0:8906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496066688 00000100:00100000:2.0:1790773220.293730:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790773220.293738:0:8906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496066688:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1790773220.293841:0:8906:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1790773220.293845:0:8906:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1790773220 00002000:00010000:2.0:1790773220.293848:0:8906:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1790773220.293850:0:8906:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1790773220 -> 1790773220 00002000:00010000:2.0:1790773220.293852:0:8906:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1790773220.294371:0:8906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3604:x1877761496066688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 632us (729us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1790773220.294379:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1790773220.294403:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:3.0:1790773220.294556:0:6510:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1790773220.294565:0:6510:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:0.0:1790773220.295286:0:3591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc7842528 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.295297:0:3591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc7842528 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.295305:0:3591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc7842528 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.295311:0:3591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc4c00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773220.295317:0:3591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc7842528 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.295325:0:3591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc7842528 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.295340:0:3591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d28095b400) 00010000:00010000:0.0:1790773220.295343:0:3591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773220.295358:0:3591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc7842528 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.295365:0:3591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc7842528 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.295384:0:3591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc784262b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.295391:0:3591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc784262b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.295397:0:3591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc784262b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.295402:0:3591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074b200 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773220.295405:0:3591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc784262b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.295410:0:3591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc784262b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.295418:0:3591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93d28095b300) 00010000:00010000:0.0:1790773220.295420:0:3591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790773220.295423:0:3591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc784262b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.295427:0:3591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc784262b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773220.295512:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773220.295654:0:8392:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484479232 00000100:00100000:0.0:1790773220.295660:0:8392:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484479232 00000100:00100000:0.0:1790773220.295705:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 63 00000100:00100000:0.0:1790773220.295719:0:8392:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2412ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:110130ab-04fa-4d7c-984e-562032df4432+10:2398:x1877761484479232:12345-192.168.202.19@tcp:16:lhsmtool_posix.0 00000004:00080000:1.0:1790773220.296058:0:3604:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93d143d9c000/2, rc 0, transno 4294967316 00000100:00100000:1.0:1790773220.296065:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496066688:0@lo:2:osp-syn-1-0.0 00000001:00080000:2.0:1790773220.298421:0:9475:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:2.0:1790773220.298442:0:9475:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:0.0:1790773220.298624:0:8392:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2412ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:110130ab-04fa-4d7c-984e-562032df4432+7:2398:x1877761484479232:12345-192.168.202.19@tcp:16:lhsmtool_posix.0 Request processed in 2900us (3108us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773220.298635:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 63 00000100:00100000:1.0:1790773220.300842:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773220.300934:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484479488 00000100:00100000:3.0:1790773220.300944:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484479488 00000100:00100000:3.0:1790773220.301002:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 198 00000100:00100000:3.0:1790773220.301012:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143d9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+19:12331:x1877761484479488:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790773220.301063:0:13768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773220.301089:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc7842640 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be64 expref: 19 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.301108:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93d28095b300) 00010000:00010000:3.0:1790773220.301123:0:13768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790773220.301164:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc7842655 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.301178:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc7842655 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.301188:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc7842655 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790773220.301345:0:13768:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000fa305cba reply state 000000008b75c3fc transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc7842655 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.301358:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc7842655 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.301364:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93d28095b300) 00010000:00010000:3.0:1790773220.301367:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790773220.301370:0:13768:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790773220.301466:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143d9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+20:12331:x1877761484479488:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 455us (634us total) trans 4294967463 rc 0/0 00000100:00100000:3.0:1790773220.301772:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 198 00000100:00100000:2.0:1790773220.304160:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773220.304314:0:8393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484479616 00000100:00100000:0.0:1790773220.304323:0:8393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484479616 00000100:00100000:0.0:1790773220.304374:0:8393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 64 00000100:00100000:0.0:1790773220.304384:0:8393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:110130ab-04fa-4d7c-984e-562032df4432+7:2398:x1877761484479616:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1790773220.304557:0:8393:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1790773220.304561:0:8393:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1790773220 -> 1790773219 00002000:00010000:0.0:1790773220.304563:0:8393:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1790773217 00002000:00010000:0.0:1790773220.304566:0:8393:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1790773220 -> 1790773219 00002000:00010000:0.0:1790773220.304567:0:8393:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1790773220.304626:0:8393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:110130ab-04fa-4d7c-984e-562032df4432+8:2398:x1877761484479616:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 Request processed in 243us (473us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1790773220.304635:0:8393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 64 00000100:00100000:1.0:1790773220.307297:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773220.307381:0:14584:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484479872 00000100:00100000:2.0:1790773220.307390:0:14584:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484479872 00000100:00100000:2.0:1790773220.307459:0:14584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 199 00000100:00100000:2.0:1790773220.307470:0:14584:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:110130ab-04fa-4d7c-984e-562032df4432+20:12331:x1877761484479872:12345-192.168.202.19@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1790773220.307538:0:14584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc784265c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773220.307556:0:14584:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc7842624 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be56 expref: 20 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773220.307566:0:14584:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc784265c lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773220.307616:0:14584:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc7842624 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be56 expref: 20 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773220.307631:0:14584:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc7842624 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be56 expref: 20 pid: 6478 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773220.307644:0:14584:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14584:1877761496066816:192.168.202.19@tcp:104: 00000100:00100000:2.0:1790773220.307730:0:14584:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279e96300 going to sleep for 11 seconds 00000100:00100000:2.0:1790773220.310998:0:14584:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14584:1877761496066816:192.168.202.19@tcp:104: 00010000:00010000:2.0:1790773220.311029:0:14584:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc784265c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773220.312777:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773220.313174:0:6463:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484480000 00000100:00100000:0.0:1790773220.313183:0:6463:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484480000 00010000:00010000:0.0:1790773220.313264:0:6463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc7842624 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be56 expref: 21 pid: 6478 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773220.313308:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 89 00000100:00100000:0.0:1790773220.313318:0:6463:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143d9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:110130ab-04fa-4d7c-984e-562032df4432+21:2398:x1877761484480000:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790773220.313334:0:6463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773220.313341:0:6463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc7842624 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be56 expref: 21 pid: 6478 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.313368:0:6463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc7842624 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be56 expref: 21 pid: 6478 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.313390:0:6463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc7842624 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be56 expref: 21 pid: 6478 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.313406:0:6463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93d28095b300) 00010000:00010000:0.0:1790773220.313410:0:6463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc784265c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.313419:0:6463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc784265c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.313426:0:6463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc784265c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.313465:0:6463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790773220.313575:0:14584:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc784265c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773220.313584:0:14584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc784265c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773220.313622:0:14584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc784265c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773220.313630:0:14584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc784265c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773220.313649:0:14584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc784265c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773220.313655:0:14584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc5200 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773220.313660:0:14584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc784265c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773220.313668:0:14584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc784265c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773220.313676:0:14584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93d28095b300) 00010000:00010000:1.0:1790773220.313679:0:14584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1790773220.313683:0:14584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc784265c lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773220.313689:0:14584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc784265c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773220.313886:0:6463:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143d9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:110130ab-04fa-4d7c-984e-562032df4432+20:2398:x1877761484480000:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 568us (1115us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773220.313894:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 89 00000100:00100000:1.0:1790773220.315243:0:14584:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:110130ab-04fa-4d7c-984e-562032df4432+19:12331:x1877761484479872:12345-192.168.202.19@tcp:55:lhsmtool_posix.0 Request processed in 7769us (7948us total) trans 0 rc -22/-22 00000100:00100000:1.0:1790773220.315255:0:14584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 199 00000100:00100000:1.0:1790773220.319277:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773220.319359:0:8907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484480128 00000100:00100000:0.0:1790773220.319370:0:8907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484480128 00000100:00100000:0.0:1790773220.319474:0:8907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 65 00000100:00100000:0.0:1790773220.319485:0:8907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143d9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:110130ab-04fa-4d7c-984e-562032df4432+8:2399:x1877761484480128:12345-192.168.202.19@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1790773220.319553:0:8907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e0a26fa4/0xabf1cc0bc7842663 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.319585:0:8907:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000083c4e23b/0xabf1cc0bc784264e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be72 expref: 8 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.319594:0:8907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790773220.319598:0:8907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790773220.319603:0:8907:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0a26fa4/0xabf1cc0bc7842663 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.319639:0:8907:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000083c4e23b/0xabf1cc0bc784264e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be72 expref: 8 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.319654:0:8907:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000083c4e23b/0xabf1cc0bc784264e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be72 expref: 8 pid: 8393 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773220.319680:0:8907:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:8907:1877761496066944:192.168.202.19@tcp:104: 00000100:00100000:0.0:1790773220.319761:0:8907:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d141fd2000 going to sleep for 11 seconds 00000100:00100000:2.0:1790773220.325353:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773220.325491:0:8907:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:8907:1877761496066944:192.168.202.19@tcp:104: 00010000:00010000:0.0:1790773220.325517:0:8907:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e0a26fa4/0xabf1cc0bc7842663 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773220.325672:0:6464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484480256 00000100:00100000:3.0:1790773220.325680:0:6464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484480256 00010000:00010000:3.0:1790773220.325714:0:6464:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000083c4e23b/0xabf1cc0bc784264e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be72 expref: 9 pid: 8393 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773220.325753:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 90 00000100:00100000:3.0:1790773220.325763:0:6464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:110130ab-04fa-4d7c-984e-562032df4432+9:2397:x1877761484480256:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790773220.325777:0:6464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773220.325811:0:6464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000083c4e23b/0xabf1cc0bc784264e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be72 expref: 9 pid: 8393 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.325825:0:6464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000083c4e23b/0xabf1cc0bc784264e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be72 expref: 9 pid: 8393 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.325847:0:6464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083c4e23b/0xabf1cc0bc784264e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be72 expref: 9 pid: 8393 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.326040:0:6464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790773220.326045:0:6464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790773220.326051:0:6464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e0a26fa4/0xabf1cc0bc7842663 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.326061:0:6464:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0a26fa4/0xabf1cc0bc7842663 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.326093:0:6464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790773220.326372:0:6464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:110130ab-04fa-4d7c-984e-562032df4432+8:2397:x1877761484480256:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 381us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773220.326382:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 90 00010000:00010000:2.0:1790773220.327738:0:8907:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e0a26fa4/0xabf1cc0bc7842663 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773220.327754:0:8907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0a26fa4/0xabf1cc0bc7842663 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773220.327783:0:8907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e0a26fa4/0xabf1cc0bc7842663 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773220.327792:0:8907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0a26fa4/0xabf1cc0bc7842663 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773220.327801:0:8907:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0a26fa4/0xabf1cc0bc7842663 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773220.327823:0:8907:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074b200 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:2.0:1790773220.327827:0:8907:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0a26fa4/0xabf1cc0bc7842663 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773220.327836:0:8907:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0a26fa4/0xabf1cc0bc7842663 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773220.327854:0:8907:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0a26fa4/0xabf1cc0bc7842663 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773220.327862:0:8907:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0a26fa4/0xabf1cc0bc7842663 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773220.328430:0:8907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143d9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:110130ab-04fa-4d7c-984e-562032df4432+7:2399:x1877761484480128:12345-192.168.202.19@tcp:1:lhsmtool_posix.0 Request processed in 8942us (9159us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773220.328480:0:8907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 65 00000100:00100000:2.0:1790773220.349493:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773220.349568:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484480512 00000100:00100000:0.0:1790773220.349578:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484480512 00000100:00100000:0.0:1790773220.349642:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 200 00000100:00100000:0.0:1790773220.349653:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144544e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+19:12331:x1877761484480512:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1790773220.349744:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784266a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.349763:0:6479:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc78424b1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdfb expref: 19 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.349773:0:6479:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784266a lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.349806:0:6479:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc78424b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdfb expref: 19 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.349820:0:6479:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc78424b1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdfb expref: 19 pid: 8697 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773220.349834:0:6479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1877761496067072:192.168.202.19@tcp:104: 00000100:00100000:0.0:1790773220.349924:0:6479:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d141fd2000 going to sleep for 11 seconds 00000100:00100000:0.0:1790773220.352087:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773220.352193:0:6479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1877761496067072:192.168.202.19@tcp:104: 00010000:00010000:1.0:1790773220.352247:0:6479:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784266a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773220.352456:0:8410:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484480640 00000100:00100000:3.0:1790773220.352463:0:8410:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484480640 00010000:00010000:3.0:1790773220.352496:0:8410:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc78424b1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdfb expref: 20 pid: 8697 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773220.352537:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 91 00000100:00100000:3.0:1790773220.352545:0:8410:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:110130ab-04fa-4d7c-984e-562032df4432+20:2400:x1877761484480640:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790773220.352571:0:8410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773220.352578:0:8410:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc78424b1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdfb expref: 20 pid: 8697 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.352591:0:8410:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc78424b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdfb expref: 20 pid: 8697 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.352611:0:8410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc78424b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bdfb expref: 20 pid: 8697 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.352627:0:8410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d28095b400) 00010000:00010000:3.0:1790773220.352632:0:8410:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784266a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.352641:0:8410:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784266a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.352648:0:8410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784266a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.352670:0:8410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790773220.352715:0:8410:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:110130ab-04fa-4d7c-984e-562032df4432+19:2400:x1877761484480640:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 169us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773220.352722:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 91 00010000:00010000:3.0:1790773220.352746:0:6479:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784266a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.352752:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784266a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.352935:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc7842671 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.352947:0:6479:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc7842632 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be5d expref: 19 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.352955:0:6479:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc7842671 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.352982:0:6479:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc7842632 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be5d expref: 19 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.352994:0:6479:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc7842632 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be5d expref: 19 pid: 6480 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773220.353006:0:6479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2412ad500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1877761496067200:192.168.202.19@tcp:104: 00000100:00100000:3.0:1790773220.353380:0:6479:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26c7420c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790773220.357648:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773220.358082:0:6463:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484480768 00000100:00100000:0.0:1790773220.358093:0:6463:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484480768 00010000:00010000:0.0:1790773220.358145:0:6463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc7842632 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be5d expref: 20 pid: 6480 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773220.358187:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 92 00000100:00100000:0.0:1790773220.358196:0:6463:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:110130ab-04fa-4d7c-984e-562032df4432+20:2400:x1877761484480768:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790773220.358241:0:6463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773220.358249:0:6463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc7842632 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be5d expref: 20 pid: 6480 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.358272:0:6463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc7842632 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be5d expref: 20 pid: 6480 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.358295:0:6463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93d28095b300) 00010000:00010000:0.0:1790773220.358300:0:6463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc7842671 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.358310:0:6463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc7842671 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.358318:0:6463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc7842671 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.358338:0:6463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790773220.358401:0:6463:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:110130ab-04fa-4d7c-984e-562032df4432+20:2400:x1877761484480768:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 206us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773220.358408:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 92 00010000:00010000:1.0:1790773220.365857:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc7842632 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be5d expref: 19 pid: 6480 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773220.365919:0:6479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2412ad500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1877761496067200:192.168.202.19@tcp:104: 00010000:00010000:1.0:1790773220.365952:0:6479:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc7842671 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773220.365961:0:6479:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc7842671 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773220.365968:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc7842671 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790773220.366791:0:6479:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:1.0:1790773220.366938:0:6479:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:1.0:1790773220.367490:0:6479:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:1.0:1790773220.367575:0:6479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143d9ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6479:1877761496067328:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1790773220.367646:0:6479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773220.367673:0:6479:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d143779000 going to sleep for 11 seconds 00000100:00100000:0.0:1790773220.367821:0:7666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496067328 00000100:00100000:0.0:1790773220.367830:0:7666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496067328 00000100:00100000:0.0:1790773220.367888:0:7666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1790773220.367906:0:7666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2412ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6479:x1877761496067328:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1790773220.368566:0:7666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2412ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6479:x1877761496067328:12345-0@lo:1000:mdt00_001.0 Request processed in 668us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773220.368574:0:7666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1790773220.368648:0:6479:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:1.0:1790773220.368653:0:6479:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93d143d9c000, transno 4294967316 00000100:00100000:1.0:1790773220.368670:0:6479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143d9ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6479:1877761496067328:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1790773220.368793:0:6479:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:1.0:1790773220.368839:0:6479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143d9ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6479:1877761496067456:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1790773220.368889:0:6479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773220.368929:0:6479:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d143779e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790773220.369028:0:12789:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496067456 00000100:00100000:2.0:1790773220.369034:0:12789:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496067456 00000100:00100000:2.0:1790773220.369082:0:12789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1790773220.369090:0:12789:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:6479:x1877761496067456:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1790773220.369281:0:12789:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:6479:x1877761496067456:12345-0@lo:1000:mdt00_001.0 Request processed in 192us (392us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1790773220.369289:0:12789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1790773220.369448:0:6479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143d9ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6479:1877761496067456:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1790773220.369485:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc7842671 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.369495:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc7842671 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.369503:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc7842671 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.369522:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ad400 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773220.369527:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc7842671 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.369536:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc7842671 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.369551:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93d28095b300) 00010000:00010000:3.0:1790773220.369554:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790773220.369559:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc7842671 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.369566:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc7842671 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.369592:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc78425ad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.369598:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc78425ad lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.369604:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc78425ad lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.369608:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ada00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773220.369611:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc78425ad lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.369617:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc78425ad lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.369635:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d28095b400) 00010000:00010000:3.0:1790773220.369638:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790773220.369641:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc78425ad lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.369647:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc78425ad lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.369668:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7842678 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.369683:0:6479:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc78425c9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be41 expref: 22 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.369691:0:6479:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7842678 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.369717:0:6479:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc78425c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be41 expref: 22 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.369730:0:6479:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc78425c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be41 expref: 22 pid: 6480 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773220.369741:0:6479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445d8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1877761496067584:192.168.202.19@tcp:104: 00000100:00100000:3.0:1790773220.369813:0:6479:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26c742b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790773220.379361:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773220.379402:0:6479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445d8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6479:1877761496067584:192.168.202.19@tcp:104: 00010000:00010000:1.0:1790773220.379455:0:6479:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7842678 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773220.379744:0:6465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484480896 00000100:00100000:0.0:1790773220.379752:0:6465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484480896 00010000:00010000:0.0:1790773220.379788:0:6465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc78425c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be41 expref: 23 pid: 6480 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773220.379845:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 93 00000100:00100000:0.0:1790773220.379856:0:6465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:110130ab-04fa-4d7c-984e-562032df4432+23:2398:x1877761484480896:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790773220.379873:0:6465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773220.379881:0:6465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc78425c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be41 expref: 23 pid: 6480 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.379894:0:6465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc78425c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be41 expref: 23 pid: 6480 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.379928:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc78425c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be41 expref: 23 pid: 6480 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.380177:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d28095b400) 00010000:00010000:0.0:1790773220.380288:0:6465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7842678 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.380300:0:6465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7842678 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.380308:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7842678 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.380340:0:6465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790773220.380463:0:6465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:110130ab-04fa-4d7c-984e-562032df4432+22:2398:x1877761484480896:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 607us (1111us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773220.380472:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 93 00010000:00010000:3.0:1790773220.380485:0:6479:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7842678 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.380505:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7842678 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.380516:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7842678 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.380524:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7842678 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.380540:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7842678 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.380546:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ad000 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773220.380551:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7842678 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.380558:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7842678 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.380568:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d28095b400) 00010000:00010000:3.0:1790773220.380571:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790773220.380575:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7842678 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.380580:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc7842678 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.380606:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784266a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.380613:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784266a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.380625:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784266a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.380630:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074b400 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773220.380633:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784266a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.380638:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784266a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.380646:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d28095b400) 00010000:00010000:3.0:1790773220.380648:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790773220.380650:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784266a lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.380656:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784266a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773220.380799:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144544e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+21:12331:x1877761484480512:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 31148us (31315us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1790773220.380809:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 200 00000020:00080000:3.0:1790773220.380812:0:6479:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1790773220.384610:0:13749:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790773220.384626:0:13749:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790773220.385141:0:13749:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1790773220.385164:0:13749:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790773220.390379:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773220.390757:0:14187:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484481152 00000100:00100000:3.0:1790773220.390768:0:14187:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484481152 00000100:00100000:3.0:1790773220.390830:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 50 00000100:00100000:3.0:1790773220.390840:0:14187:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d279db8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:110130ab-04fa-4d7c-984e-562032df4432+21:12331:x1877761484481152:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1790773220.391110:0:14187:0:(mdd_object.c:4189:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1790773220.391142:0:14187:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:3.0:1790773220.391180:0:14187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc784267f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.391197:0:14187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc784267f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.391233:0:14187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc784267f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.391245:0:14187:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc784267f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.391251:0:14187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc784267f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.391257:0:14187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc784267f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773220.391279:0:14187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790773220.391322:0:8409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790773220.391331:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc784267f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.391338:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ada00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:0.0:1790773220.391343:0:8409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc784267f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.391351:0:8409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc784267f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773220.391364:0:8409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93d28095b300) 00010000:00010000:0.0:1790773220.391368:0:8409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000100:00100000:3.0:1790773220.391373:0:14187:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d279db8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:110130ab-04fa-4d7c-984e-562032df4432+23:12331:x1877761484481152:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 Request processed in 532us (1000us total) trans 4294967470 rc 0/0 00010000:00010000:0.0:1790773220.391374:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc784267f lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14187 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773220.391388:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 50 00010000:00010000:0.0:1790773220.391388:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc784267f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14187 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1790773220.391397:0:14187:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790773220.391410:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773220.391413:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773220.391415:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790773221.131157:0:14623:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790773221.131167:0:14623:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790773221.131191:0:14623:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1790773221.131198:0:14623:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1790773221.199538:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773221.392902:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773221.392948:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484481408 00000100:00100000:3.0:1790773221.392958:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484481408 00000100:00100000:3.0:1790773221.393021:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 201 00000100:00100000:3.0:1790773221.393039:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+23:12341:x1877761484481408:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:3.0:1790773221.393069:0:8697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773221.393092:0:8697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc7842686 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6be79 expref: -99 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.393230:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc784268d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.393247:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc784268d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.393262:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc784268d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790773221.393275:0:8697:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1790773221.393384:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc7842686 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be79 expref: 26 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.393408:0:8697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc784268d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be79 expref: 25 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.393418:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93d26ede0c00) 00010000:00010000:3.0:1790773221.393433:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790773221.393437:0:8697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d1434ad000, rc 0) 00000100:00100000:3.0:1790773221.393686:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+25:12341:x1877761484481408:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 648us (797us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1790773221.393695:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 201 00000100:00100000:3.0:1790773221.418459:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773221.418513:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484481536 00000100:00100000:3.0:1790773221.418539:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484481536 00000100:00100000:3.0:1790773221.418611:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 202 00000100:00100000:3.0:1790773221.418623:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+25:12341:x1877761484481536:12345-192.168.202.19@tcp:34:lfs.0 00010000:00010000:3.0:1790773221.418713:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc784269b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.418733:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc784269b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.418745:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc784269b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.418760:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc78426a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.418768:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc78426a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.418775:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc78426a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.418852:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc78426a9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.418860:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc78426a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.418867:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc78426a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790773221.418912:0:6480:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc78426a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.418936:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc784269b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.418942:0:6480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc784269b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.418948:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc784269b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.418954:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ad400 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773221.418958:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc784269b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.418965:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc784269b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.418977:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93d26ede0c00) 00010000:00010000:3.0:1790773221.418980:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790773221.418984:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc784269b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.418989:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc784269b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.419007:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc78426a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.419013:0:6480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc78426a2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.419018:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc78426a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.419028:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ace00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773221.419031:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc78426a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.419038:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc78426a2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.419045:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93d27c346c00) 00010000:00010000:3.0:1790773221.419047:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790773221.419050:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc78426a2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.419055:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc78426a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.419069:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc78426a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.419075:0:6480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc78426a9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.419081:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc78426a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.419085:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ada00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773221.419088:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc78426a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.419093:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc78426a9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.419109:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d27c346600) 00010000:00010000:3.0:1790773221.419111:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790773221.419114:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc78426a9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.419131:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc78426a9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773221.419231:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+25:12341:x1877761484481536:12345-192.168.202.19@tcp:34:lfs.0 Request processed in 585us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773221.419239:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 202 00000100:00100000:0.0:1790773221.522653:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773221.522742:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484481792 00000100:00100000:2.0:1790773221.522751:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484481792 00000100:00100000:2.0:1790773221.522840:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 203 00000100:00100000:2.0:1790773221.522851:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+25:12344:x1877761484481792:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1790773221.522872:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773221.522892:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc78426b0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6be80 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.522962:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc78426b7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.522978:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc78426b7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.522989:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc78426b7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.523003:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc78426be lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.523010:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc78426be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.523016:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc78426be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.523113:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc78426c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.523122:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc78426c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.523140:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc78426c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790773221.523151:0:6478:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:2.0:1790773221.523242:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc78426b7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.523251:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc78426b7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.523258:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc78426b7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.523264:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc5000 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:2.0:1790773221.523269:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc78426b7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.523276:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc78426b7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.523287:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93d26ede0c00) 00010000:00010000:2.0:1790773221.523290:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790773221.523295:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc78426b7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.523301:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc78426b7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.523314:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc78426be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.523320:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc78426be lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.523332:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc78426be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.523337:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc4e00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:2.0:1790773221.523340:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc78426be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.523347:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc78426be lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.523354:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93d255badd00) 00010000:00010000:2.0:1790773221.523357:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790773221.523360:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc78426be lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.523366:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4e00/0xabf1cc0bc78426be lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.523400:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc78426b0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be80 expref: 28 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.523413:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc78426c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be80 expref: 27 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.523436:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d255bad900) 00010000:00010000:2.0:1790773221.523439:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790773221.523442:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26efc5c00, rc 0) 00000100:00100000:2.0:1790773221.523508:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+27:12344:x1877761484481792:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 659us (863us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1790773221.523523:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 203 00000100:00100000:3.0:1790773221.536486:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773221.536521:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484481920 00000100:00100000:3.0:1790773221.536530:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484481920 00000100:00100000:3.0:1790773221.536595:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 204 00000100:00100000:3.0:1790773221.536606:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+27:12344:x1877761484481920:12345-192.168.202.19@tcp:54:lfs.0 00010000:00010000:3.0:1790773221.536672:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc78426d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.536689:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc78426d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.536701:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc78426d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.536734:0:8697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc78426d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.536741:0:8697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc78426d3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.536762:0:8697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc78426d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.536768:0:8697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ada00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773221.536773:0:8697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc78426d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.536781:0:8697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc78426d3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.536793:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d255bad900) 00010000:00010000:3.0:1790773221.536796:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790773221.536802:0:8697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc78426d3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.536808:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc78426d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773221.536880:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+27:12344:x1877761484481920:12345-192.168.202.19@tcp:54:lfs.0 Request processed in 275us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773221.536887:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 204 00000100:00100000:3.0:1790773221.543998:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773221.544076:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484482176 00000100:00100000:0.0:1790773221.544086:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484482176 00000100:00100000:0.0:1790773221.544152:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 51 00000100:00100000:0.0:1790773221.544163:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:110130ab-04fa-4d7c-984e-562032df4432+27:12344:x1877761484482176:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:0.0:1790773221.544393:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:110130ab-04fa-4d7c-984e-562032df4432+28:12344:x1877761484482176:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 231us (408us total) trans 4294967473 rc 0/0 00000100:00100000:0.0:1790773221.544415:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 51 00000100:00100000:3.0:1790773221.627977:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773221.628269:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484482432 00000100:00100000:0.0:1790773221.628280:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484482432 00000100:00100000:0.0:1790773221.628340:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 205 00000100:00100000:0.0:1790773221.628352:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+28:11875:x1877761484482432:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:0.0:1790773221.628384:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773221.628407:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc78426da lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6be87 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773221.628535:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78426e1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773221.628550:0:6480:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc78426c5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be80 expref: 29 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773221.628558:0:6480:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78426e1 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773221.628594:0:6480:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc78426c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be80 expref: 29 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773221.628608:0:6480:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc78426c5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be80 expref: 29 pid: 6478 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773221.628622:0:6480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6480:1877761496067712:192.168.202.19@tcp:104: 00000100:00100000:0.0:1790773221.628708:0:6480:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d141fd2d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790773221.640048:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773221.640285:0:10300:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484482560 00000100:00100000:1.0:1790773221.640297:0:10300:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484482560 00010000:00010000:1.0:1790773221.640343:0:10300:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc78426c5 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be80 expref: 30 pid: 6478 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773221.640396:0:10300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 94 00000100:00100000:1.0:1790773221.640408:0:10300:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:110130ab-04fa-4d7c-984e-562032df4432+30:2398:x1877761484482560:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790773221.640435:0:10300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790773221.640443:0:10300:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc78426c5 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be80 expref: 30 pid: 6478 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773221.640466:0:10300:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc78426c5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be80 expref: 30 pid: 6478 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773221.640491:0:10300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d255bad900) 00010000:00010000:1.0:1790773221.640498:0:10300:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78426e1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773221.640510:0:10300:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78426e1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773221.640518:0:10300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78426e1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773221.640541:0:10300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790773221.640596:0:10300:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:110130ab-04fa-4d7c-984e-562032df4432+30:2398:x1877761484482560:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 190us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773221.640603:0:10300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 94 00010000:00010000:0.0:1790773221.642838:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc78426c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be80 expref: 29 pid: 6478 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773221.642881:0:6480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6480:1877761496067712:192.168.202.19@tcp:104: 00010000:00010000:0.0:1790773221.642904:0:6480:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78426e1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773221.642914:0:6480:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78426e1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773221.642921:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78426e1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790773221.642944:0:6480:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:0.0:1790773221.643075:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc78426da lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be87 expref: 30 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773221.643091:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78426e1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be87 expref: 29 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773221.643100:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d255bad900) 00010000:00010000:0.0:1790773221.643103:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790773221.643106:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074be00, rc 0) 00000100:00100000:0.0:1790773221.643173:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+29:11875:x1877761484482432:12345-192.168.202.19@tcp:101:bash.0 Request processed in 14824us (15205us total) trans 4294967474 rc 0/0 00000100:00100000:0.0:1790773221.643182:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 205 00000100:00100000:3.0:1790773221.646199:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773221.650371:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484482688 00000100:00100000:0.0:1790773221.650389:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484482688 00000100:00100000:0.0:1790773221.650482:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 206 00000100:00100000:0.0:1790773221.650493:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+29:11875:x1877761484482688:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:0.0:1790773221.650542:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773221.650578:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc78426ef lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6be8e expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773221.650624:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc78426f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773221.650642:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc78426f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773221.650654:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc78426f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773221.650774:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc78426ef lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be8e expref: 31 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773221.650791:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc78426f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be8e expref: 30 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773221.650800:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d255bad900) 00010000:00010000:0.0:1790773221.650803:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790773221.650807:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074bc00, rc 0) 00000100:00100000:0.0:1790773221.650887:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+30:11875:x1877761484482688:12345-192.168.202.19@tcp:101:bash.0 Request processed in 396us (4696us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773221.650894:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 206 00000100:00100000:3.0:1790773221.653478:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773221.654065:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484482944 00000100:00100000:0.0:1790773221.654076:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484482944 00000100:00100000:0.0:1790773221.654413:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 207 00000100:00100000:0.0:1790773221.654435:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+30:11875:x1877761484482944:12345-192.168.202.19@tcp:36:bash.0 00010000:00010000:0.0:1790773221.654729:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc78426fd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773221.654749:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc78426fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773221.654760:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc78426fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790773221.654802:0:13768:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:0.0:1790773221.654823:0:13768:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001d67efa4 reply state 000000007ef3097e transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc78426fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773221.654835:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc78426fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773221.654843:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d255bad900) 00010000:00010000:0.0:1790773221.654845:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790773221.654849:0:13768:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1790773221.654885:0:13768:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:0.0:1790773221.654990:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+34:11875:x1877761484482944:12345-192.168.202.19@tcp:36:bash.0 Request processed in 566us (1520us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1790773221.654999:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 207 00000020:00080000:0.0:1790773221.655004:0:13768:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1790773221.657347:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773221.670476:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484483072 00000100:00100000:2.0:1790773221.670493:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484483072 00000100:00100000:2.0:1790773221.670567:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 208 00000100:00100000:2.0:1790773221.670577:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+34:11875:x1877761484483072:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:2.0:1790773221.670601:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773221.670622:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7842704 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6be95 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.670678:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7842704 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be95 expref: 35 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.670692:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7842704 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be95 expref: 35 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.670710:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d255bad900) 00010000:00010000:2.0:1790773221.670714:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790773221.670717:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26efc5600, rc 0) 00000100:00100000:2.0:1790773221.670773:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+35:11875:x1877761484483072:12345-192.168.202.19@tcp:101:bash.0 Request processed in 198us (13433us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773221.670779:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 208 00000100:00100000:3.0:1790773221.673198:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773221.674566:0:8392:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484483200 00000100:00100000:2.0:1790773221.674581:0:8392:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484483200 00000100:00100000:2.0:1790773221.674650:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 66 00000100:00100000:2.0:1790773221.674660:0:8392:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:110130ab-04fa-4d7c-984e-562032df4432+7:11875:x1877761484483200:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:2.0:1790773221.674678:0:8392:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773221.674714:0:8392:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000adfd55ca/0xabf1cc0bc784270b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6be9c expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790773221.674739:0:8392:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6abd07e3, atime: 0x6abd07e1, ctime: 0x6abd07e3, blocks: 0x8 00010000:00010000:2.0:1790773221.674764:0:8392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=364s v=(0 0) 00010000:00010000:2.0:1790773221.674769:0:8392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790773221.674777:0:8392:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000adfd55ca/0xabf1cc0bc784270b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be9c expref: 8 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.674795:0:8392:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000adfd55ca/0xabf1cc0bc784270b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be9c expref: 8 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.674807:0:8392:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26efc4e00, rc 0) 00000100:00100000:2.0:1790773221.674863:0:8392:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:110130ab-04fa-4d7c-984e-562032df4432+8:11875:x1877761484483200:12345-192.168.202.19@tcp:101:bash.0 Request processed in 204us (1674us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773221.674871:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 66 00000100:00100000:3.0:1790773221.681537:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773221.685672:0:8399:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484483328 00000100:00100000:2.0:1790773221.685689:0:8399:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484483328 00002000:00010000:2.0:1790773221.685733:0:8399:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:2.0:1790773221.685738:0:8399:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93d1445d8000 with x1877761484483328 ext(0->18446744073709551615) 00002000:00010000:2.0:1790773221.685750:0:8399:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93d1445d8000. 00000100:00100000:2.0:1790773221.685784:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00100000:2.0:1790773221.685793:0:8399:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:110130ab-04fa-4d7c-984e-562032df4432+8:2399:x1877761484483328:12345-192.168.202.19@tcp:10:bash.0 00002000:00010000:2.0:1790773221.686051:0:8399:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1790773221.686055:0:8399:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1790773219 -> 1790773221 00002000:00010000:2.0:1790773221.686058:0:8399:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1790773217 -> 1790773217 00002000:00010000:2.0:1790773221.686070:0:8399:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1790773219 -> 1790773221 00002000:00010000:2.0:1790773221.686073:0:8399:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1790773221.686154:0:8399:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:110130ab-04fa-4d7c-984e-562032df4432+9:2399:x1877761484483328:12345-192.168.202.19@tcp:10:bash.0 Request processed in 360us (4625us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1790773221.686161:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 5 00002000:00010000:2.0:1790773221.686165:0:8399:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:2.0:1790773221.686168:0:8399:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93d1445d8000 with x1877761484483328 ext(0->18446744073709551615) 00002000:00010000:2.0:1790773221.686173:0:8399:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93d1445d8000. 00000100:00100000:3.0:1790773221.710700:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144547480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496067840:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790773221.710777:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773221.711836:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496067840 00000100:00100000:1.0:1790773221.711848:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496067840 00000100:00100000:1.0:1790773221.711922:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1790773221.711935:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496067840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790773221.711969:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790773221.712044:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496067840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (1268us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773221.712050:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1790773221.712121:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144547480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496067840:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790773221.712140:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790773221.712147:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496067968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790773221.712179:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790773221.712262:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790773221.712361:0:8397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496067968 00000100:00100000:0.0:1790773221.712366:0:8397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496067968 00000100:00100000:0.0:1790773221.712400:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1790773221.712407:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3606:x1877761496067968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790773221.712428:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790773221.712462:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3606:x1877761496067968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773221.712484:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:2.0:1790773221.712564:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790773221.712688:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496067968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790773221.788981:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773221.789091:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484483456 00000100:00100000:0.0:1790773221.789101:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484483456 00000100:00100000:0.0:1790773221.789167:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 209 00000100:00100000:0.0:1790773221.789177:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+35:12358:x1877761484483456:12345-192.168.202.19@tcp:34:lfs.0 00010000:00010000:0.0:1790773221.789281:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7842712 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773221.789299:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7842712 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773221.789311:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7842712 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773221.789327:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc7842719 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773221.789334:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc7842719 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773221.789341:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc7842719 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773221.789411:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7842720 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773221.789431:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7842720 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773221.789439:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7842720 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790773221.789731:0:6479:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7842720 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773221.789744:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7842712 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773221.789750:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7842712 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773221.789758:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7842712 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773221.789764:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074b000 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773221.789768:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7842712 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773221.789775:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7842712 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773221.789787:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93d26ede0c00) 00010000:00010000:0.0:1790773221.789790:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773221.789794:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7842712 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773221.789800:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc7842712 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773221.789813:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc7842719 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773221.789819:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc7842719 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773221.789830:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc7842719 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773221.789835:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074b400 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773221.789838:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc7842719 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773221.789844:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc7842719 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773221.789851:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93d26ede0100) 00010000:00010000:0.0:1790773221.789854:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773221.789857:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc7842719 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773221.789862:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc7842719 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773221.789878:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7842720 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773221.789884:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7842720 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773221.789891:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7842720 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773221.789896:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074ae00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773221.789898:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7842720 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773221.789913:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7842720 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773221.789920:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d255bad900) 00010000:00010000:0.0:1790773221.789922:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773221.789925:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7842720 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773221.789931:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7842720 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773221.790004:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+35:12358:x1877761484483456:12345-192.168.202.19@tcp:34:lfs.0 Request processed in 828us (1034us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773221.790013:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 209 00000100:00100000:3.0:1790773221.845186:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773221.845359:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484483712 00000100:00100000:2.0:1790773221.845371:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484483712 00000100:00100000:2.0:1790773221.845443:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 210 00000100:00100000:2.0:1790773221.845467:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+35:12361:x1877761484483712:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1790773221.845491:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773221.845512:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7842727 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bea3 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.845590:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc784272e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.845604:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc784272e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.845615:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc784272e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.845629:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc7842735 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.845652:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc7842735 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.845659:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc7842735 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.845764:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4600/0xabf1cc0bc784273c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.845774:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4600/0xabf1cc0bc784273c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.845782:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4600/0xabf1cc0bc784273c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790773221.845792:0:6478:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1790773221.845861:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc784272e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.845869:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc784272e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.845877:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc784272e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.845883:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc4c00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:2.0:1790773221.845888:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc784272e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.845896:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc784272e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.845918:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93d26ede0c00) 00010000:00010000:2.0:1790773221.845921:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790773221.845927:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc784272e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.845933:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc784272e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.845947:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc7842735 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.845954:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc7842735 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.845961:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc7842735 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.845966:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc4800 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:2.0:1790773221.845969:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc7842735 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.845976:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc7842735 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.845983:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93d255bad500) 00010000:00010000:2.0:1790773221.845986:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790773221.845989:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc7842735 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.845995:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc7842735 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.846039:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc7842727 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bea3 expref: 38 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.846053:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4600/0xabf1cc0bc784273c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bea3 expref: 37 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.846061:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d255bad900) 00010000:00010000:2.0:1790773221.846063:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790773221.846066:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26efc4600, rc 0) 00000100:00100000:2.0:1790773221.846135:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+37:12361:x1877761484483712:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 670us (958us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1790773221.846144:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 210 00000100:00100000:3.0:1790773221.856270:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773221.856405:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484483840 00000100:00100000:0.0:1790773221.856416:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484483840 00000100:00100000:0.0:1790773221.856489:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 211 00000100:00100000:0.0:1790773221.856499:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+37:12361:x1877761484483840:12345-192.168.202.19@tcp:54:lfs.0 00010000:00010000:0.0:1790773221.856567:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784274a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773221.856584:0:13768:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78426e1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be87 expref: 37 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773221.856593:0:13768:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784274a lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773221.856625:0:13768:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78426e1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be87 expref: 37 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773221.856657:0:13768:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78426e1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be87 expref: 37 pid: 6480 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773221.856673:0:13768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13768:1877761496068096:192.168.202.19@tcp:104: 00000100:00100000:0.0:1790773221.856762:0:13768:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d141fd23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790773221.862517:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773221.862630:0:13768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13768:1877761496068096:192.168.202.19@tcp:104: 00010000:00010000:3.0:1790773221.862658:0:13768:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784274a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773221.863416:0:6482:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484484096 00000100:00100000:1.0:1790773221.863433:0:6482:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484484096 00000100:00100000:1.0:1790773221.863649:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 52 00000100:00100000:1.0:1790773221.863660:0:6482:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+38:6167:x1877761484484096:12345-192.168.202.19@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1790773221.863934:0:6482:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+39:6167:x1877761484484096:12345-192.168.202.19@tcp:35:ldlm_bl.0 Request processed in 276us (1427us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1790773221.863943:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 52 00000100:00100000:3.0:1790773221.870138:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773221.870243:0:6464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484484224 00000100:00100000:2.0:1790773221.870252:0:6464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484484224 00010000:00010000:2.0:1790773221.870301:0:6464:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78426e1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be87 expref: 39 pid: 6480 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773221.870344:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 95 00000100:00100000:2.0:1790773221.870353:0:6464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d255828050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:110130ab-04fa-4d7c-984e-562032df4432+39:2398:x1877761484484224:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790773221.870367:0:6464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790773221.870374:0:6464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78426e1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be87 expref: 39 pid: 6480 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.870387:0:6464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78426e1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be87 expref: 39 pid: 6480 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.870471:0:6464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78426e1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be87 expref: 39 pid: 6480 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.870489:0:6464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d255bad900) 00010000:00010000:2.0:1790773221.870495:0:6464:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784274a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.870504:0:6464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784274a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.870511:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784274a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773221.870534:0:6464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790773221.870585:0:6464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d255828050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:110130ab-04fa-4d7c-984e-562032df4432+38:2398:x1877761484484224:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 233us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773221.870593:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 95 00010000:00010000:3.0:1790773221.871025:0:13768:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784274a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.871034:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784274a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.871082:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784274a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.871090:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784274a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.871097:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784274a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.871119:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074b400 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773221.871124:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784274a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.871132:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784274a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.871142:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d255bad900) 00010000:00010000:3.0:1790773221.871145:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790773221.871150:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784274a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.871155:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc784274a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773221.871242:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+37:12361:x1877761484483840:12345-192.168.202.19@tcp:54:lfs.0 Request processed in 14708us (14946us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773221.871250:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 211 00000100:00100000:3.0:1790773221.873405:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773221.873912:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484484480 00000100:00100000:0.0:1790773221.873921:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484484480 00000100:00100000:2.0:1790773221.874054:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 53 00000100:00100000:2.0:1790773221.874064:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:110130ab-04fa-4d7c-984e-562032df4432+37:12361:x1877761484484480:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:2.0:1790773221.874294:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:110130ab-04fa-4d7c-984e-562032df4432+38:12361:x1877761484484480:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 230us (895us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1790773221.874301:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 53 00000100:00100000:2.0:1790773221.993988:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773221.994128:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484484736 00000100:00100000:3.0:1790773221.994140:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484484736 00000100:00100000:3.0:1790773221.994258:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 212 00000100:00100000:3.0:1790773221.994270:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144547800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+38:12372:x1877761484484736:12345-192.168.202.19@tcp:101:cat.0 00010000:00010000:3.0:1790773221.994299:0:8697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773221.994320:0:8697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc7842751 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6beaa expref: -99 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.994393:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7842758 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.994431:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7842758 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.994444:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7842758 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.994470:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc784275f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.994477:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc784275f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.994484:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc784275f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.994844:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc7842766 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.994855:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc7842766 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.994863:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc7842766 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790773221.994884:0:8697:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:3.0:1790773221.994961:0:8697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7842758 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.994969:0:8697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7842758 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.994976:0:8697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7842758 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.994989:0:8697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ada00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773221.994993:0:8697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7842758 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.995000:0:8697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7842758 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.995014:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93d26ede0c00) 00010000:00010000:3.0:1790773221.995017:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790773221.995022:0:8697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7842758 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.995028:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7842758 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.995045:0:8697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc784275f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.995051:0:8697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc784275f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.995057:0:8697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc784275f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.995062:0:8697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ad400 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773221.995064:0:8697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc784275f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.995070:0:8697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc784275f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.995088:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93d27c346600) 00010000:00010000:3.0:1790773221.995090:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790773221.995094:0:8697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc784275f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.995101:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc784275f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.995148:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc7842751 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6beaa expref: 41 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.995164:0:8697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc7842766 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6beaa expref: 40 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773221.995171:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d255bad900) 00010000:00010000:3.0:1790773221.995173:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790773221.995175:0:8697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d1434ade00, rc 0) 00000100:00100000:3.0:1790773221.995302:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144547800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+40:12372:x1877761484484736:12345-192.168.202.19@tcp:101:cat.0 Request processed in 1034us (1323us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1790773221.995310:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 212 00000100:00100000:0.0:1790773222.006845:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773222.006942:0:14187:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484484992 00000100:00100000:3.0:1790773222.006952:0:14187:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484484992 00000100:00100000:3.0:1790773222.007025:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 54 00000100:00100000:3.0:1790773222.007034:0:14187:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:110130ab-04fa-4d7c-984e-562032df4432+40:12372:x1877761484484992:12345-192.168.202.19@tcp:35:cat.0 00000100:00100000:3.0:1790773222.007354:0:14187:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:110130ab-04fa-4d7c-984e-562032df4432+41:12372:x1877761484484992:12345-192.168.202.19@tcp:35:cat.0 Request processed in 320us (518us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1790773222.007361:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 54 00000100:00080000:2.0:1790773222.007558:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790773222.047576:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773222.047740:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484485248 00000100:00100000:2.0:1790773222.047751:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484485248 00000100:00100000:2.0:1790773222.047817:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 213 00000100:00100000:2.0:1790773222.047840:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+41:12373:x1877761484485248:12345-192.168.202.19@tcp:36:rm.0 00010000:00010000:2.0:1790773222.047912:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1790773222.047938:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7842704 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be95 expref: 41 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.047962:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc7842766 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6beaa expref: 40 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.047979:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4600/0xabf1cc0bc784273c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bea3 expref: 39 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.047992:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc78426f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be8e expref: 38 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.048003:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d255bad900) 00010000:00010000:2.0:1790773222.048008:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790773222.048028:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc7842774 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.048042:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc7842774 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.048052:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc7842774 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.048066:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc784277b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.048074:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc784277b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.048087:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc784277b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.048167:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7842782 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.048176:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7842782 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.048183:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7842782 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790773222.048646:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1790773222.048657:0:6478:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 364850451908ns, next at 365850448423ns, rc = 0 00010000:00010000:2.0:1790773222.048699:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7842789 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.048709:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7842789 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.048717:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7842789 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.048725:0:6478:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7842789 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.048732:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7842789 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.048739:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7842789 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.048773:0:6478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790773222.048794:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7842782 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.048801:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7842782 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.048808:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7842782 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.048815:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc5200 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:2.0:1790773222.048819:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7842782 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.048827:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7842782 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.048836:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d255bad900) 00010000:00010000:2.0:1790773222.048839:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1790773222.048843:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7842782 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.048849:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7842782 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.048864:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc7842774 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.049366:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc7842774 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.049372:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc7842774 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.049392:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc4c00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:2.0:1790773222.049395:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc7842774 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.049401:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc7842774 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.049409:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93d26ede0c00) 00010000:00010000:2.0:1790773222.049412:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790773222.049424:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc7842774 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.049436:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc7842774 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790773222.049632:0:6478:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000015d86880 reply state 000000001cba9397 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc784277b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.049645:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc784277b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.049657:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93d255bad500) 00010000:00010000:2.0:1790773222.049659:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790773222.049662:0:6478:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790773222.049765:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+39:12373:x1877761484485248:12345-192.168.202.19@tcp:36:rm.0 Request processed in 1924us (2195us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1790773222.049800:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 213 00010000:00010000:3.0:1790773222.049881:0:6466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790773222.049888:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7842789 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.049895:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc5800 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:3.0:1790773222.049898:0:6466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7842789 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.049904:0:6466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7842789 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.049921:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d255bad900) 00010000:00010000:3.0:1790773222.049923:0:6466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790773222.049926:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7842789 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.049932:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7842789 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.049943:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773222.049945:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773222.049946:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773222.126441:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773222.126550:0:14584:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484485504 00000100:00100000:2.0:1790773222.126560:0:14584:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484485504 00000100:00100000:2.0:1790773222.126623:0:14584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 214 00000100:00100000:2.0:1790773222.126648:0:14584:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:110130ab-04fa-4d7c-984e-562032df4432+39:12379:x1877761484485504:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:2.0:1790773222.126674:0:14584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773222.126694:0:14584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc7842790 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6beb1 expref: -99 pid: 14584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.126792:0:14584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7842797 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.126806:0:14584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7842797 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.126817:0:14584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7842797 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.126827:0:14584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4600/0xabf1cc0bc784279e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.126833:0:14584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4600/0xabf1cc0bc784279e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.126840:0:14584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4600/0xabf1cc0bc784279e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790773222.127166:0:14584:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:2.0:1790773222.127342:0:14584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc78427a5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.127352:0:14584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc78427a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.127360:0:14584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc78427a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.127397:0:14584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7842797 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.127405:0:14584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7842797 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.127412:0:14584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7842797 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.127429:0:14584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc5200 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:2.0:1790773222.127434:0:14584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7842797 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.127441:0:14584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7842797 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.127452:0:14584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93d26ede0c00) 00010000:00010000:2.0:1790773222.127455:0:14584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790773222.127459:0:14584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7842797 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.127464:0:14584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7842797 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790773222.127478:0:14584:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d90590a5 reply state 0000000092a56f7c transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4600/0xabf1cc0bc784279e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.127489:0:14584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4600/0xabf1cc0bc784279e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.127495:0:14584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93d255bad500) 00010000:00010000:2.0:1790773222.127503:0:14584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790773222.127506:0:14584:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790773222.127533:0:14584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc7842790 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6beb1 expref: 42 pid: 14584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.127547:0:14584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc78427a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6beb1 expref: 41 pid: 14584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.127554:0:14584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93d255bada00) 00010000:00010000:2.0:1790773222.127556:0:14584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790773222.127559:0:14584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26efc5600, rc 0) 00000100:00100000:2.0:1790773222.127635:0:14584:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:110130ab-04fa-4d7c-984e-562032df4432+42:12379:x1877761484485504:12345-192.168.202.19@tcp:101:bash.0 Request processed in 988us (1202us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1790773222.127642:0:14584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 214 00000100:00100000:1.0:1790773222.146761:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773222.146852:0:8906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484485632 00000100:00100000:2.0:1790773222.146862:0:8906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484485632 00000100:00100000:2.0:1790773222.146943:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 67 00000100:00100000:2.0:1790773222.146953:0:8906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:110130ab-04fa-4d7c-984e-562032df4432+7:2399:x1877761484485632:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:2.0:1790773222.146970:0:8906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773222.146990:0:8906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1f867cc/0xabf1cc0bc78427b3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6beb8 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790773222.147015:0:8906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790773222.147033:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=364s v=(0 0) 00010000:00010000:2.0:1790773222.147038:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790773222.147047:0:8906:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1f867cc/0xabf1cc0bc78427b3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6beb8 expref: 8 pid: 8906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.147086:0:8906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f1f867cc/0xabf1cc0bc78427b3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6beb8 expref: 8 pid: 8906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.147099:0:8906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26efc4c00, rc 0) 00000100:00100000:2.0:1790773222.147167:0:8906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:110130ab-04fa-4d7c-984e-562032df4432+8:2399:x1877761484485632:12345-192.168.202.19@tcp:101:bash.0 Request processed in 215us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773222.147174:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 67 00000100:00080000:3.0:1790773222.147404:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790773222.150831:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773222.151026:0:8907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484485760 00000100:00100000:2.0:1790773222.151037:0:8907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484485760 00000100:00100000:2.0:1790773222.151153:0:8907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 68 00000100:00100000:2.0:1790773222.151164:0:8907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:110130ab-04fa-4d7c-984e-562032df4432+8:12379:x1877761484485760:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:2.0:1790773222.151196:0:8907:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773222.151256:0:8907:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005dc6ee3a/0xabf1cc0bc78427ba lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bebf expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.151287:0:8907:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f1f867cc/0xabf1cc0bc78427b3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6beb8 expref: 9 pid: 8906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.151298:0:8907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790773222.151302:0:8907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790773222.151307:0:8907:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005dc6ee3a/0xabf1cc0bc78427ba lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bebf expref: 9 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.151344:0:8907:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f1f867cc/0xabf1cc0bc78427b3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6beb8 expref: 9 pid: 8906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.151377:0:8907:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f1f867cc/0xabf1cc0bc78427b3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6beb8 expref: 9 pid: 8906 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773222.151391:0:8907:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144546d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:8907:1877761496068224:192.168.202.19@tcp:104: 00000100:00100000:2.0:1790773222.151493:0:8907:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279e96840 going to sleep for 11 seconds 00000100:00100000:2.0:1790773222.154547:0:8907:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144546d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:8907:1877761496068224:192.168.202.19@tcp:104: 00010000:00010000:2.0:1790773222.154594:0:8907:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005dc6ee3a/0xabf1cc0bc78427ba lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bebf expref: 9 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.154615:0:8907:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26efc5200, rc 0) 00000100:00100000:2.0:1790773222.154684:0:8907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:110130ab-04fa-4d7c-984e-562032df4432+9:12379:x1877761484485760:12345-192.168.202.19@tcp:101:bash.0 Request processed in 3520us (3862us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773222.154694:0:8907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 68 00000100:00100000:1.0:1790773222.157481:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773222.157663:0:6465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484485888 00000100:00100000:0.0:1790773222.157674:0:6465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484485888 00010000:00010000:0.0:1790773222.157718:0:6465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f1f867cc/0xabf1cc0bc78427b3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6beb8 expref: 9 pid: 8906 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773222.157761:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 96 00000100:00100000:0.0:1790773222.157771:0:6465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:110130ab-04fa-4d7c-984e-562032df4432+9:2397:x1877761484485888:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790773222.157786:0:6465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773222.157806:0:6465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f1f867cc/0xabf1cc0bc78427b3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6beb8 expref: 9 pid: 8906 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.157820:0:6465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f1f867cc/0xabf1cc0bc78427b3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6beb8 expref: 9 pid: 8906 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.157844:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1f867cc/0xabf1cc0bc78427b3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6beb8 expref: 9 pid: 8906 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.157979:0:6465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790773222.157983:0:6465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790773222.157992:0:6465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005dc6ee3a/0xabf1cc0bc78427ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bebf expref: 8 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.158003:0:6465:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005dc6ee3a/0xabf1cc0bc78427ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bebf expref: 8 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.158041:0:6465:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005dc6ee3a/0xabf1cc0bc78427ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bebf expref: 8 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773222.158056:0:6465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6465:1877761496068352:192.168.202.19@tcp:105: 00000100:00100000:0.0:1790773222.158182:0:6465:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d141fd2300 going to sleep for 11 seconds 00000100:00100000:1.0:1790773222.161918:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773222.162037:0:6482:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484486144 00000100:00100000:2.0:1790773222.162046:0:6482:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484486144 00000100:00100000:2.0:1790773222.162102:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 55 00000100:00100000:2.0:1790773222.162112:0:6482:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+42:12379:x1877761484486144:12345-192.168.202.19@tcp:35:bash.0 00000100:00100000:2.0:1790773222.162706:0:6482:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+43:12379:x1877761484486144:12345-192.168.202.19@tcp:35:bash.0 Request processed in 594us (796us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1790773222.162715:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 55 00000100:00100000:0.0:1790773222.163151:0:6465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6465:1877761496068352:192.168.202.19@tcp:105: 00010000:00010000:0.0:1790773222.163175:0:6465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790773222.163304:0:6465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:110130ab-04fa-4d7c-984e-562032df4432+8:2397:x1877761484485888:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 5534us (5834us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773222.163313:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 96 00010000:00010000:0.0:1790773222.225981:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773222.337559:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773222.337619:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484486272 00000100:00100000:3.0:1790773222.337629:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484486272 00000100:00100000:3.0:1790773222.337697:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 215 00000100:00100000:3.0:1790773222.337707:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+43:12395:x1877761484486272:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:3.0:1790773222.337735:0:8697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773222.337756:0:8697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc78427c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bec6 expref: -99 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.337840:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc78427c8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.337855:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc78427c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.337878:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc78427c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790773222.337924:0:8697:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1790773222.337927:0:8697:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790773222.337946:0:8697:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc78427c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.337976:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc78427c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bec6 expref: 45 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.337998:0:8697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc78427c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bec6 expref: 44 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.338007:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93d26ede0c00) 00010000:00010000:3.0:1790773222.338010:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790773222.338013:0:8697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d1434ad400, rc 0) 00000100:00100000:3.0:1790773222.338082:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+44:12395:x1877761484486272:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 376us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773222.338090:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 215 00000100:00100000:1.0:1790773222.343648:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773222.343974:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484486528 00000100:00100000:3.0:1790773222.343985:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484486528 00000100:00100000:3.0:1790773222.344055:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 216 00000100:00100000:3.0:1790773222.344065:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+44:12395:x1877761484486528:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:3.0:1790773222.344097:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773222.344124:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc78427cf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6becd expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.344265:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc78427d6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.344280:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc78427d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.344292:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc78427d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790773222.344304:0:6480:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1790773222.344409:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc78427cf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6becd expref: 47 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.344443:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc78427d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6becd expref: 46 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.344453:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93d255bada00) 00010000:00010000:3.0:1790773222.344456:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790773222.344460:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d1434ada00, rc 0) 00000100:00100000:3.0:1790773222.344530:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+46:12395:x1877761484486528:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 466us (889us total) trans 4294967486 rc 0/0 00000100:00100000:3.0:1790773222.344537:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 216 00000100:00100000:3.0:1790773222.351279:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773222.351339:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773222.351411:0:6463:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484486912 00000100:00100000:0.0:1790773222.351431:0:6463:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484486912 00000100:00100000:0.0:1790773222.351502:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:0.0:1790773222.351512:0:6463:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:110130ab-04fa-4d7c-984e-562032df4432+46:2397:x1877761484486912:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790773222.351528:0:6463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773222.351560:0:6463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc78427d6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6becd expref: 46 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.351582:0:6463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93d255bada00) 00010000:00010000:0.0:1790773222.351588:0:6463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790773222.351642:0:6463:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:110130ab-04fa-4d7c-984e-562032df4432+45:2397:x1877761484486912:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 131us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773222.351649:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:2.0:1790773222.351794:0:14584:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484486784 00000100:00100000:2.0:1790773222.351799:0:14584:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484486784 00000100:00100000:2.0:1790773222.351840:0:14584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 217 00000100:00100000:2.0:1790773222.351848:0:14584:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:110130ab-04fa-4d7c-984e-562032df4432+45:12395:x1877761484486784:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1790773222.351887:0:14584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773222.351905:0:14584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc78427e4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bed4 expref: -99 pid: 14584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.352001:0:14584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc78427eb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.352016:0:14584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc78427eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.352026:0:14584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc78427eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790773222.352039:0:14584:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1790773222.352131:0:14584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4c00/0xabf1cc0bc78427e4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bed4 expref: 48 pid: 14584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.352146:0:14584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc78427eb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bed4 expref: 47 pid: 14584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.352154:0:14584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93d255bada00) 00010000:00010000:2.0:1790773222.352157:0:14584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1790773222.352159:0:14584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26efc5800, rc 0) 00000100:00100000:2.0:1790773222.352188:0:14584:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:110130ab-04fa-4d7c-984e-562032df4432+47:12395:x1877761484486784:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 342us (923us total) trans 4294967487 rc 0/0 00000100:00100000:2.0:1790773222.352195:0:14584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 217 00000100:00100000:3.0:1790773222.359640:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773222.359709:0:8393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484487040 00000100:00100000:0.0:1790773222.359718:0:8393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484487040 00000100:00100000:0.0:1790773222.359763:0:8393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 69 00000100:00100000:0.0:1790773222.359770:0:8393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14480f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:110130ab-04fa-4d7c-984e-562032df4432+8:2399:x1877761484487040:12345-192.168.202.19@tcp:1:lfs.0 00010000:00010000:0.0:1790773222.359811:0:8393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e50aca4d/0xabf1cc0bc78427f9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.359826:0:8393:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005dc6ee3a/0xabf1cc0bc78427ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bebf expref: 8 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.359832:0:8393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1790773222.359835:0:8393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790773222.359839:0:8393:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e50aca4d/0xabf1cc0bc78427f9 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.359865:0:8393:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005dc6ee3a/0xabf1cc0bc78427ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bebf expref: 8 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.359875:0:8393:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005dc6ee3a/0xabf1cc0bc78427ba lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bebf expref: 8 pid: 8907 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773222.359894:0:8393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8393:1877761496068480:192.168.202.19@tcp:104: 00000100:00100000:0.0:1790773222.359961:0:8393:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d141fd2300 going to sleep for 11 seconds 00000100:00100000:0.0:1790773222.365076:0:8393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8393:1877761496068480:192.168.202.19@tcp:104: 00010000:00010000:0.0:1790773222.365123:0:8393:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e50aca4d/0xabf1cc0bc78427f9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773222.365983:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773222.366048:0:8398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484487168 00000100:00100000:2.0:1790773222.366056:0:8398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484487168 00002000:00100000:2.0:1790773222.366118:0:8398:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff93d14480ed80 x1877761484487168/t0(0) o4->110130ab-04fa-4d7c-984e-562032df4432@192.168.202.19@tcp:58/0 lens 504/0 e 0 to 0 dl 1790773233 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790773222.366142:0:8398:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93d14480ed80 with x1877761484487168 ext(0->8) 00010000:00010000:2.0:1790773222.366151:0:8398:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005dc6ee3a/0xabf1cc0bc78427ba lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bebf expref: 9 pid: 8907 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.366166:0:8398:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005dc6ee3a/0xabf1cc0bc78427ba lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bebf expref: 9 pid: 8907 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790773222.366175:0:8398:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93d14480ed80 00000100:00100000:2.0:1790773222.366246:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 3 00000100:00100000:2.0:1790773222.366257:0:8398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14480ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:110130ab-04fa-4d7c-984e-562032df4432+9:2397:x1877761484487168:12345-192.168.202.19@tcp:4:lfs.0 00000100:00100000:2.0:1790773222.368193:0:8398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14480ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:110130ab-04fa-4d7c-984e-562032df4432+11:2397:x1877761484487168:12345-192.168.202.19@tcp:4:lfs.0 Request processed in 1928us (2203us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1790773222.368328:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 3 00002000:00100000:2.0:1790773222.368339:0:8398:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff93d14480ed80 x1877761484487168/t4294967309(0) o4->110130ab-04fa-4d7c-984e-562032df4432@192.168.202.19@tcp:58/0 lens 504/448 e 0 to 0 dl 1790773233 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790773222.368351:0:8398:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93d14480ed80 with x1877761484487168 ext(0->8) 00010000:00010000:2.0:1790773222.368360:0:8398:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005dc6ee3a/0xabf1cc0bc78427ba lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bebf expref: 11 pid: 8907 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.368378:0:8398:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005dc6ee3a/0xabf1cc0bc78427ba lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bebf expref: 11 pid: 8907 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790773222.368386:0:8398:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93d14480ed80 00000100:00100000:2.0:1790773222.370390:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773222.373961:0:8410:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484487296 00000100:00100000:3.0:1790773222.373976:0:8410:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484487296 00010000:00010000:3.0:1790773222.374025:0:8410:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005dc6ee3a/0xabf1cc0bc78427ba lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bebf expref: 11 pid: 8907 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773222.374076:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 97 00000100:00100000:3.0:1790773222.374096:0:8410:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144546d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:110130ab-04fa-4d7c-984e-562032df4432+11:2398:x1877761484487296:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790773222.374398:0:8410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1790773222.374428:0:8410:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1790773222.374431:0:8410:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1790773222 00002000:00010000:2.0:1790773222.374434:0:8410:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1790773222 00002000:00010000:2.0:1790773222.374436:0:8410:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1790773222 00002000:00010000:2.0:1790773222.374439:0:8410:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1790773222.374453:0:8410:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005dc6ee3a/0xabf1cc0bc78427ba lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bebf expref: 11 pid: 8907 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.374469:0:8410:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005dc6ee3a/0xabf1cc0bc78427ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bebf expref: 11 pid: 8907 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.374492:0:8410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005dc6ee3a/0xabf1cc0bc78427ba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bebf expref: 11 pid: 8907 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.374511:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790773222.374515:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790773222.374521:0:8410:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e50aca4d/0xabf1cc0bc78427f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.374533:0:8410:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e50aca4d/0xabf1cc0bc78427f9 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.374570:0:8410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790773222.374630:0:8410:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144546d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:110130ab-04fa-4d7c-984e-562032df4432+10:2398:x1877761484487296:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 535us (4246us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773222.374638:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 97 00010000:00010000:0.0:1790773222.374761:0:8393:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e50aca4d/0xabf1cc0bc78427f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.374772:0:8393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e50aca4d/0xabf1cc0bc78427f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.374792:0:8393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e50aca4d/0xabf1cc0bc78427f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.374802:0:8393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e50aca4d/0xabf1cc0bc78427f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.374811:0:8393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e50aca4d/0xabf1cc0bc78427f9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.374818:0:8393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074aa00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:0.0:1790773222.374823:0:8393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e50aca4d/0xabf1cc0bc78427f9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.374845:0:8393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e50aca4d/0xabf1cc0bc78427f9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.374858:0:8393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e50aca4d/0xabf1cc0bc78427f9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.374866:0:8393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e50aca4d/0xabf1cc0bc78427f9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773222.374912:0:8393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14480f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:110130ab-04fa-4d7c-984e-562032df4432+9:2399:x1877761484487040:12345-192.168.202.19@tcp:1:lfs.0 Request processed in 15142us (15280us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773222.374920:0:8393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 69 00000100:00100000:3.0:1790773222.377361:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773222.377484:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484487552 00000100:00100000:0.0:1790773222.377495:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484487552 00000100:00100000:0.0:1790773222.377547:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 56 00000100:00100000:0.0:1790773222.377556:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d279db9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:110130ab-04fa-4d7c-984e-562032df4432+47:12395:x1877761484487552:12345-192.168.202.19@tcp:35:lfs.0 00000004:00010000:0.0:1790773222.377612:0:6481:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc78427eb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bed4 expref: 47 pid: 14584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790773222.377783:0:6481:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:0.0:1790773222.377812:0:6481:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1790773222.378096:0:6481:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:0.0:1790773222.378146:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842800 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.378162:0:6481:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc78427a5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6beb1 expref: 51 pid: 14584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.378185:0:6481:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842800 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.378245:0:6481:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc78427a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6beb1 expref: 51 pid: 14584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.378261:0:6481:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc78427a5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6beb1 expref: 51 pid: 14584 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773222.378276:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6481:1877761496068608:192.168.202.19@tcp:104: 00000100:00100000:0.0:1790773222.378345:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d141fd2300 going to sleep for 11 seconds 00000100:00100000:3.0:1790773222.380797:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773222.380918:0:6465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484487680 00000100:00100000:1.0:1790773222.380927:0:6465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484487680 00010000:00010000:1.0:1790773222.380965:0:6465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc78427a5 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6beb1 expref: 52 pid: 14584 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773222.381025:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 98 00000100:00100000:1.0:1790773222.381035:0:6465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14480fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:110130ab-04fa-4d7c-984e-562032df4432+52:2398:x1877761484487680:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790773222.381050:0:6465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790773222.381057:0:6465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc78427a5 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6beb1 expref: 52 pid: 14584 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773222.381070:0:6465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc78427a5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6beb1 expref: 52 pid: 14584 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773222.381101:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93d255bada00) 00010000:00010000:1.0:1790773222.381110:0:6465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842800 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773222.381120:0:6465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842800 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773222.381128:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842800 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773222.381146:0:6465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790773222.381225:0:6465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14480fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:110130ab-04fa-4d7c-984e-562032df4432+52:2398:x1877761484487680:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 165us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773222.381233:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 98 00010000:00010000:0.0:1790773222.382260:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc78427a5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6beb1 expref: 51 pid: 14584 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773222.382282:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6481:1877761496068608:192.168.202.19@tcp:104: 00010000:00010000:0.0:1790773222.382301:0:6481:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842800 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.382311:0:6481:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842800 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.382317:0:6481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842800 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790773222.382996:0:6481:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:0.0:1790773222.383133:0:6481:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:0.0:1790773222.383284:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6481:1877761496068736:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1790773222.383353:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773222.383386:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d141fd2780 going to sleep for 11 seconds 00000100:00100000:2.0:1790773222.383598:0:6484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496068736 00000100:00100000:2.0:1790773222.383606:0:6484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496068736 00000100:00100000:2.0:1790773222.383652:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1790773222.383661:0:6484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6481:x1877761496068736:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1790773222.383746:0:6484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6481:x1877761496068736:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 86us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773222.383754:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1790773222.383958:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6481:1877761496068736:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1790773222.384062:0:6481:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:3.0:1790773222.384100:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14480e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6481:1877761496068864:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1790773222.384141:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773222.384164:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d14306d780 going to sleep for 11 seconds 00000100:00100000:0.0:1790773222.384525:0:7666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496068864 00000100:00100000:0.0:1790773222.384530:0:7666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496068864 00000100:00100000:0.0:1790773222.384566:0:7666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1790773222.384573:0:7666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14480d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6481:x1877761496068864:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1790773222.384678:0:7666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14480d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6481:x1877761496068864:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 105us (536us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1790773222.384686:0:7666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1790773222.384819:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14480e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6481:1877761496068864:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1790773222.384854:0:6481:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:3.0:1790773222.384882:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842800 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.384892:0:6481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842800 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.384900:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842800 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.384920:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074b200 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773222.384925:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842800 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.384934:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842800 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.384948:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93d255bada00) 00010000:00010000:3.0:1790773222.384952:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1790773222.384956:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842800 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.384963:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842800 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790773222.385045:0:6481:0:(mdd_object.c:4189:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1790773222.385950:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:3.0:1790773222.385967:0:6481:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 365187761504ns, next at 366187758222ns, rc = 0 00000001:00080000:3.0:1790773222.385976:0:6481:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:3.0:1790773222.386007:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93d255bada00) 00010000:00010000:3.0:1790773222.386011:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1790773222.386020:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc78427eb lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bed4 expref: 55 pid: 14584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773222.386153:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d279db9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:110130ab-04fa-4d7c-984e-562032df4432+54:12395:x1877761484487552:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 8597us (8798us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1790773222.386162:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 56 00000020:00080000:3.0:1790773222.386167:0:6481:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1790773222.389118:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773222.389336:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484487808 00000100:00100000:0.0:1790773222.389346:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484487808 00000100:00100000:0.0:1790773222.389402:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 218 00000100:00100000:0.0:1790773222.389411:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14480c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+54:12395:x1877761484487808:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:0.0:1790773222.389444:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773222.389471:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc7842807 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bedb expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.389530:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc7842807 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bedb expref: 55 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.389544:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc7842807 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bedb expref: 55 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.389562:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93d26ede0100) 00010000:00010000:0.0:1790773222.389565:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790773222.389569:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074aa00, rc 0) 00000100:00100000:0.0:1790773222.389701:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14480c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+55:12395:x1877761484487808:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 290us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773222.389723:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 218 00000100:00100000:2.0:1790773222.393799:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773222.393881:0:6482:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484488064 00000100:00100000:1.0:1790773222.393890:0:6482:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484488064 00000100:00100000:1.0:1790773222.393945:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 57 00000100:00100000:1.0:1790773222.393955:0:6482:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144547b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+55:12395:x1877761484488064:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:1.0:1790773222.394805:0:6482:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144547b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+56:12395:x1877761484488064:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 244us (409us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1790773222.394816:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 57 00000100:00100000:1.0:1790773222.501579:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773222.501698:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484488192 00000100:00100000:3.0:1790773222.501708:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484488192 00000100:00100000:3.0:1790773222.501763:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 219 00000100:00100000:3.0:1790773222.501772:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+56:12405:x1877761484488192:12345-192.168.202.19@tcp:34:lfs.0 00010000:00010000:3.0:1790773222.501847:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc784280e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.501865:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc784280e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.501877:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc784280e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.501887:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc7842815 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.501894:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc7842815 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.501901:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc7842815 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.501970:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc784281c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.501978:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc784281c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.501984:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc784281c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790773222.502025:0:6480:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc784281c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.502051:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc784280e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.502058:0:6480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc784280e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.502065:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc784280e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.502071:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ace00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773222.502075:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc784280e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.502082:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc784280e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.502093:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93d26ede0c00) 00010000:00010000:3.0:1790773222.502095:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790773222.502101:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc784280e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.502116:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc784280e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.502134:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc7842815 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.502140:0:6480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc7842815 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.502145:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc7842815 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.502156:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ac200 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773222.502159:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc7842815 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.502165:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc7842815 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.502172:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93d255bad500) 00010000:00010000:3.0:1790773222.502175:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790773222.502179:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc7842815 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.502185:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc7842815 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.502429:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc784281c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.502437:0:6480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc784281c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.502443:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc784281c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.502458:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ada00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773222.502461:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc784281c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.502467:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc784281c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.502486:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93d26ede0100) 00010000:00010000:3.0:1790773222.502488:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790773222.502491:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc784281c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.502496:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc784281c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773222.502707:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+56:12405:x1877761484488192:12345-192.168.202.19@tcp:34:lfs.0 Request processed in 934us (1138us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773222.502716:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 219 00000100:00100000:0.0:1790773222.554849:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773222.555042:0:14584:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484488448 00000100:00100000:2.0:1790773222.555051:0:14584:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484488448 00000100:00100000:2.0:1790773222.555111:0:14584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 220 00000100:00100000:2.0:1790773222.555118:0:14584:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:110130ab-04fa-4d7c-984e-562032df4432+56:12408:x1877761484488448:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1790773222.555138:0:14584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773222.555154:0:14584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc7842823 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bee2 expref: -99 pid: 14584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.555260:0:14584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc784282a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.555276:0:14584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc784282a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.555285:0:14584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc784282a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.555292:0:14584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7842831 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.555297:0:14584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7842831 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.555317:0:14584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7842831 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.555405:0:14584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7842838 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.555420:0:14584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7842838 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.555427:0:14584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7842838 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790773222.555439:0:14584:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1790773222.555522:0:14584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc784282a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.555531:0:14584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc784282a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.555538:0:14584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc784282a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.555545:0:14584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc5000 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:2.0:1790773222.555549:0:14584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc784282a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.555557:0:14584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc784282a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.555569:0:14584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93d26ede0c00) 00010000:00010000:2.0:1790773222.555573:0:14584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790773222.555584:0:14584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc784282a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.555591:0:14584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5000/0xabf1cc0bc784282a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.555608:0:14584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7842831 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.555615:0:14584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7842831 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.555621:0:14584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7842831 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.555627:0:14584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc5800 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:2.0:1790773222.555630:0:14584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7842831 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.555635:0:14584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7842831 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.555643:0:14584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93d255bad500) 00010000:00010000:2.0:1790773222.555646:0:14584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790773222.555648:0:14584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7842831 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.555654:0:14584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7842831 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.555687:0:14584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc7842823 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bee2 expref: 59 pid: 14584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.555711:0:14584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7842838 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bee2 expref: 58 pid: 14584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.555719:0:14584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93d26ede0100) 00010000:00010000:2.0:1790773222.555722:0:14584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790773222.555724:0:14584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26efc5600, rc 0) 00000100:00100000:2.0:1790773222.556031:0:14584:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:110130ab-04fa-4d7c-984e-562032df4432+58:12408:x1877761484488448:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 911us (1187us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1790773222.556040:0:14584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 220 00000100:00100000:2.0:1790773222.566549:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773222.566707:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484488576 00000100:00100000:3.0:1790773222.566717:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484488576 00000100:00100000:3.0:1790773222.566775:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 221 00000100:00100000:3.0:1790773222.566785:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144546680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+58:12408:x1877761484488576:12345-192.168.202.19@tcp:54:lfs.0 00010000:00010000:3.0:1790773222.566853:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7842846 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.566870:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7842846 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.566882:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7842846 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.566916:0:8697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7842846 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.566923:0:8697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7842846 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.566949:0:8697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7842846 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.566955:0:8697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ada00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773222.566960:0:8697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7842846 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.566967:0:8697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7842846 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.566980:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93d26ede0100) 00010000:00010000:3.0:1790773222.566983:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790773222.566987:0:8697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7842846 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.566994:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7842846 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773222.567075:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144546680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+58:12408:x1877761484488576:12345-192.168.202.19@tcp:54:lfs.0 Request processed in 291us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773222.567082:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 221 00000100:00100000:1.0:1790773222.578760:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773222.578856:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484488832 00000100:00100000:3.0:1790773222.578927:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484488832 00000100:00100000:3.0:1790773222.579147:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 58 00000100:00100000:3.0:1790773222.579158:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:110130ab-04fa-4d7c-984e-562032df4432+58:12408:x1877761484488832:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:3.0:1790773222.579440:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:110130ab-04fa-4d7c-984e-562032df4432+59:12408:x1877761484488832:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 282us (690us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1790773222.579455:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 58 00000100:00100000:0.0:1790773222.678928:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773222.679004:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484489088 00000100:00100000:2.0:1790773222.679015:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484489088 00000100:00100000:2.0:1790773222.679081:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 222 00000100:00100000:2.0:1790773222.679092:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+59:12417:x1877761484489088:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:2.0:1790773222.679116:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773222.679120:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1790773222.679143:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc78427c8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bec6 expref: 59 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.679166:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93d26ede0c00) 00010000:00010000:2.0:1790773222.679171:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790773222.679184:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc784284d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bee9 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.679617:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7842854 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.679644:0:6478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7842838 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bee2 expref: 59 pid: 14584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.679654:0:6478:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7842854 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.679686:0:6478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7842838 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bee2 expref: 59 pid: 14584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.679701:0:6478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7842838 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bee2 expref: 59 pid: 14584 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773222.679716:0:6478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144545500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1877761496068992:192.168.202.19@tcp:104: 00000100:00100000:2.0:1790773222.679833:0:6478:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279e96840 going to sleep for 11 seconds 00000100:00100000:3.0:1790773222.690555:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773222.690802:0:6464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484489216 00000100:00100000:0.0:1790773222.690813:0:6464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484489216 00010000:00010000:0.0:1790773222.690852:0:6464:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7842838 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bee2 expref: 60 pid: 14584 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773222.690901:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 99 00000100:00100000:0.0:1790773222.690911:0:6464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14480f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:110130ab-04fa-4d7c-984e-562032df4432+60:2398:x1877761484489216:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790773222.690926:0:6464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773222.690932:0:6464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7842838 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bee2 expref: 60 pid: 14584 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.690947:0:6464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7842838 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bee2 expref: 60 pid: 14584 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.690969:0:6464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93d26ede0100) 00010000:00010000:0.0:1790773222.690975:0:6464:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7842854 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.690984:0:6464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7842854 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.690991:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7842854 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.691009:0:6464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790773222.691079:0:6464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14480f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:110130ab-04fa-4d7c-984e-562032df4432+60:2398:x1877761484489216:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 168us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773222.691087:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 99 00010000:00010000:2.0:1790773222.693476:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7842838 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bee2 expref: 59 pid: 14584 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773222.693507:0:6478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144545500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1877761496068992:192.168.202.19@tcp:104: 00010000:00010000:2.0:1790773222.693538:0:6478:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7842854 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.693549:0:6478:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7842854 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.693555:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7842854 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790773222.693579:0:6478:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1790773222.693723:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5c00/0xabf1cc0bc784284d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bee9 expref: 60 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.693738:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7842854 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bee9 expref: 59 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.693747:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93d26ede0100) 00010000:00010000:2.0:1790773222.693750:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790773222.693753:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26efc5800, rc 0) 00000100:00100000:2.0:1790773222.693813:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+59:12417:x1877761484489088:12345-192.168.202.19@tcp:101:bash.0 Request processed in 14724us (14900us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1790773222.693822:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 222 00000100:00100000:3.0:1790773222.696903:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773222.696999:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484489344 00000100:00100000:0.0:1790773222.697009:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484489344 00000100:00100000:0.0:1790773222.697067:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 223 00000100:00100000:0.0:1790773222.697078:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14480c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+59:12417:x1877761484489344:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:0.0:1790773222.697103:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773222.697132:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc7842862 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bef0 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.697166:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc7842869 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.697180:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc7842869 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.697434:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc7842869 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.697557:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc7842862 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bef0 expref: 61 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.697576:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc7842869 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bef0 expref: 60 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.697585:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93d26ede0100) 00010000:00010000:0.0:1790773222.697588:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790773222.697592:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074be00, rc 0) 00000100:00100000:0.0:1790773222.697659:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14480c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+60:12417:x1877761484489344:12345-192.168.202.19@tcp:101:bash.0 Request processed in 582us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773222.697667:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 223 00000100:00100000:1.0:1790773222.701853:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773222.702347:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484489600 00000100:00100000:0.0:1790773222.702358:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484489600 00000100:00100000:0.0:1790773222.702430:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 224 00000100:00100000:0.0:1790773222.702440:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+60:12417:x1877761484489600:12345-192.168.202.19@tcp:36:bash.0 00010000:00010000:0.0:1790773222.702650:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7842870 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.702664:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7842870 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.702672:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7842870 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790773222.702702:0:6479:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:0.0:1790773222.702715:0:6479:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000012d5f1da reply state 000000003b8ab999 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7842870 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.702723:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7842870 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.702729:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93d26ede0100) 00010000:00010000:0.0:1790773222.702731:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790773222.702733:0:6479:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790773222.702803:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+63:12417:x1877761484489600:12345-192.168.202.19@tcp:36:bash.0 Request processed in 364us (960us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1790773222.702810:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 224 00000020:00080000:0.0:1790773222.702814:0:6479:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1790773222.705605:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773222.705784:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484489728 00000100:00100000:3.0:1790773222.705795:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484489728 00000100:00100000:3.0:1790773222.705851:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 225 00000100:00100000:3.0:1790773222.705861:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144545500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+63:12417:x1877761484489728:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:3.0:1790773222.705884:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773222.705905:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7842877 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bef7 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.705997:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc784287e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.706012:0:6480:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7842854 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bee9 expref: 64 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.706022:0:6480:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc784287e lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.706057:0:6480:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7842854 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bee9 expref: 64 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.706070:0:6480:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7842854 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bee9 expref: 64 pid: 6478 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773222.706083:0:6480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14480d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6480:1877761496069120:192.168.202.19@tcp:104: 00000100:00100000:3.0:1790773222.706302:0:6480:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d14306df00 going to sleep for 11 seconds 00000100:00100000:3.0:1790773222.709086:0:6480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14480d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6480:1877761496069120:192.168.202.19@tcp:104: 00010000:00010000:3.0:1790773222.709140:0:6480:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc784287e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773222.715356:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773222.715547:0:10300:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484489856 00000100:00100000:2.0:1790773222.715558:0:10300:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484489856 00010000:00010000:2.0:1790773222.715597:0:10300:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7842854 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bee9 expref: 65 pid: 6478 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773222.715637:0:10300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 100 00000100:00100000:2.0:1790773222.715647:0:10300:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:110130ab-04fa-4d7c-984e-562032df4432+65:2397:x1877761484489856:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790773222.715663:0:10300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790773222.715669:0:10300:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7842854 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bee9 expref: 65 pid: 6478 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.715682:0:10300:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7842854 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bee9 expref: 65 pid: 6478 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.715702:0:10300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc7842854 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bee9 expref: 65 pid: 6478 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.715733:0:10300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93d26ede0100) 00010000:00010000:2.0:1790773222.715738:0:10300:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc784287e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.715747:0:10300:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc784287e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.715754:0:10300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc784287e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.715784:0:10300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790773222.715829:0:10300:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:110130ab-04fa-4d7c-984e-562032df4432+64:2397:x1877761484489856:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 183us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773222.715837:0:10300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 100 00010000:00010000:3.0:1790773222.715903:0:6480:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc784287e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.715913:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc784287e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790773222.715966:0:6480:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1790773222.715971:0:6480:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790773222.715991:0:6480:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc784287e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.716020:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7842877 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bef7 expref: 64 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.716038:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc784287e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bef7 expref: 63 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.716045:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93d26ede0100) 00010000:00010000:3.0:1790773222.716047:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790773222.716049:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d1434ac200, rc 0) 00000100:00100000:3.0:1790773222.716088:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144545500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+63:12417:x1877761484489728:12345-192.168.202.19@tcp:101:bash.0 Request processed in 10229us (10491us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773222.716095:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 225 00000100:00100000:1.0:1790773222.731398:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773222.731588:0:6482:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484490112 00000100:00100000:2.0:1790773222.731599:0:6482:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484490112 00000100:00100000:2.0:1790773222.731656:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 59 00000100:00100000:2.0:1790773222.731666:0:6482:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+63:12417:x1877761484490112:12345-192.168.202.19@tcp:35:bash.0 00000100:00100000:2.0:1790773222.731881:0:6482:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+64:12417:x1877761484490112:12345-192.168.202.19@tcp:35:bash.0 Request processed in 216us (492us total) trans 4294967503 rc 0/0 00000100:00100000:2.0:1790773222.731890:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 59 00000100:00100000:2.0:1790773222.840365:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773222.840475:0:14584:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484490240 00000100:00100000:1.0:1790773222.840486:0:14584:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484490240 00000100:00100000:1.0:1790773222.840545:0:14584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 226 00000100:00100000:1.0:1790773222.840553:0:14584:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144544380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:110130ab-04fa-4d7c-984e-562032df4432+64:12424:x1877761484490240:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1790773222.840575:0:14584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773222.840593:0:14584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc7842885 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6befe expref: -99 pid: 14584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773222.840644:0:14584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b400/0xabf1cc0bc784288c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773222.840654:0:14584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b400/0xabf1cc0bc784288c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773222.840662:0:14584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b400/0xabf1cc0bc784288c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790773222.840697:0:14584:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1790773222.840700:0:14584:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790773222.840714:0:14584:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b400/0xabf1cc0bc784288c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773222.840746:0:14584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc7842885 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6befe expref: 66 pid: 14584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773222.840758:0:14584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b400/0xabf1cc0bc784288c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6befe expref: 65 pid: 14584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773222.840765:0:14584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93d26ede0c00) 00010000:00010000:1.0:1790773222.840767:0:14584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790773222.840769:0:14584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12b400, rc 0) 00000100:00100000:1.0:1790773222.840819:0:14584:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144544380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:110130ab-04fa-4d7c-984e-562032df4432+65:12424:x1877761484490240:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 268us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773222.840823:0:14584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 226 00000100:00100000:0.0:1790773222.844722:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773222.844991:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484490368 00000100:00100000:3.0:1790773222.845001:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484490368 00000100:00100000:3.0:1790773222.845058:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 227 00000100:00100000:3.0:1790773222.845068:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+65:12424:x1877761484490368:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:3.0:1790773222.845115:0:8697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773222.845135:0:8697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7842893 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bf05 expref: -99 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.845449:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc784289a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.845468:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc784289a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.845481:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc784289a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.845494:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc78428a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.845502:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc78428a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.845508:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc78428a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.845581:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc78428a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.845590:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc78428a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.845597:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc78428a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790773222.845637:0:8697:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1790773222.845647:0:8697:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790773222.845669:0:8697:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc78428a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.845680:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc78428a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.845687:0:8697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc784289a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.845694:0:8697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc784289a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.845700:0:8697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc784289a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.845707:0:8697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ace00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773222.845711:0:8697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc784289a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.845720:0:8697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc784289a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.845731:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93d26ede0c00) 00010000:00010000:3.0:1790773222.845734:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790773222.845739:0:8697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc784289a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.845746:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ace00/0xabf1cc0bc784289a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.845762:0:8697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc78428a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.845779:0:8697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc78428a1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.845786:0:8697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc78428a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.845791:0:8697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ade00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773222.845794:0:8697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc78428a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.845801:0:8697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc78428a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.845809:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93d255bad500) 00010000:00010000:3.0:1790773222.845812:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790773222.845815:0:8697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc78428a1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.845821:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc78428a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.845847:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7842893 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf05 expref: 67 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.845860:0:8697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc78428a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf05 expref: 66 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.845867:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93d26ede0100) 00010000:00010000:3.0:1790773222.845870:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790773222.845877:0:8697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d1434ad400, rc 0) 00000100:00100000:3.0:1790773222.845946:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+66:12424:x1877761484490368:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 879us (1233us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773222.845954:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 227 00000100:00100000:2.0:1790773222.857716:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773222.857785:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773222.857873:0:6463:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484490752 00000100:00100000:3.0:1790773222.857884:0:6463:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484490752 00000100:00100000:3.0:1790773222.857961:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:3.0:1790773222.857971:0:6463:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d255828c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:110130ab-04fa-4d7c-984e-562032df4432+66:2398:x1877761484490752:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790773222.857988:0:6463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773222.858013:0:6463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc78428a8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf05 expref: 66 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773222.858035:0:6463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93d26ede0100) 00010000:00010000:3.0:1790773222.858041:0:6463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790773222.858113:0:6463:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d255828c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:110130ab-04fa-4d7c-984e-562032df4432+65:2398:x1877761484490752:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 143us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773222.858121:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:0.0:1790773222.858828:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484490624 00000100:00100000:0.0:1790773222.858837:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484490624 00000100:00100000:0.0:1790773222.858881:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 228 00000100:00100000:0.0:1790773222.858891:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144547100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+65:12424:x1877761484490624:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:0.0:1790773222.858910:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773222.858925:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc78428af lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bf0c expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.859024:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc78428b6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.859039:0:6478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc784287e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bef7 expref: 66 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.859049:0:6478:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc78428b6 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.859093:0:6478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc784287e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bef7 expref: 66 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.859114:0:6478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc784287e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bef7 expref: 66 pid: 6480 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773222.859128:0:6478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1877761496069248:192.168.202.19@tcp:104: 00000100:00100000:0.0:1790773222.859377:0:6478:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d141fd2000 going to sleep for 11 seconds 00000100:00100000:2.0:1790773222.877629:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773222.877720:0:8410:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484490880 00000100:00100000:1.0:1790773222.877729:0:8410:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484490880 00010000:00010000:1.0:1790773222.877770:0:8410:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc784287e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bef7 expref: 67 pid: 6480 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773222.877811:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 101 00000100:00100000:1.0:1790773222.877821:0:8410:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144544000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:110130ab-04fa-4d7c-984e-562032df4432+67:2397:x1877761484490880:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790773222.877837:0:8410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790773222.877844:0:8410:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc784287e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bef7 expref: 67 pid: 6480 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773222.877858:0:8410:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc784287e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bef7 expref: 67 pid: 6480 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773222.877902:0:8410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93d26ede0100) 00010000:00010000:1.0:1790773222.877908:0:8410:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc78428b6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773222.877918:0:8410:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc78428b6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773222.877927:0:8410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc78428b6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773222.877946:0:8410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790773222.878006:0:8410:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144544000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:110130ab-04fa-4d7c-984e-562032df4432+67:2397:x1877761484490880:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 186us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773222.878014:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 101 00010000:00010000:0.0:1790773222.879028:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac200/0xabf1cc0bc784287e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bef7 expref: 66 pid: 6480 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773222.879072:0:6478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1877761496069248:192.168.202.19@tcp:104: 00010000:00010000:0.0:1790773222.879114:0:6478:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc78428b6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.879125:0:6478:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc78428b6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.879132:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc78428b6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790773222.879153:0:6478:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1790773222.879585:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc78428af lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf0c expref: 67 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.879603:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc78428b6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf0c expref: 66 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.879613:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93d26ede0100) 00010000:00010000:0.0:1790773222.879616:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790773222.879619:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074bc00, rc 0) 00000100:00100000:0.0:1790773222.879682:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144547100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+66:12424:x1877761484490624:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 20792us (21977us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1790773222.879691:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 228 00000100:00100000:2.0:1790773222.887031:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773222.890589:0:6465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484491136 00000100:00100000:1.0:1790773222.890605:0:6465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484491136 00000100:00100000:1.0:1790773222.890683:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 18 00000100:00100000:1.0:1790773222.890693:0:6465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144545180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:110130ab-04fa-4d7c-984e-562032df4432+66:12424:x1877761484491136:12345-192.168.202.19@tcp:103:lfs.0 00010000:00010000:1.0:1790773222.890707:0:6465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790773222.890731:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc7842807 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bedb expref: 66 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773222.890752:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93d26ede0100) 00010000:00010000:1.0:1790773222.890756:0:6465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790773222.890837:0:6465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144545180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:110130ab-04fa-4d7c-984e-562032df4432+65:12424:x1877761484491136:12345-192.168.202.19@tcp:103:lfs.0 Request processed in 146us (3816us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773222.890845:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 18 00000100:00100000:1.0:1790773222.893666:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773222.893787:0:14584:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484491264 00000100:00100000:2.0:1790773222.893811:0:14584:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484491264 00000100:00100000:2.0:1790773222.893870:0:14584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 229 00000100:00100000:2.0:1790773222.893880:0:14584:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:110130ab-04fa-4d7c-984e-562032df4432+65:12424:x1877761484491264:12345-192.168.202.19@tcp:58:lfs.0 00010000:00010000:2.0:1790773222.894006:0:14584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc78428c4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.894026:0:14584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc78428c4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773222.894038:0:14584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc78428c4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790773222.894148:0:14584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1790773222.894264:0:14584:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:110130ab-04fa-4d7c-984e-562032df4432+65:12424:x1877761484491264:12345-192.168.202.19@tcp:58:lfs.0 Request processed in 385us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773222.894273:0:14584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 229 00000100:00100000:2.0:1790773222.897364:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773222.907626:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484491392 00000100:00100000:0.0:1790773222.907640:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484491392 00000100:00100000:0.0:1790773222.907716:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 230 00000100:00100000:0.0:1790773222.907726:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144545c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+65:12424:x1877761484491392:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:0.0:1790773222.907764:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773222.907786:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc78428cb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bf13 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.907842:0:6479:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc78428c4 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.907855:0:6479:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc78428cb lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf13 expref: 66 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.907875:0:6479:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc78428c4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.907889:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc78428cb lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf13 expref: 66 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.907904:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93d26ede0100) 00010000:00010000:0.0:1790773222.907907:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790773222.907911:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc78428cb lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf13 expref: 66 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773222.907920:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074b000, rc 0) 00000100:00100000:0.0:1790773222.907977:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144545c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+66:12424:x1877761484491392:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 251us (10623us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773222.907985:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 230 00010000:00010000:1.0:1790773223.246801:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1790773223.248347:0:8388:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:3.0:1790773223.248360:0:8388:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000040:00080000:1.0:1790773223.437446:0:13749:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790773223.437457:0:13749:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790773223.437511:0:13749:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1790773223.437521:0:13749:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790773223.437653:0:13749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445dea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13749:1877761496069376:192.168.202.19@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790773223.437751:0:13749:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279ed9300 going to sleep for 11 seconds 00000100:00100000:1.0:1790773223.440549:0:13749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445dea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13749:1877761496069376:192.168.202.19@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790773223.442520:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773223.443858:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484491520 00000100:00100000:3.0:1790773223.443871:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484491520 00000100:00100000:3.0:1790773223.443985:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 231 00000100:00100000:3.0:1790773223.443996:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+66:12426:x1877761484491520:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790773223.444027:0:6480:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790773223.444161:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+66:12426:x1877761484491520:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 Request processed in 166us (1649us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773223.444169:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 231 00000100:00100000:2.0:1790773223.446726:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773223.447166:0:14584:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484491648 00000100:00100000:1.0:1790773223.447176:0:14584:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484491648 00000100:00100000:1.0:1790773223.447270:0:14584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 232 00000100:00100000:1.0:1790773223.447280:0:14584:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144545880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:110130ab-04fa-4d7c-984e-562032df4432+66:12426:x1877761484491648:12345-192.168.202.19@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1790773223.447358:0:14584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc78428d2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.447377:0:14584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc78428d2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.447389:0:14584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc78428d2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.447400:0:14584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc78428d9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.447417:0:14584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc78428d9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.447424:0:14584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc78428d9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.447475:0:14584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc78428e0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.447484:0:14584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc78428e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.447490:0:14584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc78428e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790773223.447556:0:14584:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1790773223.447561:0:14584:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790773223.447575:0:14584:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc78428e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.447586:0:14584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc78428d2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.447593:0:14584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc78428d2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.447600:0:14584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc78428d2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.447606:0:14584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12b600 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773223.447610:0:14584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc78428d2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.447616:0:14584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc78428d2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.447628:0:14584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93d26ede0500) 00010000:00010000:1.0:1790773223.447636:0:14584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790773223.447642:0:14584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc78428d2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.447647:0:14584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc78428d2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.447662:0:14584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc78428d9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.447667:0:14584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc78428d9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.447672:0:14584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc78428d9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.447677:0:14584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12b200 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773223.447679:0:14584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc78428d9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.447685:0:14584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc78428d9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.447692:0:14584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff93d14363dc00) 00010000:00010000:1.0:1790773223.447694:0:14584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790773223.447696:0:14584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc78428d9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.447701:0:14584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc78428d9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.447715:0:14584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc78428e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.447726:0:14584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc78428e0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.447732:0:14584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc78428e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.447736:0:14584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12ba00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773223.447739:0:14584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc78428e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.447744:0:14584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc78428e0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.447752:0:14584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93d26ede0100) 00010000:00010000:1.0:1790773223.447755:0:14584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790773223.447758:0:14584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc78428e0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.447763:0:14584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc78428e0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773223.447842:0:14584:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144545880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:110130ab-04fa-4d7c-984e-562032df4432+66:12426:x1877761484491648:12345-192.168.202.19@tcp:34:lhsmtool_posix.0 Request processed in 563us (1125us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773223.447850:0:14584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 232 00000100:00100000:2.0:1790773223.451930:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773223.452037:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484491904 00000100:00100000:0.0:1790773223.452046:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484491904 00000100:00100000:0.0:1790773223.452109:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 233 00000100:00100000:0.0:1790773223.452134:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d246ad5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+66:12426:x1877761484491904:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790773223.452164:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773223.452182:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc78428e7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bf1a expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.452417:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc78428ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.452501:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc78428ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.452515:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc78428ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790773223.452527:0:6479:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1790773223.452709:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc78428ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.452717:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc78428ee lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.452724:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc78428ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.452729:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074aa00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773223.452733:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc78428ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.452740:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc78428ee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.452752:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93d26ede0100) 00010000:00010000:0.0:1790773223.452762:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790773223.452767:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc78428ee lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.452773:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc78428ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.452815:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc78428e7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf1a expref: 68 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.452826:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93d26ede0500) 00010000:00010000:0.0:1790773223.452828:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790773223.452833:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc78428e7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf1a expref: 68 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.452840:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074b200, rc 0) 00000100:00100000:0.0:1790773223.453146:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d246ad5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+67:12426:x1877761484491904:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 1013us (1223us total) trans 4294967505 rc 301/301 00000100:00100000:0.0:1790773223.453159:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 233 00000100:00100000:2.0:1790773223.457777:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773223.457868:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484492032 00000100:00100000:0.0:1790773223.457878:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484492032 00000100:00100000:0.0:1790773223.457969:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 234 00000100:00100000:0.0:1790773223.457979:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144546a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+67:12426:x1877761484492032:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790773223.458019:0:6478:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790773223.458146:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144546a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+67:12426:x1877761484492032:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 Request processed in 167us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773223.458154:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 234 00000100:00100000:2.0:1790773223.460602:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773223.460797:0:14584:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484492288 00000100:00100000:1.0:1790773223.460805:0:14584:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484492288 00000100:00100000:1.0:1790773223.460852:0:14584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 235 00000100:00100000:1.0:1790773223.460863:0:14584:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144545f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:110130ab-04fa-4d7c-984e-562032df4432+67:12426:x1877761484492288:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790773223.460885:0:14584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773223.460909:0:14584:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1790773223.460932:0:14584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b400/0xabf1cc0bc784288c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6befe expref: 67 pid: 14584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.460946:0:14584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93d26ede0c00) 00010000:00010000:1.0:1790773223.460950:0:14584:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790773223.460959:0:14584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc78428fc lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bf21 expref: -99 pid: 14584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790773223.461334:0:14584:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:1.0:1790773223.461470:0:14584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc7842903 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.461483:0:14584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc7842903 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.461492:0:14584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc7842903 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.461544:0:14584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc78428fc lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf21 expref: 69 pid: 14584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.461558:0:14584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc7842903 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf21 expref: 68 pid: 14584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.461565:0:14584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93d14363dc00) 00010000:00010000:1.0:1790773223.461567:0:14584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790773223.461569:0:14584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12b200, rc 0) 00000100:00100000:1.0:1790773223.461623:0:14584:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144545f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:110130ab-04fa-4d7c-984e-562032df4432+68:12426:x1877761484492288:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 762us (1032us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1790773223.461640:0:14584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 235 00000100:00100000:2.0:1790773223.466624:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773223.468655:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484492544 00000100:00100000:0.0:1790773223.468686:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484492544 00000100:00100000:2.0:1790773223.468929:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773223.469151:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 236 00000100:00100000:0.0:1790773223.469175:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144544700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+68:12426:x1877761484492544:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790773223.469272:0:8697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773223.469301:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b200/0xabf1cc0bc7842903 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf21 expref: 68 pid: 14584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.469322:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93d14363dc00) 00010000:00010000:0.0:1790773223.469333:0:8697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790773223.469356:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842911 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.469370:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842911 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.469380:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842911 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.469452:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc7842918 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x2552063b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.469461:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc7842918 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x2552063b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.469467:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc7842918 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x2552063b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.469518:0:8697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842911 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.469526:0:8697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842911 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.469549:0:8697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842911 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.469553:0:8697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074b200 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773223.469556:0:8697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842911 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.469561:0:8697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842911 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.469567:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93d26ede0c00) 00010000:00010000:0.0:1790773223.469569:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773223.469571:0:8697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842911 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.469575:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b200/0xabf1cc0bc7842911 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.469582:0:8697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc7842918 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x2552063b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.469586:0:8697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc7842918 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x2552063b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.469589:0:8697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc7842918 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x2552063b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.469592:0:8697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074aa00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773223.469594:0:8697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc7842918 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x2552063b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.469604:0:8697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc7842918 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x2552063b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.469609:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x2552063b (ffff93d26ede0e00) 00010000:00010000:0.0:1790773223.469610:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773223.469612:0:8697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc7842918 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x2552063b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.469615:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074aa00/0xabf1cc0bc7842918 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x2552063b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773223.469688:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144544700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+67:12426:x1877761484492544:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 518us (3075us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790773223.469693:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 236 00000100:00100000:1.0:1790773223.469990:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484492672 00000100:00100000:1.0:1790773223.469998:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484492672 00000100:00100000:1.0:1790773223.470044:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 391 00000100:00100000:1.0:1790773223.470053:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:2397:x1877761484492672:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773223.470089:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:2397:x1877761484492672:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 38us (1164us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773223.470096:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 391 00000100:00100000:1.0:1790773223.472328:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773223.472442:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773223.472471:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773223.472494:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773223.472512:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773223.472534:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773223.472560:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484493184 00000100:00100000:1.0:1790773223.472568:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484493184 00000100:00100000:1.0:1790773223.472620:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484492800 00000100:00100000:1.0:1790773223.472624:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484492800 00000100:00100000:1.0:1790773223.472637:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484493312 00000100:00100000:1.0:1790773223.472640:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484493312 00000100:00100000:1.0:1790773223.472653:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484493440 00000100:00100000:1.0:1790773223.472656:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484493440 00000100:00100000:1.0:1790773223.472671:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 320 00000100:00100000:1.0:1790773223.472681:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2397:x1877761484493184:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773223.472750:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2397:x1877761484493184:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 70us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773223.472758:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 320 00000100:00100000:1.0:1790773223.472804:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 321 00000100:00100000:1.0:1790773223.472810:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+5:2397:x1877761484492800:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773223.472851:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+5:2397:x1877761484492800:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 41us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773223.472857:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 321 00000100:00100000:1.0:1790773223.472870:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 322 00000100:00100000:1.0:1790773223.472876:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2397:x1877761484493312:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773223.472901:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2397:x1877761484493312:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 25us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773223.472907:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 322 00000100:00100000:1.0:1790773223.472920:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 237 00000100:00100000:1.0:1790773223.472926:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+67:12426:x1877761484493440:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00000100:00100000:3.0:1790773223.472936:0:8394:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484492928 00010000:00010000:1.0:1790773223.472937:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790773223.472941:0:8394:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484492928 00010000:00010000:1.0:1790773223.472959:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b400/0xabf1cc0bc784291f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bf28 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773223.472964:0:8394:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484493056 00000100:00100000:3.0:1790773223.472967:0:8394:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484493056 00000100:00100000:3.0:1790773223.472983:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 123 00000100:00100000:3.0:1790773223.472989:0:8394:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:110130ab-04fa-4d7c-984e-562032df4432+5:2397:x1877761484492928:12345-192.168.202.19@tcp:400:kworker.0 00010000:00010000:1.0:1790773223.472994:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7842926 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.473007:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7842926 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773223.473013:0:8394:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:110130ab-04fa-4d7c-984e-562032df4432+5:2397:x1877761484492928:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 26us (698us total) trans 0 rc 0/0 00010000:00010000:1.0:1790773223.473018:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7842926 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773223.473019:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 123 00000100:00100000:3.0:1790773223.473030:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 124 00000100:00100000:3.0:1790773223.473035:0:8394:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:110130ab-04fa-4d7c-984e-562032df4432+9:2397:x1877761484493056:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1790773223.473057:0:8394:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:110130ab-04fa-4d7c-984e-562032df4432+9:2397:x1877761484493056:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 21us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773223.473062:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 124 00010000:00010000:1.0:1790773223.473120:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b400/0xabf1cc0bc784291f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf28 expref: 69 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.473153:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7842926 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf28 expref: 68 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.473163:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93d14363d900) 00010000:00010000:1.0:1790773223.473166:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790773223.473170:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12b600, rc 0) 00000100:00100000:1.0:1790773223.473237:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+68:12426:x1877761484493440:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 279us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773223.473244:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 237 00000100:00080000:1.0:1790773223.473263:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790773223.473268:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790773223.473270:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790773223.480835:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773223.480883:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484493696 00000100:00100000:3.0:1790773223.480894:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484493696 00000100:00100000:3.0:1790773223.480964:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 238 00000100:00100000:3.0:1790773223.480974:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144546300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+68:12426:x1877761484493696:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790773223.481060:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc784292d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773223.481090:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc784292d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773223.481102:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc784292d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790773223.481399:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:1.0:1790773223.481422:0:6479:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 366283217213ns, next at 367283213970ns, rc = 0 00000004:00010000:1.0:1790773223.482045:0:6479:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000009c2d7332 reply state 0000000000fec09d transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc784292d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.482059:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc784292d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.482065:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93d14363d900) 00010000:00010000:1.0:1790773223.482068:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1790773223.482070:0:6479:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790773223.482270:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144546300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+70:12426:x1877761484493696:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 1295us (1441us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1790773223.482279:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 238 00000100:00100000:1.0:1790773223.486365:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773223.486441:0:14584:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484493824 00000100:00100000:2.0:1790773223.486452:0:14584:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484493824 00000100:00100000:2.0:1790773223.486519:0:14584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 239 00000100:00100000:2.0:1790773223.486529:0:14584:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:110130ab-04fa-4d7c-984e-562032df4432+70:12426:x1877761484493824:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790773223.486556:0:14584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773223.486583:0:14584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7842934 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bf2f expref: -99 pid: 14584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773223.486644:0:14584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7842934 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf2f expref: 71 pid: 14584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773223.486659:0:14584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7842934 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf2f expref: 71 pid: 14584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773223.486678:0:14584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93d14363d900) 00010000:00010000:2.0:1790773223.486681:0:14584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790773223.486686:0:14584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26efc5600, rc 0) 00000100:00100000:2.0:1790773223.487035:0:14584:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:110130ab-04fa-4d7c-984e-562032df4432+71:12426:x1877761484493824:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 506us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773223.487043:0:14584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 239 00000100:00100000:2.0:1790773223.490146:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773223.490357:0:8393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484493952 00000100:00100000:0.0:1790773223.490369:0:8393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484493952 00000100:00100000:0.0:1790773223.490440:0:8393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 70 00000100:00100000:0.0:1790773223.490451:0:8393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:110130ab-04fa-4d7c-984e-562032df4432+9:2398:x1877761484493952:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1790773223.490736:0:8393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:110130ab-04fa-4d7c-984e-562032df4432+10:2398:x1877761484493952:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 Request processed in 286us (648us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1790773223.490745:0:8393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 70 00000100:00100000:0.0:1790773223.492496:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773223.492558:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484494208 00000100:00100000:3.0:1790773223.492581:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484494208 00000100:00100000:3.0:1790773223.492626:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 60 00000100:00100000:3.0:1790773223.492635:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:110130ab-04fa-4d7c-984e-562032df4432+71:12426:x1877761484494208:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1790773223.492806:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:110130ab-04fa-4d7c-984e-562032df4432+72:12426:x1877761484494208:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 Request processed in 172us (316us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1790773223.492814:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 60 00000100:00100000:1.0:1790773223.494497:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773223.494676:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484494464 00000100:00100000:0.0:1790773223.494685:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484494464 00000100:00100000:0.0:1790773223.494782:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 240 00000100:00100000:0.0:1790773223.494792:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+72:12426:x1877761484494464:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790773223.494916:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+72:12426:x1877761484494464:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 124us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773223.494925:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 240 00000100:00100000:2.0:1790773223.497723:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773223.497806:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484494592 00000100:00100000:1.0:1790773223.497817:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484494592 00000100:00100000:1.0:1790773223.497883:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 241 00000100:00100000:1.0:1790773223.497893:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144544e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+72:12426:x1877761484494592:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790773223.497914:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773223.497937:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc784293b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bf36 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.498010:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc7842942 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.498024:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc7842942 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.498034:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc7842942 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790773223.498081:0:6480:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790773223.498114:0:6480:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc7842942 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.498141:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc784293b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf36 expref: 74 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.498170:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc7842942 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf36 expref: 73 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.498179:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93d14363d900) 00010000:00010000:1.0:1790773223.498183:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1790773223.498200:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12a800, rc 0) 00000100:00100000:1.0:1790773223.498294:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144544e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+73:12426:x1877761484494592:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 402us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773223.498302:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 241 00000100:00100000:2.0:1790773223.501746:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773223.502241:0:8392:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484494720 00000100:00100000:1.0:1790773223.502251:0:8392:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484494720 00000100:00100000:1.0:1790773223.502294:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 71 00000100:00100000:1.0:1790773223.502301:0:8392:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144547800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:110130ab-04fa-4d7c-984e-562032df4432+10:2398:x1877761484494720:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790773223.502319:0:8392:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773223.502335:0:8392:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7ed604b/0xabf1cc0bc7842949 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bf3d expref: -99 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790773223.502362:0:8392:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abd07e7, blocks: 0x0 00010000:00010000:1.0:1790773223.502383:0:8392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=366s v=(0 0) 00010000:00010000:1.0:1790773223.502388:0:8392:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790773223.502397:0:8392:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7ed604b/0xabf1cc0bc7842949 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf3d expref: 11 pid: 8392 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.502426:0:8392:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d7ed604b/0xabf1cc0bc7842949 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf3d expref: 11 pid: 8392 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.502440:0:8392:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12bc00, rc 0) 00000100:00100000:1.0:1790773223.502507:0:8392:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144547800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:110130ab-04fa-4d7c-984e-562032df4432+11:2398:x1877761484494720:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 205us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773223.502514:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 71 00000100:00100000:1.0:1790773223.509386:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773223.509568:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484494976 00000100:00100000:0.0:1790773223.509578:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484494976 00000100:00100000:0.0:1790773223.509641:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 242 00000100:00100000:0.0:1790773223.509652:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+73:12426:x1877761484494976:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790773223.509763:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+73:12426:x1877761484494976:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 113us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773223.509772:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 242 00000100:00100000:3.0:1790773223.511792:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773223.511859:0:8906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484495104 00000100:00100000:2.0:1790773223.511867:0:8906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484495104 00000100:00100000:2.0:1790773223.511904:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 72 00000100:00100000:2.0:1790773223.511913:0:8906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14480fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:110130ab-04fa-4d7c-984e-562032df4432+11:12426:x1877761484495104:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790773223.511929:0:8906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773223.511946:0:8906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1f867cc/0xabf1cc0bc7842950 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bf44 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773223.511975:0:8906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d7ed604b/0xabf1cc0bc7842949 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf3d expref: 12 pid: 8392 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773223.512003:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790773223.512007:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790773223.512013:0:8906:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1f867cc/0xabf1cc0bc7842950 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf44 expref: 12 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773223.512049:0:8906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d7ed604b/0xabf1cc0bc7842949 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf3d expref: 12 pid: 8392 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773223.512063:0:8906:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d7ed604b/0xabf1cc0bc7842949 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf3d expref: 12 pid: 8392 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773223.512077:0:8906:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144546680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8906:1877761496069504:192.168.202.19@tcp:104: 00000100:00100000:2.0:1790773223.512171:0:8906:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279e963c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790773223.514661:0:8906:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144546680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8906:1877761496069504:192.168.202.19@tcp:104: 00010000:00010000:2.0:1790773223.514704:0:8906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f1f867cc/0xabf1cc0bc7842950 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf44 expref: 12 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773223.514722:0:8906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26efc4c00, rc 0) 00000100:00100000:2.0:1790773223.514851:0:8906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14480fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:110130ab-04fa-4d7c-984e-562032df4432+12:12426:x1877761484495104:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 2938us (3063us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773223.514860:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 72 00000100:00100000:2.0:1790773223.522519:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773223.522659:0:6464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484495232 00000100:00100000:1.0:1790773223.522668:0:6464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484495232 00010000:00010000:1.0:1790773223.522704:0:6464:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d7ed604b/0xabf1cc0bc7842949 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf3d expref: 12 pid: 8392 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773223.522739:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 102 00000100:00100000:1.0:1790773223.522749:0:6464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144546680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:110130ab-04fa-4d7c-984e-562032df4432+12:2398:x1877761484495232:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790773223.522765:0:6464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790773223.522785:0:6464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d7ed604b/0xabf1cc0bc7842949 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf3d expref: 12 pid: 8392 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.522795:0:6464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d7ed604b/0xabf1cc0bc7842949 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf3d expref: 12 pid: 8392 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.522814:0:6464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7ed604b/0xabf1cc0bc7842949 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf3d expref: 12 pid: 8392 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.522826:0:6464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790773223.522829:0:6464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790773223.522834:0:6464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1f867cc/0xabf1cc0bc7842950 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf44 expref: 11 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.522841:0:6464:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1f867cc/0xabf1cc0bc7842950 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf44 expref: 11 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.522870:0:6464:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f1f867cc/0xabf1cc0bc7842950 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf44 expref: 11 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773223.522894:0:6464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445dea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6464:1877761496069632:192.168.202.19@tcp:105: 00000100:00100000:1.0:1790773223.522969:0:6464:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279ed9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790773223.525898:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773223.525985:0:8400:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484495360 00000100:00100000:1.0:1790773223.525993:0:8400:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484495360 00002000:00100000:1.0:1790773223.526039:0:8400:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff93d144545500 x1877761484495360/t0(0) o4->110130ab-04fa-4d7c-984e-562032df4432@192.168.202.19@tcp:59/0 lens 504/0 e 0 to 0 dl 1790773234 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790773223.526049:0:8400:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93d144545500 with x1877761484495360 ext(0->12) 00002000:00010000:1.0:1790773223.526055:0:8400:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93d144545500 00000100:00100000:1.0:1790773223.526086:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:1.0:1790773223.526101:0:8400:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:110130ab-04fa-4d7c-984e-562032df4432+12:2397:x1877761484495360:12345-192.168.202.19@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1790773223.526335:0:6464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445dea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6464:1877761496069632:192.168.202.19@tcp:105: 00010000:00010000:0.0:1790773223.526355:0:6464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790773223.526397:0:6464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144546680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:110130ab-04fa-4d7c-984e-562032df4432+12:2398:x1877761484495232:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 3650us (3888us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773223.526419:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 102 00000100:00100000:1.0:1790773223.527454:0:8400:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:110130ab-04fa-4d7c-984e-562032df4432+13:2397:x1877761484495360:12345-192.168.202.19@tcp:4:lhsmtool_posix.0 Request processed in 1356us (1561us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1790773223.527464:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 6 00002000:00100000:1.0:1790773223.527474:0:8400:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff93d144545500 x1877761484495360/t4294967321(0) o4->110130ab-04fa-4d7c-984e-562032df4432@192.168.202.19@tcp:59/0 lens 504/448 e 0 to 0 dl 1790773234 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790773223.527484:0:8400:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93d144545500 with x1877761484495360 ext(0->12) 00002000:00010000:1.0:1790773223.527489:0:8400:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93d144545500 00000100:00100000:3.0:1790773223.532081:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773223.532249:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484495488 00000100:00100000:0.0:1790773223.532260:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484495488 00000100:00100000:0.0:1790773223.532313:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 243 00000100:00100000:0.0:1790773223.532323:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14480f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+73:12426:x1877761484495488:12345-192.168.202.19@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1790773223.537746:0:6457:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:1.0:1790773223.537762:0:6457:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:1.0:1790773223.537795:0:6457:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:1.0:1790773223.537810:0:6457:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93d14306d3c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1790773223.537814:0:6457:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93d242bcdd00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93d14306d540 00000020:00080000:1.0:1790773223.537816:0:6457:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93d242bcd900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93d1434b2200 00000004:00080000:1.0:1790773223.537845:0:6457:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:1.0:1790773223.537863:0:6457:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93d143779000 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1790773223.537864:0:6457:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93d27c3b9200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93d143779900 00000020:00080000:1.0:1790773223.537866:0:6457:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93d27c3b9b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93d144420000 00010000:00010000:0.0:1790773223.538115:0:3590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc7842655 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.538128:0:3590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc7842655 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.538136:0:3590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc7842655 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.538150:0:3590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ad200 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773223.538155:0:3590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc7842655 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.538163:0:3590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc7842655 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.538181:0:3590:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93d28095b300) 00010000:00010000:0.0:1790773223.538184:0:3590:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773223.538188:0:3590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc7842655 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.538195:0:3590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad200/0xabf1cc0bc7842655 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.538279:0:3590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc78426fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.538284:0:3590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc78426fd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.538288:0:3590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc78426fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.538291:0:3590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074a800 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773223.538294:0:3590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc78426fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.538300:0:3590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc78426fd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.538313:0:3590:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff93d255bad900) 00010000:00010000:0.0:1790773223.538314:0:3590:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773223.538317:0:3590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc78426fd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.538323:0:3590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a800/0xabf1cc0bc78426fd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.538335:0:3590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc784277b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.538339:0:3590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc784277b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.538343:0:3590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc784277b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.538347:0:3590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc4200 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773223.538350:0:3590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc784277b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.538355:0:3590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc784277b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.538361:0:3590:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93d255bad500) 00010000:00010000:0.0:1790773223.538363:0:3590:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773223.538366:0:3590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc784277b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.538372:0:3590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc784277b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.538388:0:3590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4600/0xabf1cc0bc784279e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.538394:0:3590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4600/0xabf1cc0bc784279e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.538400:0:3590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4600/0xabf1cc0bc784279e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.538416:0:3590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc4600 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773223.538420:0:3590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4600/0xabf1cc0bc784279e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.538426:0:3590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4600/0xabf1cc0bc784279e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.538442:0:3590:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93d255bad500) 00010000:00010000:0.0:1790773223.538445:0:3590:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773223.538448:0:3590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4600/0xabf1cc0bc784279e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.538454:0:3590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4600/0xabf1cc0bc784279e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.538470:0:3590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7842870 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.538481:0:3590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7842870 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.538487:0:3590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7842870 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.538499:0:3590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074ae00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773223.538502:0:3590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7842870 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.538508:0:3590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7842870 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.538517:0:3590:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93d26ede0100) 00010000:00010000:0.0:1790773223.538519:0:3590:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773223.538523:0:3590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7842870 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.538527:0:3590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc7842870 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773223.538785:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144547100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496069888:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1790773223.538971:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773223.539047:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790773223.539070:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144544380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496069760:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1790773223.539179:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790773223.539650:0:3590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc784292d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.539659:0:3590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc784292d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.539665:0:3590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc784292d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.539670:0:3590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ad400 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773223.539674:0:3590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc784292d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.539681:0:3590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc784292d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.539707:0:3590:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93d14363d900) 00010000:00010000:0.0:1790773223.539709:0:3590:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790773223.539713:0:3590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc784292d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.539719:0:3590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad400/0xabf1cc0bc784292d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1790773223.539795:0:6510:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1790773223.539977:0:6510:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1790773223.540001:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14480d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496070016:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1790773223.540117:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773223.540262:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14480f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+21:12426:x1877761484495488:12345-192.168.202.19@tcp:44:lhsmtool_posix.0 Request processed in 7936us (8185us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773223.540274:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 243 00000100:00100000:0.0:1790773223.540327:0:8392:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496069888 00000100:00100000:0.0:1790773223.540334:0:8392:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496069888 00000100:00100000:0.0:1790773223.540375:0:8392:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496069760 00000100:00100000:0.0:1790773223.540379:0:8392:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496069760 00000100:00100000:0.0:1790773223.540395:0:8392:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496070016 00000100:00100000:0.0:1790773223.540397:0:8392:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496070016 00000100:00100000:0.0:1790773223.540424:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790773223.540441:0:8392:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144545c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3605:x1877761496069888:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1790773223.540449:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790773223.540457:0:8906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144545880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3605:x1877761496069760:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1790773223.540470:0:8906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:1.0:1790773223.540487:0:8906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7ed604b/0xabf1cc0bc7842957 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.540505:0:8906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000adfd55ca/0xabf1cc0bc784270b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be9c expref: 12 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.540513:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1790773223.540518:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790773223.540522:0:8906:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7ed604b/0xabf1cc0bc7842957 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.540547:0:8906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000adfd55ca/0xabf1cc0bc784270b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be9c expref: 12 pid: 8392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.540561:0:8906:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000adfd55ca/0xabf1cc0bc784270b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be9c expref: 12 pid: 8392 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773223.540572:0:8906:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445ded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8906:1877761496070144:192.168.202.19@tcp:104: 00000100:00100000:1.0:1790773223.540625:0:8906:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279ed9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790773223.540700:0:8907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790773223.540709:0:8907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14480dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496070016:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1790773223.540724:0:8907:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00002000:00010000:2.0:1790773223.540746:0:8907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6abd07e6, atime: 0x6abd07e6, ctime: 0x6abd07e6, blocks: 0x8 00010000:00010000:2.0:1790773223.540751:0:8907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000715485c4/0xabf1cc0bc784295e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773223.540760:0:8907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=366s v=(0 0) 00010000:00010000:2.0:1790773223.540763:0:8907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790773223.540768:0:8907:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000715485c4/0xabf1cc0bc784295e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773223.540781:0:8907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000715485c4/0xabf1cc0bc784295e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773223.540789:0:8907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000715485c4/0xabf1cc0bc784295e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773223.540795:0:8907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000715485c4/0xabf1cc0bc784295e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773223.540817:0:8907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790773223.540936:0:8907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14480dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3606:x1877761496070016:12345-0@lo:6:osp-syn-0-0.0 Request processed in 228us (851us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1790773223.540942:0:8907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790773223.541012:0:3606:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1790773223.541019:0:3606:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967310 00000004:00080000:2.0:1790773223.541115:0:3606:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93d143d9ca80, transno 4294967308 00000004:00080000:2.0:1790773223.541126:0:3606:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967310 00000100:00100000:2.0:1790773223.541176:0:3606:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff93d14480d180 x1877761496070016/t4294967311(4294967311) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1790773239 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1790773223.541189:0:3606:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93d14480d180/2, rc 0, transno 4294967311 00002000:00010000:0.0:1790773223.542008:0:8392:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1790773223.542013:0:8392:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1790773223 00002000:00010000:0.0:1790773223.542015:0:8392:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1790773223.542018:0:8392:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1790773223 -> 1790773223 00002000:00010000:0.0:1790773223.542020:0:8392:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1790773223.542072:0:8392:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144545c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3605:x1877761496069888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1639us (3113us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1790773223.542079:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1790773223.542110:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790773223.542123:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1790773223.542351:0:6466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790773223.542359:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000715485c4/0xabf1cc0bc784295e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.542368:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc5000 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:1.0:1790773223.542372:0:6466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000715485c4/0xabf1cc0bc784295e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.542382:0:6466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000715485c4/0xabf1cc0bc784295e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.542398:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000715485c4/0xabf1cc0bc784295e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.542416:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000715485c4/0xabf1cc0bc784295e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.542438:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773223.542441:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773223.542443:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1790773223.542577:0:3605:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93d144547100/2, rc 0, transno 4294967322 00000100:00100000:3.0:1790773223.542585:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144547100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496069888:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1790773223.542646:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14480d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496070016:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1790773223.546706:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773223.546954:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773223.548378:0:8907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484495616 00000100:00100000:2.0:1790773223.548392:0:8907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484495616 00000100:00100000:2.0:1790773223.548472:0:8907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 76 00000100:00100000:2.0:1790773223.548483:0:8907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14480d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:110130ab-04fa-4d7c-984e-562032df4432+13:2400:x1877761484495616:12345-192.168.202.19@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1790773223.549555:0:8906:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445ded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8906:1877761496070144:192.168.202.19@tcp:104: 00010000:00010000:1.0:1790773223.549599:0:8906:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d7ed604b/0xabf1cc0bc7842957 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773223.549722:0:10300:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484495744 00000100:00100000:0.0:1790773223.549728:0:10300:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484495744 00010000:00010000:0.0:1790773223.549760:0:10300:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000adfd55ca/0xabf1cc0bc784270b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be9c expref: 14 pid: 8392 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773223.549800:0:10300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 103 00000100:00100000:0.0:1790773223.549808:0:10300:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14480ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:110130ab-04fa-4d7c-984e-562032df4432+14:2397:x1877761484495744:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790773223.549821:0:10300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773223.549827:0:10300:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000adfd55ca/0xabf1cc0bc784270b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be9c expref: 14 pid: 8392 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.549841:0:10300:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000adfd55ca/0xabf1cc0bc784270b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be9c expref: 14 pid: 8392 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.549866:0:10300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000adfd55ca/0xabf1cc0bc784270b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be9c expref: 14 pid: 8392 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.549882:0:10300:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790773223.549886:0:10300:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790773223.549892:0:10300:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d7ed604b/0xabf1cc0bc7842957 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.549902:0:10300:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7ed604b/0xabf1cc0bc7842957 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.549929:0:10300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790773223.549996:0:10300:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14480ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:110130ab-04fa-4d7c-984e-562032df4432+13:2397:x1877761484495744:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 188us (3042us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773223.550004:0:10300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 103 00010000:00010000:0.0:1790773223.550028:0:8906:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d7ed604b/0xabf1cc0bc7842957 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.550037:0:8906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7ed604b/0xabf1cc0bc7842957 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.550047:0:8906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7ed604b/0xabf1cc0bc7842957 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.550055:0:8906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7ed604b/0xabf1cc0bc7842957 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.550073:0:8906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790773223.551240:0:8409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790773223.551251:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7ed604b/0xabf1cc0bc7842957 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773223.551263:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12bc00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:2.0:1790773223.551269:0:8409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7ed604b/0xabf1cc0bc7842957 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773223.551280:0:8409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7ed604b/0xabf1cc0bc7842957 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773223.551296:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7ed604b/0xabf1cc0bc7842957 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773223.551314:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7ed604b/0xabf1cc0bc7842957 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773223.551335:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773223.551337:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773223.551340:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773223.551431:0:8906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144545880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3605:x1877761496069760:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10974us (12250us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1790773223.551440:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000004:00080000:3.0:1790773223.551518:0:3605:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93d144544380/2, rc 0, transno 4294967323 00000100:00100000:3.0:1790773223.551526:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144544380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496069760:0@lo:6:osp-syn-1-0.0 00000001:00080000:3.0:1790773223.551929:0:9475:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:3.0:1790773223.551936:0:9475:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:2.0:1790773223.552065:0:8907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14480d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:110130ab-04fa-4d7c-984e-562032df4432+7:2400:x1877761484495616:12345-192.168.202.19@tcp:16:lhsmtool_posix.0 Request processed in 3583us (5368us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773223.552073:0:8907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 76 00000100:00100000:3.0:1790773223.554747:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773223.554809:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484496000 00000100:00100000:1.0:1790773223.554832:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484496000 00000100:00100000:1.0:1790773223.554892:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 244 00000100:00100000:1.0:1790773223.554902:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14480df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+21:12426:x1877761484496000:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790773223.554961:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790773223.554987:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc7842942 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf36 expref: 21 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.555006:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93d14363d900) 00010000:00010000:1.0:1790773223.555011:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790773223.555040:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc7842965 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.555055:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc7842965 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.555065:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc7842965 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790773223.555462:0:6479:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000006f0da00a reply state 000000004e4ff414 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc7842965 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.555476:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc7842965 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.555482:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93d14363d900) 00010000:00010000:1.0:1790773223.555485:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790773223.555488:0:6479:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790773223.555584:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14480df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+22:12426:x1877761484496000:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 683us (846us total) trans 4294967509 rc 0/0 00000100:00100000:1.0:1790773223.555593:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 244 00000100:00100000:3.0:1790773223.557200:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773223.557255:0:8392:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484496128 00000100:00100000:0.0:1790773223.557265:0:8392:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484496128 00000100:00100000:0.0:1790773223.557313:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 77 00000100:00100000:0.0:1790773223.557323:0:8392:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14480c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:110130ab-04fa-4d7c-984e-562032df4432+7:2397:x1877761484496128:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1790773223.557743:0:8392:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1790773223.557748:0:8392:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1790773223 -> 1790773222 00002000:00010000:0.0:1790773223.557750:0:8392:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1790773222 00002000:00010000:0.0:1790773223.557753:0:8392:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1790773223 -> 1790773222 00002000:00010000:0.0:1790773223.557766:0:8392:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1790773223.557820:0:8392:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14480c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:110130ab-04fa-4d7c-984e-562032df4432+8:2397:x1877761484496128:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 Request processed in 498us (624us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1790773223.557827:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 77 00000100:00100000:3.0:1790773223.559287:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773223.559417:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484496384 00000100:00100000:0.0:1790773223.559425:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484496384 00000100:00100000:0.0:1790773223.559484:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 245 00000100:00100000:0.0:1790773223.559494:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14480e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+22:12426:x1877761484496384:12345-192.168.202.19@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1790773223.559563:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc784296c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.559582:0:6478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7842926 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf28 expref: 22 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.559592:0:6478:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc784296c lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.559629:0:6478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7842926 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf28 expref: 22 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.559643:0:6478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7842926 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf28 expref: 22 pid: 6480 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773223.559658:0:6478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1877761496070272:192.168.202.19@tcp:104: 00000100:00100000:0.0:1790773223.559741:0:6478:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d141fd2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790773223.563007:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773223.563301:0:6478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6478:1877761496070272:192.168.202.19@tcp:104: 00010000:00010000:0.0:1790773223.563336:0:6478:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc784296c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773223.563678:0:6463:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484496512 00000100:00100000:2.0:1790773223.563686:0:6463:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484496512 00010000:00010000:2.0:1790773223.563736:0:6463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7842926 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf28 expref: 23 pid: 6480 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773223.563831:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 104 00000100:00100000:2.0:1790773223.563841:0:6463:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14480ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:110130ab-04fa-4d7c-984e-562032df4432+23:2398:x1877761484496512:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790773223.563860:0:6463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790773223.563867:0:6463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7842926 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf28 expref: 23 pid: 6480 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773223.563881:0:6463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7842926 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf28 expref: 23 pid: 6480 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773223.563904:0:6463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7842926 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf28 expref: 23 pid: 6480 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773223.563935:0:6463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93d14363d900) 00010000:00010000:2.0:1790773223.563940:0:6463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc784296c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773223.563949:0:6463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc784296c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773223.563956:0:6463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc784296c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773223.563986:0:6463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790773223.564042:0:6463:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14480ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:110130ab-04fa-4d7c-984e-562032df4432+22:2398:x1877761484496512:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 202us (1049us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773223.564050:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 104 00010000:00010000:0.0:1790773223.565427:0:6478:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc784296c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.565451:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc784296c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.565501:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc784296c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.565517:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc784296c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.565524:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc784296c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.565535:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074ae00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773223.565539:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc784296c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.565546:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc784296c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.565565:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93d14363d900) 00010000:00010000:0.0:1790773223.565568:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1790773223.565572:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc784296c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.565586:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ae00/0xabf1cc0bc784296c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773223.565692:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14480e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+21:12426:x1877761484496384:12345-192.168.202.19@tcp:55:lhsmtool_posix.0 Request processed in 6197us (6409us total) trans 0 rc -22/-22 00000100:00100000:0.0:1790773223.565721:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 245 00000100:00100000:3.0:1790773223.568072:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773223.568285:0:8394:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484496640 00000100:00100000:0.0:1790773223.568298:0:8394:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484496640 00000100:00100000:0.0:1790773223.568348:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 78 00000100:00100000:0.0:1790773223.568357:0:8394:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14480ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:110130ab-04fa-4d7c-984e-562032df4432+8:2399:x1877761484496640:12345-192.168.202.19@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1790773223.568399:0:8394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009aacc60b/0xabf1cc0bc7842973 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.568434:0:8394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1f867cc/0xabf1cc0bc7842950 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf44 expref: 8 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.568453:0:8394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790773223.568457:0:8394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790773223.568461:0:8394:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009aacc60b/0xabf1cc0bc7842973 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.568495:0:8394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f1f867cc/0xabf1cc0bc7842950 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf44 expref: 8 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.568509:0:8394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f1f867cc/0xabf1cc0bc7842950 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf44 expref: 8 pid: 8906 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773223.568524:0:8394:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8394:1877761496070400:192.168.202.19@tcp:104: 00000100:00100000:0.0:1790773223.568594:0:8394:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d141fd2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790773223.570579:0:8394:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8394:1877761496070400:192.168.202.19@tcp:104: 00010000:00010000:0.0:1790773223.570620:0:8394:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009aacc60b/0xabf1cc0bc7842973 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773223.572626:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773223.573163:0:6464:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484496768 00000100:00100000:0.0:1790773223.573173:0:6464:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484496768 00010000:00010000:0.0:1790773223.573244:0:6464:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f1f867cc/0xabf1cc0bc7842950 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf44 expref: 9 pid: 8906 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773223.573284:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 105 00000100:00100000:0.0:1790773223.573295:0:6464:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14480f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:110130ab-04fa-4d7c-984e-562032df4432+9:2398:x1877761484496768:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790773223.573311:0:6464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773223.573335:0:6464:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f1f867cc/0xabf1cc0bc7842950 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf44 expref: 9 pid: 8906 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.573348:0:6464:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f1f867cc/0xabf1cc0bc7842950 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf44 expref: 9 pid: 8906 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.573370:0:6464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1f867cc/0xabf1cc0bc7842950 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf44 expref: 9 pid: 8906 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.573388:0:6464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790773223.573393:0:6464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790773223.573399:0:6464:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009aacc60b/0xabf1cc0bc7842973 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.573420:0:6464:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009aacc60b/0xabf1cc0bc7842973 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.573471:0:6464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790773223.573531:0:6464:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14480f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:110130ab-04fa-4d7c-984e-562032df4432+8:2398:x1877761484496768:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 238us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773223.573539:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 105 00010000:00010000:3.0:1790773223.573908:0:8394:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009aacc60b/0xabf1cc0bc7842973 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773223.573918:0:8394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009aacc60b/0xabf1cc0bc7842973 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773223.573942:0:8394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009aacc60b/0xabf1cc0bc7842973 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773223.573951:0:8394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009aacc60b/0xabf1cc0bc7842973 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773223.573959:0:8394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009aacc60b/0xabf1cc0bc7842973 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773223.573966:0:8394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074a800 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:3.0:1790773223.573970:0:8394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009aacc60b/0xabf1cc0bc7842973 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773223.573979:0:8394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009aacc60b/0xabf1cc0bc7842973 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773223.573990:0:8394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009aacc60b/0xabf1cc0bc7842973 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773223.573998:0:8394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009aacc60b/0xabf1cc0bc7842973 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773223.574077:0:8394:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14480ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:110130ab-04fa-4d7c-984e-562032df4432+7:2399:x1877761484496640:12345-192.168.202.19@tcp:1:lhsmtool_posix.0 Request processed in 5720us (6011us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773223.574084:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 78 00000100:00100000:3.0:1790773223.576377:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773223.576607:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484497024 00000100:00100000:1.0:1790773223.576622:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484497024 00000100:00100000:1.0:1790773223.576681:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 246 00000100:00100000:1.0:1790773223.576690:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14480e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+21:12426:x1877761484497024:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1790773223.576787:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc784297a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.576807:0:6480:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc7842869 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bef0 expref: 21 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.576817:0:6480:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc784297a lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.576857:0:6480:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc7842869 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bef0 expref: 21 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.576870:0:6480:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc7842869 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bef0 expref: 21 pid: 13768 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773223.576887:0:6480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445ded80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6480:1877761496070528:192.168.202.19@tcp:104: 00000100:00100000:1.0:1790773223.576978:0:6480:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279ed90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790773223.579421:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773223.579522:0:6480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445ded80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6480:1877761496070528:192.168.202.19@tcp:104: 00010000:00010000:1.0:1790773223.579553:0:6480:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc784297a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773223.579631:0:6465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484497152 00000100:00100000:0.0:1790773223.579640:0:6465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484497152 00010000:00010000:0.0:1790773223.579677:0:6465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc7842869 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bef0 expref: 22 pid: 13768 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773223.579768:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 106 00000100:00100000:0.0:1790773223.579779:0:6465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2559e6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:110130ab-04fa-4d7c-984e-562032df4432+22:2397:x1877761484497152:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790773223.579795:0:6465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773223.579802:0:6465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc7842869 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bef0 expref: 22 pid: 13768 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.579814:0:6465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc7842869 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bef0 expref: 22 pid: 13768 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.579836:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc7842869 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bef0 expref: 22 pid: 13768 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.579851:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93d26ede0100) 00010000:00010000:0.0:1790773223.579857:0:6465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc78428cb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf13 expref: 21 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.579866:0:6465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc784297a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.579889:0:6465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc784297a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.579897:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc784297a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.579929:0:6465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790773223.579991:0:6465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2559e6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:110130ab-04fa-4d7c-984e-562032df4432+21:2397:x1877761484497152:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 214us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773223.579999:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 106 00010000:00010000:3.0:1790773223.580228:0:6480:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc784297a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773223.580237:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc784297a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773223.580431:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7842981 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773223.580456:0:6480:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7842934 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf2f expref: 21 pid: 14584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773223.580464:0:6480:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7842981 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773223.580496:0:6480:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7842934 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf2f expref: 21 pid: 14584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773223.580510:0:6480:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7842934 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf2f expref: 21 pid: 14584 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773223.580521:0:6480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14480c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6480:1877761496070656:192.168.202.19@tcp:104: 00000100:00100000:3.0:1790773223.580595:0:6480:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d242c57480 going to sleep for 11 seconds 00000100:00100000:2.0:1790773223.583877:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773223.583972:0:6480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14480c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6480:1877761496070656:192.168.202.19@tcp:104: 00010000:00010000:3.0:1790773223.584000:0:6480:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7842981 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773223.584684:0:8410:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484497280 00000100:00100000:1.0:1790773223.584695:0:8410:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484497280 00010000:00010000:1.0:1790773223.584758:0:8410:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7842934 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf2f expref: 22 pid: 14584 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773223.584880:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 107 00000100:00100000:1.0:1790773223.584891:0:8410:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144546d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:110130ab-04fa-4d7c-984e-562032df4432+22:2397:x1877761484497280:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790773223.584909:0:8410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790773223.584916:0:8410:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7842934 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf2f expref: 22 pid: 14584 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.584928:0:8410:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7842934 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf2f expref: 22 pid: 14584 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.585243:0:8410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5600/0xabf1cc0bc7842934 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf2f expref: 22 pid: 14584 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.585261:0:8410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93d14363d900) 00010000:00010000:1.0:1790773223.585266:0:8410:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7842981 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.585276:0:8410:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7842981 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.585283:0:8410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7842981 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.585308:0:8410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790773223.585374:0:8410:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144546d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:110130ab-04fa-4d7c-984e-562032df4432+21:2397:x1877761484497280:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 480us (1502us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773223.585382:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 107 00010000:00010000:1.0:1790773223.585744:0:6480:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7842981 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.585760:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7842981 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790773223.585859:0:6480:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:1.0:1790773223.585984:0:6480:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:1.0:1790773223.586018:0:6480:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:1.0:1790773223.586333:0:6480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445ded80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6480:1877761496070784:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1790773223.586389:0:6480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773223.587419:0:6480:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279eaa6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790773223.587641:0:6484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496070784 00000100:00100000:0.0:1790773223.587651:0:6484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496070784 00000100:00100000:0.0:1790773223.588294:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1790773223.588312:0:6484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6480:x1877761496070784:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1790773223.589390:0:6484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6480:x1877761496070784:12345-0@lo:1000:mdt00_002.0 Request processed in 1084us (2997us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773223.589413:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1790773223.589731:0:6480:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:1.0:1790773223.589740:0:6480:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:1.0:1790773223.589761:0:6480:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93d144547100, transno 4294967322 00000100:00100000:1.0:1790773223.590370:0:6480:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff93d144544380 x1877761496069760/t4294967323(4294967323) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1790773239 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773223.590394:0:6480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445ded80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6480:1877761496070784:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1790773223.590646:0:6480:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:1.0:1790773223.593742:0:6480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445ded80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6480:1877761496070912:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1790773223.593810:0:6480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773223.593849:0:6480:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2465e5300 going to sleep for 11 seconds 00000100:00100000:2.0:1790773223.593949:0:12789:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496070912 00000100:00100000:2.0:1790773223.593956:0:12789:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496070912 00000100:00100000:2.0:1790773223.593996:0:12789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1790773223.594002:0:12789:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:6480:x1877761496070912:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1790773223.594235:0:12789:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:6480:x1877761496070912:12345-0@lo:1000:mdt00_002.0 Request processed in 231us (423us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1790773223.594243:0:12789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1790773223.596820:0:6480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445ded80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6480:1877761496070912:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1790773223.596873:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7842981 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.596884:0:6480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7842981 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.596892:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7842981 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.596914:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ada00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773223.596919:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7842981 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.596928:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7842981 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.597012:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93d14363d900) 00010000:00010000:1.0:1790773223.597017:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790773223.597023:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7842981 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.597029:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc7842981 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.597061:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc78428c4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.597068:0:6480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc78428c4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.597073:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc78428c4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.597079:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc4800 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773223.597082:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc78428c4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.597088:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc78428c4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.597174:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93d26ede0100) 00010000:00010000:1.0:1790773223.597177:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790773223.597185:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc78428cb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf13 expref: 24 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.597197:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc78428cb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf13 expref: 24 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.597226:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc78428cb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf13 expref: 24 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.597271:0:6480:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc78428cb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf13 expref: 24 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773223.597286:0:6480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445dea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6480:1877761496071040:192.168.202.19@tcp:105: 00000100:00100000:1.0:1790773223.597429:0:6480:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2465e5300 going to sleep for 11 seconds 00000100:00100000:2.0:1790773223.601979:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773223.602078:0:6480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445dea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6480:1877761496071040:192.168.202.19@tcp:105: 00010000:00010000:1.0:1790773223.602119:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc78428c4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.602130:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc78428c4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.602161:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7842988 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.602175:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7842988 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773223.602306:0:14187:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484497408 00000100:00100000:3.0:1790773223.602319:0:14187:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484497408 00000100:00100000:3.0:1790773223.602382:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 61 00000100:00100000:3.0:1790773223.602393:0:14187:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144547480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:110130ab-04fa-4d7c-984e-562032df4432+25:12424:x1877761484497408:12345-192.168.202.19@tcp:49:lfs.0 00000100:00100000:3.0:1790773223.602846:0:14187:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144547480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:110130ab-04fa-4d7c-984e-562032df4432+25:12424:x1877761484497408:12345-192.168.202.19@tcp:49:lfs.0 Request processed in 453us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773223.602855:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 61 00010000:00010000:1.0:1790773223.602905:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7842988 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.602919:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7842988 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.602926:0:6480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7842988 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.602932:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7842988 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.602948:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12a400 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773223.602952:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7842988 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.602959:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7842988 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.602972:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93d26ede0100) 00010000:00010000:1.0:1790773223.602974:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790773223.602978:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7842988 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.602983:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc7842988 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.602994:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc784297a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.603000:0:6480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc784297a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.603013:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc784297a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.603017:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12a200 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773223.603020:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc784297a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.603025:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc784297a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.603032:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93d26ede0100) 00010000:00010000:1.0:1790773223.603035:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790773223.603037:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc784297a lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.603043:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc784297a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773223.603349:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14480e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+24:12426:x1877761484497024:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 26659us (26984us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1790773223.603358:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 246 00000020:00080000:2.0:1790773223.603362:0:6480:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1790773223.603650:0:13749:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790773223.603654:0:13749:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790773223.603997:0:13749:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1790773223.604003:0:13749:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790773223.605916:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773223.605981:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484497664 00000100:00100000:3.0:1790773223.605991:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484497664 00000100:00100000:3.0:1790773223.606036:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 62 00000100:00100000:3.0:1790773223.606043:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d246a14c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:110130ab-04fa-4d7c-984e-562032df4432+24:12426:x1877761484497664:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1790773223.606329:0:6481:0:(mdd_object.c:4189:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1790773223.606370:0:6481:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:3.0:1790773223.606415:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc784298f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773223.606434:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc784298f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773223.606459:0:6481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc784298f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773223.606469:0:6481:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc784298f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773223.606487:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc784298f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773223.606491:0:6481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc784298f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773223.606506:0:6481:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790773223.606527:0:6467:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790773223.606533:0:6467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc784298f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.606540:0:6467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ade00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:1.0:1790773223.606543:0:6467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc784298f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.606560:0:6467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc784298f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.606571:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93d14363d900) 00010000:00010000:1.0:1790773223.606574:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1790773223.606578:0:6467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc784298f lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.606583:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc784298f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773223.606588:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d246a14c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:110130ab-04fa-4d7c-984e-562032df4432+26:12426:x1877761484497664:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 Request processed in 544us (678us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1790773223.606594:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 62 00010000:00010000:1.0:1790773223.606598:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1790773223.606599:0:6481:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790773223.606600:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773223.606601:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773223.610641:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773223.610749:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484497920 00000100:00100000:0.0:1790773223.610760:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484497920 00000100:00100000:1.0:1790773223.610844:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 247 00000100:00100000:1.0:1790773223.610855:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144547b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+26:12424:x1877761484497920:12345-192.168.202.19@tcp:58:lfs.0 00000040:00080000:1.0:1790773223.611014:0:13768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1790773223.611082:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144547b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+26:12424:x1877761484497920:12345-192.168.202.19@tcp:58:lfs.0 Request processed in 229us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773223.611087:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 247 00000100:00100000:0.0:1790773223.639502:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773223.639839:0:14584:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484498048 00000100:00100000:2.0:1790773223.639851:0:14584:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484498048 00000100:00100000:2.0:1790773223.639923:0:14584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 248 00000100:00100000:2.0:1790773223.639934:0:14584:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:110130ab-04fa-4d7c-984e-562032df4432+26:12428:x1877761484498048:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1790773223.639959:0:14584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773223.639983:0:14584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7842996 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bf4b expref: -99 pid: 14584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773223.640232:0:14584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc784299d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773223.640246:0:14584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc784299d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773223.640255:0:14584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc784299d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773223.640266:0:14584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc78429a4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773223.640270:0:14584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc78429a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773223.640274:0:14584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc78429a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.640388:0:14584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78429ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.640419:0:14584:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc78428b6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf0c expref: 27 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.640429:0:14584:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78429ab lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.640920:0:14584:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc78428b6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf0c expref: 27 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.640935:0:14584:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc78428b6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf0c expref: 27 pid: 6478 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773223.641017:0:14584:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c5180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14584:1877761496071168:192.168.202.19@tcp:104: 00000100:00100000:0.0:1790773223.641328:0:14584:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d141fd2180 going to sleep for 11 seconds 00000100:00100000:2.0:1790773223.644874:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773223.645827:0:14584:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c5180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14584:1877761496071168:192.168.202.19@tcp:104: 00010000:00010000:0.0:1790773223.645859:0:14584:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78429ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773223.648636:0:14187:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484498304 00000100:00100000:1.0:1790773223.648649:0:14187:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484498304 00000100:00100000:1.0:1790773223.648772:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 63 00000100:00100000:1.0:1790773223.648784:0:14187:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144547480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:110130ab-04fa-4d7c-984e-562032df4432+28:6167:x1877761484498304:12345-192.168.202.19@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1790773223.649036:0:14187:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144547480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:110130ab-04fa-4d7c-984e-562032df4432+29:6167:x1877761484498304:12345-192.168.202.19@tcp:35:ldlm_bl.0 Request processed in 254us (4169us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1790773223.649043:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 63 00000100:00100000:2.0:1790773223.651917:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773223.652087:0:10300:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484498432 00000100:00100000:0.0:1790773223.652161:0:10300:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484498432 00010000:00010000:0.0:1790773223.652222:0:10300:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc78428b6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf0c expref: 29 pid: 6478 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773223.652336:0:10300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 108 00000100:00100000:0.0:1790773223.652346:0:10300:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144547100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:110130ab-04fa-4d7c-984e-562032df4432+29:2398:x1877761484498432:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790773223.652364:0:10300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773223.652372:0:10300:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc78428b6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf0c expref: 29 pid: 6478 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.652386:0:10300:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc78428b6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf0c expref: 29 pid: 6478 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.652663:0:10300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc78428b6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf0c expref: 29 pid: 6478 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.652682:0:10300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93d26ede0100) 00010000:00010000:0.0:1790773223.652688:0:10300:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78429ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.652698:0:10300:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78429ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.652707:0:10300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78429ab lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773223.652747:0:10300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790773223.652883:0:14584:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78429ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.652893:0:14584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78429ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790773223.652960:0:14584:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1790773223.652964:0:14584:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790773223.652985:0:14584:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78429ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.652998:0:14584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78429ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.653008:0:14584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc784299d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.653015:0:14584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc784299d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.653035:0:14584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc784299d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.653042:0:14584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc4200 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773223.653046:0:14584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc784299d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.653060:0:14584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc784299d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.653072:0:14584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93d26ede0c00) 00010000:00010000:1.0:1790773223.653074:0:14584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790773223.653089:0:14584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc784299d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773223.653271:0:10300:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144547100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:110130ab-04fa-4d7c-984e-562032df4432+28:2398:x1877761484498432:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 923us (1367us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773223.653290:0:10300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 108 00010000:00010000:1.0:1790773223.653492:0:14584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4200/0xabf1cc0bc784299d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.653513:0:14584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc78429a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.653519:0:14584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc78429a4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.653525:0:14584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc78429a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.653535:0:14584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc4800 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773223.653540:0:14584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc78429a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.653547:0:14584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc78429a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.653556:0:14584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93d255badd00) 00010000:00010000:1.0:1790773223.653563:0:14584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790773223.653567:0:14584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc78429a4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.653573:0:14584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc4800/0xabf1cc0bc78429a4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.653621:0:14584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5200/0xabf1cc0bc7842996 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf4b expref: 28 pid: 14584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.653666:0:14584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78429ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf4b expref: 27 pid: 14584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773223.653675:0:14584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93d26ede0100) 00010000:00010000:1.0:1790773223.653677:0:14584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790773223.653680:0:14584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074be00, rc 0) 00000100:00100000:1.0:1790773223.653731:0:14584:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:110130ab-04fa-4d7c-984e-562032df4432+27:12428:x1877761484498048:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 13798us (14536us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773223.653739:0:14584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 248 00000100:00100000:3.0:1790773223.757540:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14480c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce0675b4-b0c5-48e7-b182-565e22fed04c:3607:1877761496071296:0@lo:400:kworker.0 00000100:00100000:3.0:1790773223.757631:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773223.757678:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14480f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877761496071808:0@lo:400:kworker.0 00000100:00100000:3.0:1790773223.757711:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773223.757732:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3607:1877761496072320:0@lo:400:kworker.0 00000100:00100000:3.0:1790773223.757754:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773223.757783:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1790773223.757790:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14480ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496071680:0@lo:400:kworker.0 00000100:00100000:3.0:1790773223.757819:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773223.757839:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496072192:0@lo:400:kworker.0 00000100:00100000:3.0:1790773223.757866:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773223.757900:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496071296 00000100:00100000:3.0:1790773223.757907:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496071296 00000100:00100000:3.0:1790773223.757954:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1790773223.757965:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3607:x1877761496071296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773223.758032:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3607:x1877761496071296:12345-0@lo:400:kworker.0 Request processed in 68us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773223.758040:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1790773223.758076:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14480c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3604:1877761496071424:0@lo:400:kworker.0 00000100:00100000:3.0:1790773223.758101:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773223.758119:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3604:1877761496071936:0@lo:400:kworker.0 00000100:00100000:3.0:1790773223.758139:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773223.758154:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3604:1877761496072448:0@lo:400:kworker.0 00000100:00100000:3.0:1790773223.758173:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773223.758189:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1790773223.758195:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14480ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496071552:0@lo:400:kworker.0 00000100:00100000:3.0:1790773223.758242:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773223.758257:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3604:1877761496072064:0@lo:400:kworker.0 00000100:00100000:3.0:1790773223.758279:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773223.758292:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496072576:0@lo:400:kworker.0 00000100:00100000:3.0:1790773223.758312:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773223.758337:0:8393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496072192 00000100:00100000:3.0:1790773223.758341:0:8393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496072192 00000100:00100000:3.0:1790773223.758374:0:8393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496072576 00000100:00100000:3.0:1790773223.758377:0:8393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496072576 00000100:00100000:3.0:1790773223.758399:0:8393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1790773223.758420:0:8393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496072192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773223.758454:0:8393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496072192:12345-0@lo:400:kworker.0 Request processed in 35us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773223.758460:0:8393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1790773223.758480:0:8393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1790773223.758485:0:8393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496072576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773223.758519:0:8393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496072576:12345-0@lo:400:kworker.0 Request processed in 33us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773223.758525:0:8393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1790773223.758569:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496072576:0@lo:400:kworker.0 00000100:00100000:3.0:1790773223.758604:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496072192:0@lo:400:kworker.0 00000100:00100000:3.0:1790773223.758613:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14480c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce0675b4-b0c5-48e7-b182-565e22fed04c:3607:1877761496071296:0@lo:400:kworker.0 00000100:00100000:3.0:1790773223.758634:0:6484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496071680 00000100:00100000:3.0:1790773223.758638:0:6484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496071680 00000100:00100000:3.0:1790773223.758663:0:6484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496071552 00000100:00100000:3.0:1790773223.758666:0:6484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496071552 00000100:00100000:3.0:1790773223.758682:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1790773223.758688:0:6484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496071680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773223.758726:0:6484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496071680:12345-0@lo:400:kworker.0 Request processed in 38us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773223.758732:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1790773223.758743:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1790773223.758749:0:6484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496071552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773223.758780:0:6484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496071552:12345-0@lo:400:kworker.0 Request processed in 31us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773223.758785:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1790773223.758811:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14480ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496071552:0@lo:400:kworker.0 00000100:00100000:3.0:1790773223.758832:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14480ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496071680:0@lo:400:kworker.0 00000100:00100000:3.0:1790773223.758866:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496071808 00000100:00100000:3.0:1790773223.758869:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496071808 00000100:00100000:3.0:1790773223.758889:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496072320 00000100:00100000:3.0:1790773223.758892:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496072320 00000100:00100000:3.0:1790773223.758905:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496071424 00000100:00100000:3.0:1790773223.758907:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496071424 00000100:00100000:3.0:1790773223.758916:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496071936 00000100:00100000:3.0:1790773223.758918:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496071936 00000100:00100000:3.0:1790773223.758932:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496072448 00000100:00100000:3.0:1790773223.758934:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496072448 00000100:00100000:3.0:1790773223.758946:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496072064 00000100:00100000:3.0:1790773223.758949:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496072064 00000100:00100000:3.0:1790773223.758962:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1790773223.758968:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877761496071808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773223.759005:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877761496071808:12345-0@lo:400:kworker.0 Request processed in 37us (1294us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773223.759012:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1790773223.759024:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1790773223.759030:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1877761496072320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773223.759057:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1877761496072320:12345-0@lo:400:kworker.0 Request processed in 27us (1302us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773223.759062:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1790773223.759073:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1790773223.759078:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3604:x1877761496071424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773223.759108:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3604:x1877761496071424:12345-0@lo:400:kworker.0 Request processed in 29us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773223.759114:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1790773223.759125:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1790773223.759136:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3604:x1877761496071936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773223.759163:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3604:x1877761496071936:12345-0@lo:400:kworker.0 Request processed in 28us (1023us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773223.759169:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1790773223.759181:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1790773223.759186:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3604:x1877761496072448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773223.759238:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3604:x1877761496072448:12345-0@lo:400:kworker.0 Request processed in 51us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773223.759243:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1790773223.759255:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1790773223.759261:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3604:x1877761496072064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773223.759285:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3604:x1877761496072064:12345-0@lo:400:kworker.0 Request processed in 25us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773223.759290:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00010000:00080000:3.0:1790773223.759316:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1445d8e00 x1877761496072064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773223.759327:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3604:1877761496072064:0@lo:400:kworker.0 00000100:00100000:3.0:1790773223.759336:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14480c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3604:1877761496071424:0@lo:400:kworker.0 00000100:00100000:3.0:1790773223.759344:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3604:1877761496071936:0@lo:400:kworker.0 00010000:00080000:3.0:1790773223.759353:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1445da680 x1877761496072448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773223.759360:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3604:1877761496072448:0@lo:400:kworker.0 00000100:00100000:3.0:1790773223.759383:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14480f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877761496071808:0@lo:400:kworker.0 00000100:00100000:3.0:1790773223.759414:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3607:1877761496072320:0@lo:400:kworker.0 00000100:00080000:0.0:1790773223.760878:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790773223.760885:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790773223.760887:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790773223.760890:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790773223.760954:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790773223.760977:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496072704:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790773223.761025:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773223.761062:0:6484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496072704 00000100:00100000:0.0:1790773223.761070:0:6484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496072704 00000100:00100000:0.0:1790773223.761116:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1790773223.761124:0:6484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496072704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790773223.761167:0:6484:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1790773223.761228:0:6484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496072704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773223.761416:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1790773223.761751:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496072704:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790773223.762845:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496072832:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790773223.762899:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773223.762962:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496072832 00000100:00100000:1.0:1790773223.762968:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496072832 00000100:00100000:1.0:1790773223.763006:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1790773223.763014:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496072832:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790773223.763033:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:1.0:1790773223.763071:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496072832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773223.763077:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1790773223.763127:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496072832:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790773223.766751:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790773223.766778:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496072960:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790773223.766859:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773223.766922:0:6484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496072960 00000100:00100000:0.0:1790773223.766930:0:6484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496072960 00000100:00100000:0.0:1790773223.767041:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1790773223.767050:0:6484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496072960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790773223.767087:0:6484:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1790773223.768725:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496072960:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790773223.768787:0:6484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496072960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1736us (1926us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773223.768796:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1790773223.769449:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496073088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790773223.769502:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773223.771646:0:11145:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496073088 00000100:00100000:0.0:1790773223.771660:0:11145:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496073088 00000100:00100000:0.0:1790773223.771725:0:11145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1790773223.771737:0:11145:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3605:x1877761496073088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790773223.771763:0:11145:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:0.0:1790773223.776587:0:11145:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3605:x1877761496073088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4843us (7073us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773223.776606:0:11145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1790773223.778393:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496073088:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790773224.269840:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790773224.503842:0:14674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790773224.503852:0:14674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790773224.503886:0:14674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1790773224.503891:0:14674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1790773224.653637:0:13749:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790773224.653647:0:13749:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790773224.653672:0:13749:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1790773224.653679:0:13749:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790773224.653811:0:13749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cd880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13749:1877761496073216:192.168.202.19@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790773224.653904:0:13749:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d242c57900 going to sleep for 11 seconds 00000100:00100000:2.0:1790773224.660531:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773224.660630:0:13749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cd880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13749:1877761496073216:192.168.202.19@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790773224.660818:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484498560 00000100:00100000:0.0:1790773224.660827:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484498560 00000100:00100000:0.0:1790773224.660902:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 249 00000100:00100000:0.0:1790773224.660912:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+27:12440:x1877761484498560:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790773224.660946:0:6479:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790773224.661054:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+27:12440:x1877761484498560:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 Request processed in 144us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773224.661062:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 249 00000100:00080000:3.0:1790773224.661385:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790773224.670472:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773224.670718:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484498816 00000100:00100000:0.0:1790773224.670730:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484498816 00000100:00100000:0.0:1790773224.670800:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 250 00000100:00100000:0.0:1790773224.670811:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+27:12440:x1877761484498816:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790773224.670833:0:8697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773224.670858:0:8697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc78429b2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bf52 expref: -99 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773224.670982:0:8697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc78429b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773224.670997:0:8697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc78429b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773224.671008:0:8697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc78429b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8697 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790773224.671020:0:8697:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1790773224.671314:0:8697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b400/0xabf1cc0bc78429b2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf52 expref: 30 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773224.671335:0:8697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc78429b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf52 expref: 29 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773224.671366:0:8697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93d26ede0100) 00010000:00010000:0.0:1790773224.671370:0:8697:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790773224.671374:0:8697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074bc00, rc 0) 00000100:00100000:0.0:1790773224.671500:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+29:12440:x1877761484498816:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 690us (1040us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1790773224.671508:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 250 00000100:00100000:3.0:1790773224.677447:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773224.677488:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773224.677587:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484499072 00000100:00100000:1.0:1790773224.677600:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484499072 00000100:00100000:1.0:1790773224.677669:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 251 00000100:00100000:1.0:1790773224.677681:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+29:12440:x1877761484499072:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1790773224.677783:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc78429c7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773224.677803:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc78429c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773224.677815:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc78429c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773224.677987:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc78429c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773224.677995:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc78429c7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773224.678002:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc78429c7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773224.678008:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12ba00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773224.678012:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc78429c7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773224.678019:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc78429c7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773224.678045:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93d26ede0100) 00010000:00010000:1.0:1790773224.678048:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790773224.678053:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc78429c7 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773224.678059:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ba00/0xabf1cc0bc78429c7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773224.678196:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+30:12440:x1877761484499072:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 516us (760us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1790773224.678228:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 251 00000040:00080000:1.0:1790773224.678321:0:13749:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790773224.678327:0:13749:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790773224.678845:0:13749:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1790773224.678856:0:13749:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790773224.679263:0:8410:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484499200 00000100:00100000:0.0:1790773224.679271:0:8410:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484499200 00000100:00100000:0.0:1790773224.679325:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 19 00000100:00100000:0.0:1790773224.679333:0:8410:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:110130ab-04fa-4d7c-984e-562032df4432+30:2397:x1877761484499200:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790773224.679347:0:8410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773224.679365:0:8410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074bc00/0xabf1cc0bc78429b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf52 expref: 30 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773224.679381:0:8410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93d26ede0100) 00010000:00010000:0.0:1790773224.679386:0:8410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790773224.679432:0:8410:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:110130ab-04fa-4d7c-984e-562032df4432+29:2397:x1877761484499200:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 100us (1943us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773224.679440:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 19 00000100:00100000:3.0:1790773224.689712:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773224.691879:0:6482:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484499456 00000100:00100000:2.0:1790773224.691891:0:6482:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484499456 00000100:00100000:2.0:1790773224.691948:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 64 00000100:00100000:2.0:1790773224.691959:0:6482:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+29:12440:x1877761484499456:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790773224.692234:0:6482:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+30:12440:x1877761484499456:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 Request processed in 277us (2529us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1790773224.692243:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 64 00010000:00010000:0.0:1790773225.293902:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773226.318268:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790773226.320651:0:13753:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1790773226.658049:0:14726:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790773226.658059:0:14726:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790773226.658091:0:14726:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1790773226.658100:0:14726:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1790773226.770733:0:13749:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790773226.770741:0:13749:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790773226.770765:0:13749:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1790773226.770773:0:13749:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790773226.807858:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773226.808037:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484499712 00000100:00100000:1.0:1790773226.808048:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484499712 00000100:00100000:1.0:1790773226.808150:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 252 00000100:00100000:1.0:1790773226.808159:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+30:12460:x1877761484499712:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1790773226.808184:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773226.808222:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc78429ce lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bf59 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773226.808345:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc78429d5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773226.808360:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc78429d5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773226.808381:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc78429d5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790773226.808393:0:6479:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1790773226.808494:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc78429ce lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf59 expref: 33 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773226.808573:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc78429d5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf59 expref: 32 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773226.808583:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93d26ede0100) 00010000:00010000:1.0:1790773226.808586:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1790773226.808589:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12a800, rc 0) 00000100:00100000:1.0:1790773226.808644:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+32:12460:x1877761484499712:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 486us (794us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1790773226.808652:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 252 00000100:00080000:3.0:1790773226.811958:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790773226.813367:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773226.813634:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484499840 00000100:00100000:2.0:1790773226.813645:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484499840 00000100:00100000:2.0:1790773226.813717:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 253 00000100:00100000:2.0:1790773226.813731:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+32:12460:x1877761484499840:12345-192.168.202.19@tcp:54:lfs.0 00010000:00010000:2.0:1790773226.813806:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc78429e3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773226.813824:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc78429e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773226.813837:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc78429e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773226.813873:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc78429e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773226.813880:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc78429e3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773226.813887:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc78429e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773226.813893:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc5800 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:2.0:1790773226.813911:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc78429e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773226.813919:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc78429e3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773226.813931:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93d26ede0100) 00010000:00010000:2.0:1790773226.813935:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790773226.813940:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc78429e3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773226.813947:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5800/0xabf1cc0bc78429e3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773226.814106:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:110130ab-04fa-4d7c-984e-562032df4432+32:12460:x1877761484499840:12345-192.168.202.19@tcp:54:lfs.0 Request processed in 377us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773226.814115:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 253 00000100:00100000:1.0:1790773226.829991:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496073344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790773226.830080:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773226.830454:0:8397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496073344 00000100:00100000:3.0:1790773226.830463:0:8397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496073344 00000100:00100000:3.0:1790773226.830522:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1790773226.830532:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3606:x1877761496073344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790773226.830562:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790773226.830683:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144545180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496073472:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790773226.830716:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773226.830750:0:11145:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496073472 00000100:00100000:0.0:1790773226.830753:0:11145:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496073472 00000100:00100000:0.0:1790773226.830771:0:11145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1790773226.830776:0:11145:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c582850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496073472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790773226.830785:0:11145:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790773226.830812:0:11145:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c582850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496073472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 36us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773226.830819:0:11145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1790773226.830857:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144545180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496073472:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1790773226.831344:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790773226.831541:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3606:x1877761496073344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1010us (1460us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773226.831566:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1790773226.831818:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496073344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790773226.868000:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773226.868066:0:8394:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484499968 00000100:00100000:3.0:1790773226.868077:0:8394:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484499968 00000100:00100000:3.0:1790773226.868199:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 79 00000100:00100000:3.0:1790773226.868321:0:8394:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:110130ab-04fa-4d7c-984e-562032df4432+7:2397:x1877761484499968:12345-192.168.202.19@tcp:101:cat.0 00010000:00010000:3.0:1790773226.868342:0:8394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773226.868366:0:8394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ac0d10f/0xabf1cc0bc78429ea lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bf60 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790773226.868404:0:8394:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6abd07e6, atime: 0x6abd07e6, ctime: 0x6abd07e6, blocks: 0x8 00010000:00010000:3.0:1790773226.868424:0:8394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=369s v=(0 0) 00010000:00010000:3.0:1790773226.868429:0:8394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773226.868439:0:8394:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ac0d10f/0xabf1cc0bc78429ea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf60 expref: 8 pid: 8394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773226.868458:0:8394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007ac0d10f/0xabf1cc0bc78429ea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf60 expref: 8 pid: 8394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773226.868472:0:8394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d1434ace00, rc 0) 00000100:00100000:3.0:1790773226.868578:0:8394:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:110130ab-04fa-4d7c-984e-562032df4432+8:2397:x1877761484499968:12345-192.168.202.19@tcp:101:cat.0 Request processed in 261us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773226.868586:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 79 00000100:00080000:0.0:1790773226.868903:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790773226.876912:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773226.877007:0:8398:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484500096 00000100:00100000:2.0:1790773226.877016:0:8398:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484500096 00002000:00100000:2.0:1790773226.877060:0:8398:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff93d27f9c9c00 x1877761484500096/t0(0) o3->110130ab-04fa-4d7c-984e-562032df4432@192.168.202.19@tcp:62/0 lens 488/0 e 0 to 0 dl 1790773237 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790773226.877068:0:8398:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93d27f9c9c00 with x1877761484500096 ext(0->4095) 00002000:00010000:2.0:1790773226.877073:0:8398:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93d27f9c9c00 00000100:00100000:2.0:1790773226.877099:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:2.0:1790773226.877109:0:8398:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:110130ab-04fa-4d7c-984e-562032df4432+8:2398:x1877761484500096:12345-192.168.202.19@tcp:3:cat.0 00000100:00100000:2.0:1790773226.877347:0:8398:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:110130ab-04fa-4d7c-984e-562032df4432+8:2398:x1877761484500096:12345-192.168.202.19@tcp:3:cat.0 Request processed in 237us (443us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1790773226.877355:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 7 00002000:00100000:2.0:1790773226.877382:0:8398:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff93d27f9c9c00 x1877761484500096/t0(0) o3->110130ab-04fa-4d7c-984e-562032df4432@192.168.202.19@tcp:62/0 lens 488/4536 e 0 to 0 dl 1790773237 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790773226.877390:0:8398:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93d27f9c9c00 with x1877761484500096 ext(0->4095) 00002000:00010000:2.0:1790773226.877394:0:8398:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93d27f9c9c00 00010000:00010000:1.0:1790773227.342879:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773228.365562:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773228.611069:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773228.611119:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773228.611142:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773228.611162:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773228.612526:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773228.612570:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773228.612610:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773228.612643:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484500224 00000100:00100000:3.0:1790773228.612652:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484500224 00000100:00100000:3.0:1790773228.612699:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 393 00000100:00100000:3.0:1790773228.612709:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:2400:x1877761484500224:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1790773228.612902:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:2400:x1877761484500224:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 193us (1842us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773228.612911:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 393 00000100:00100000:3.0:1790773228.612952:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484500352 00000100:00100000:3.0:1790773228.612956:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484500352 00000100:00100000:3.0:1790773228.612994:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484500480 00000100:00100000:3.0:1790773228.612997:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484500480 00000100:00100000:3.0:1790773228.613017:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484500864 00000100:00100000:3.0:1790773228.613019:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484500864 00000100:00100000:3.0:1790773228.613032:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484500992 00000100:00100000:3.0:1790773228.613034:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484500992 00000100:00100000:3.0:1790773228.613047:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 329 00000100:00100000:3.0:1790773228.613053:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+32:2400:x1877761484500352:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1790773228.613434:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+32:2400:x1877761484500352:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 379us (2313us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773228.613441:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 329 00000100:00100000:3.0:1790773228.613457:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 330 00000100:00100000:3.0:1790773228.613464:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+5:2400:x1877761484500480:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1790773228.613492:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+5:2400:x1877761484500480:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 30us (2350us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773228.613512:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 330 00000100:00100000:3.0:1790773228.613525:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 331 00000100:00100000:3.0:1790773228.613531:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2400:x1877761484500864:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1790773228.613569:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2400:x1877761484500864:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 38us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773228.613575:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 331 00000100:00100000:3.0:1790773228.613586:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 332 00000100:00100000:3.0:1790773228.613593:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2400:x1877761484500992:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1790773228.613616:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2400:x1877761484500992:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 24us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773228.613622:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 332 00000100:00100000:3.0:1790773228.613647:0:8906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484500608 00000100:00100000:3.0:1790773228.613652:0:8906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484500608 00000100:00100000:3.0:1790773228.613695:0:8906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484500736 00000100:00100000:3.0:1790773228.613699:0:8906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484500736 00000100:00100000:3.0:1790773228.613725:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 127 00000100:00100000:3.0:1790773228.613732:0:8906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:110130ab-04fa-4d7c-984e-562032df4432+5:2400:x1877761484500608:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773228.613883:0:8907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 128 00000100:00100000:1.0:1790773228.613894:0:8907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:110130ab-04fa-4d7c-984e-562032df4432+8:2400:x1877761484500736:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1790773228.614000:0:8906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:110130ab-04fa-4d7c-984e-562032df4432+5:2400:x1877761484500608:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 268us (2836us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773228.614007:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 127 00000100:00100000:1.0:1790773228.623856:0:8907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:110130ab-04fa-4d7c-984e-562032df4432+8:2400:x1877761484500736:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 9951us (11322us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773228.623877:0:8907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 128 00000100:00080000:2.0:1790773228.627312:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790773228.627324:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790773228.627328:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790773228.627331:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790773228.881618:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce0675b4-b0c5-48e7-b182-565e22fed04c:3604:1877761496073600:0@lo:400:kworker.0 00000100:00100000:0.0:1790773228.881718:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773228.881805:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3604:1877761496074112:0@lo:400:kworker.0 00000100:00100000:0.0:1790773228.881836:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773228.881869:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14480ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496074624:0@lo:400:kworker.0 00000100:00100000:1.0:1790773228.881882:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3605:1877761496073728:0@lo:400:kworker.0 00000100:00100000:0.0:1790773228.881898:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773228.881918:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496075136:0@lo:400:kworker.0 00000100:00100000:1.0:1790773228.881924:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773228.881953:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3605:1877761496074240:0@lo:400:kworker.0 00000100:00100000:0.0:1790773228.881955:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773228.881982:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773228.882003:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496073984:0@lo:400:kworker.0 00000100:00100000:1.0:1790773228.882005:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14480ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3605:1877761496074752:0@lo:400:kworker.0 00000100:00100000:1.0:1790773228.882043:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773228.882057:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496075264:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790773228.882079:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496073856:0@lo:400:kworker.0 00000100:00100000:1.0:1790773228.882139:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496074112 00000100:00100000:1.0:1790773228.882147:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496074112 00000100:00100000:1.0:1790773228.882185:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496073728 00000100:00100000:1.0:1790773228.882187:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496073728 00000100:00100000:1.0:1790773228.882201:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496074240 00000100:00100000:1.0:1790773228.882222:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496074240 00000100:00100000:1.0:1790773228.882247:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496074752 00000100:00100000:1.0:1790773228.882250:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496074752 00000100:00100000:1.0:1790773228.882264:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1790773228.882272:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3604:x1877761496074112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773228.882322:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3604:x1877761496074112:12345-0@lo:400:kworker.0 Request processed in 51us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773228.882336:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1790773228.882370:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1790773228.882379:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3605:x1877761496073728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773228.882382:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773228.885496:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3605:x1877761496073728:12345-0@lo:400:kworker.0 Request processed in 3108us (3562us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773228.885513:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1790773228.885563:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1790773228.885577:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3605:x1877761496074240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773228.885633:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3605:x1877761496074240:12345-0@lo:400:kworker.0 Request processed in 63us (3652us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773228.885639:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1790773228.885651:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1790773228.885657:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3605:x1877761496074752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773228.885689:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3605:x1877761496074752:12345-0@lo:400:kworker.0 Request processed in 32us (3645us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773228.885695:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00080000:1.0:1790773228.885737:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790773228.885756:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773228.885793:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14480f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3606:1877761496074368:0@lo:400:kworker.0 00000100:00100000:1.0:1790773228.885829:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773228.885848:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14480c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3606:1877761496074880:0@lo:400:kworker.0 00000100:00100000:1.0:1790773228.885873:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773228.885902:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496075392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790773228.885930:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773228.885973:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790773228.885981:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496075520:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790773228.886012:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773228.886048:0:6483:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496073984 00000100:00100000:1.0:1790773228.886057:0:6483:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496073984 00000100:00100000:1.0:1790773228.886090:0:6483:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496073856 00000100:00100000:1.0:1790773228.886093:0:6483:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496073856 00000100:00100000:1.0:1790773228.886114:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1790773228.886122:0:6483:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496073984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773228.886164:0:6483:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496073984:12345-0@lo:400:kworker.0 Request processed in 43us (4118us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773228.886170:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1790773228.886184:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1790773228.886191:0:6483:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496073856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773228.886253:0:6483:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496073856:12345-0@lo:400:kworker.0 Request processed in 62us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773228.886259:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1790773228.886280:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496075392 00000100:00100000:1.0:1790773228.886284:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496075392 00000100:00100000:1.0:1790773228.886321:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496075520 00000100:00100000:1.0:1790773228.886324:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496075520 00000100:00100000:1.0:1790773228.886345:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1790773228.887719:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3606:x1877761496075392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790773228.887754:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1790773228.887826:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3606:x1877761496075392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1475us (1895us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773228.887834:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1790773228.887859:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1790773228.887874:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496075520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790773228.887885:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1790773228.887910:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496075520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 38us (1898us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773228.887915:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:1.0:1790773228.887949:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790773228.887960:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496074368 00000100:00100000:1.0:1790773228.887965:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496074368 00000100:00100000:1.0:1790773228.888000:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496074880 00000100:00100000:1.0:1790773228.888003:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496074880 00000100:00100000:1.0:1790773228.888020:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1790773228.888026:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1877761496074368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773228.888056:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1877761496074368:12345-0@lo:400:kworker.0 Request processed in 31us (2227us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773228.888062:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1790773228.888075:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1790773228.888080:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3606:x1877761496074880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773228.888107:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3606:x1877761496074880:12345-0@lo:400:kworker.0 Request processed in 27us (2233us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773228.888112:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00080000:1.0:1790773228.888132:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790773228.888174:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496075520:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790773228.888192:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496075392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790773228.888222:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496073856:0@lo:400:kworker.0 00010000:00080000:1.0:1790773228.888239:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d14480f480 x1877761496074368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773228.888257:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14480f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3606:1877761496074368:0@lo:400:kworker.0 00010000:00080000:1.0:1790773228.888271:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d14480c380 x1877761496074880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773228.888279:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14480c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3606:1877761496074880:0@lo:400:kworker.0 00000100:00100000:3.0:1790773228.888361:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496073600 00000100:00100000:3.0:1790773228.888368:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496073600 00000100:00100000:3.0:1790773228.888582:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1790773228.888592:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3604:x1877761496073600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773228.888650:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3604:x1877761496073600:12345-0@lo:400:kworker.0 Request processed in 62us (6931us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773228.888657:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1790773228.889283:0:8906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496074624 00000100:00100000:1.0:1790773228.889291:0:8906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496074624 00000100:00100000:1.0:1790773228.889331:0:8906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496075136 00000100:00100000:1.0:1790773228.889334:0:8906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496075136 00000100:00100000:1.0:1790773228.889368:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1790773228.889376:0:8906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3604:x1877761496074624:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1790773228.889580:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790773228.889714:0:8906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3604:x1877761496074624:12345-0@lo:400:kworker.0 Request processed in 339us (7816us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773228.889721:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1790773228.889737:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1790773228.889743:0:8906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d280b7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3604:x1877761496075136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773228.889769:0:8906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d280b7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3604:x1877761496075136:12345-0@lo:400:kworker.0 Request processed in 27us (7818us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773228.889774:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1790773228.892798:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773228.892921:0:6483:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496075264 00000100:00100000:1.0:1790773228.892930:0:6483:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496075264 00000100:00100000:1.0:1790773228.892973:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1790773228.892983:0:6483:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496075264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790773228.893026:0:6483:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1790773228.893082:0:6483:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496075264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773228.893096:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1790773228.893173:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3605:1877761496073728:0@lo:400:kworker.0 00000100:00100000:0.0:1790773228.893199:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3605:1877761496074240:0@lo:400:kworker.0 00000100:00100000:0.0:1790773228.893237:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14480ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3605:1877761496074752:0@lo:400:kworker.0 00000100:00100000:0.0:1790773228.893252:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496075264:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790773228.893283:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790773228.893294:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496075648:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790773228.893313:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496073984:0@lo:400:kworker.0 00000100:00100000:1.0:1790773228.893324:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14480c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496074496:0@lo:400:kworker.0 00000100:00100000:0.0:1790773228.893333:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773228.893371:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773228.893389:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce0675b4-b0c5-48e7-b182-565e22fed04c:3604:1877761496073600:0@lo:400:kworker.0 00000100:00100000:3.0:1790773228.893433:0:8393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496074496 00000100:00100000:3.0:1790773228.893438:0:8393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496074496 00000100:00100000:3.0:1790773228.893475:0:8393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1790773228.893482:0:8393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496074496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773228.893899:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496075008:0@lo:400:kworker.0 00000100:00100000:1.0:1790773228.893926:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773228.893949:0:8394:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496075008 00000100:00100000:1.0:1790773228.893952:0:8394:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496075008 00000100:00100000:1.0:1790773228.893975:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1790773228.893984:0:8394:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496075008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773228.894015:0:8394:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496075008:12345-0@lo:400:kworker.0 Request processed in 34us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773228.894020:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1790773228.894048:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496075008:0@lo:400:kworker.0 00000100:00100000:0.0:1790773228.895159:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3604:1877761496074112:0@lo:400:kworker.0 00000100:00100000:0.0:1790773228.895180:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14480ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496074624:0@lo:400:kworker.0 00000100:00100000:0.0:1790773228.895192:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496075136:0@lo:400:kworker.0 00000100:00100000:3.0:1790773228.896626:0:8393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496074496:12345-0@lo:400:kworker.0 Request processed in 3138us (3250us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773228.896639:0:8393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1790773228.896678:0:6484:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496075648 00000100:00100000:3.0:1790773228.896686:0:6484:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496075648 00000100:00100000:3.0:1790773228.896726:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1790773228.896734:0:6484:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496075648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790773228.896775:0:6484:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1790773228.896827:0:6484:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496075648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (3496us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773228.896834:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:3.0:1790773228.896870:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790773228.897163:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14480c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496074496:0@lo:400:kworker.0 00000100:00100000:0.0:1790773228.897468:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496075648:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1790773229.393650:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1790773229.402894:0:9475:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00080000:3.0:1790773229.402904:0:8388:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:0.0:1790773229.402922:0:9475:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:2.0:1790773229.403050:0:6457:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00010000:00010000:0.0:1790773229.403186:0:3591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc7842965 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773229.403237:0:3591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc7842965 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773229.403248:0:3591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc7842965 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773229.403257:0:3591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12ac00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773229.403287:0:3591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc7842965 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773229.403298:0:3591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc7842965 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773229.403319:0:3591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93d14363d900) 00010000:00010000:0.0:1790773229.403323:0:3591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773229.403329:0:3591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc7842965 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773229.403335:0:3591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc7842965 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1790773229.403434:0:6457:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93d2465e5c00 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1790773229.403439:0:6457:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93d27c3b9400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93d2465e56c0 00000020:00080000:2.0:1790773229.403443:0:6457:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93d27c3b9100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93d141fdbe00 00000020:00080000:2.0:1790773229.403482:0:6457:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:3.0:1790773229.403549:0:6510:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1790773229.403653:0:6510:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:1.0:1790773230.415684:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773231.441791:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773231.949900:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790773231.949966:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496075776:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790773231.950081:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773231.950311:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790773231.950335:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496075904:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790773231.950376:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773231.950412:0:8397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496075776 00000100:00100000:2.0:1790773231.950420:0:8397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496075776 00000100:00100000:2.0:1790773231.950467:0:8397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496075904 00000100:00100000:2.0:1790773231.950470:0:8397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496075904 00000100:00100000:2.0:1790773231.950489:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1790773231.950497:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496075776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790773231.950546:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790773231.950589:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496075776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773231.950597:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1790773231.950630:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1790773231.950636:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496075904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790773231.950645:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790773231.950670:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496075904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 34us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773231.950676:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1790773231.950716:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496075904:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790773231.950740:0:3604:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1790773231.950744:0:3604:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93d14480d180, transno 4294967311 00000100:00100000:2.0:1790773231.950755:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496075776:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790773231.951310:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790773232.461760:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773232.898331:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773232.898714:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484501120 00000100:00100000:2.0:1790773232.898727:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484501120 00000100:00100000:2.0:1790773232.898881:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 254 00000100:00100000:2.0:1790773232.898893:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+18:12113:x1877761484501120:12345-192.168.202.19@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1790773232.899048:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+18:12113:x1877761484501120:12345-192.168.202.19@tcp:60:lhsmtool_posix.0 Request processed in 158us (1051us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773232.899064:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 254 00000100:00080000:3.0:1790773232.902141:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790773232.907059:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773232.907176:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484501248 00000100:00100000:1.0:1790773232.907186:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484501248 00000100:00100000:1.0:1790773232.907294:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 255 00000100:00100000:1.0:1790773232.907305:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+5:12113:x1877761484501248:12345-192.168.202.19@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1790773232.907425:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:110130ab-04fa-4d7c-984e-562032df4432+5:12113:x1877761484501248:12345-192.168.202.19@tcp:60:lhsmtool_posix.0 Request processed in 122us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773232.907433:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 255 00000100:00080000:3.0:1790773232.908195:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790773232.918797:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773232.919016:0:6482:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484501504 00000100:00100000:2.0:1790773232.919027:0:6482:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484501504 00000100:00100000:2.0:1790773232.919097:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 65 00000100:00100000:2.0:1790773232.919107:0:6482:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+18:12113:x1877761484501504:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790773232.919463:0:6482:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+19:12113:x1877761484501504:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 Request processed in 356us (678us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1790773232.919472:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 65 00010000:00010000:0.0:1790773233.492222:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773233.709709:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773233.709760:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773233.709843:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773233.709881:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773233.709900:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773233.709924:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773233.709948:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773233.709982:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484501888 00000100:00100000:0.0:1790773233.709995:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484501888 00000100:00100000:0.0:1790773233.710068:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484502400 00000100:00100000:0.0:1790773233.710072:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484502400 00000100:00100000:0.0:1790773233.710103:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484501760 00000100:00100000:0.0:1790773233.710105:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484501760 00000100:00100000:0.0:1790773233.710117:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484502272 00000100:00100000:0.0:1790773233.710120:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484502272 00000100:00100000:0.0:1790773233.710161:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 339 00000100:00100000:0.0:1790773233.710172:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+5:2400:x1877761484501888:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1790773233.710285:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+5:2400:x1877761484501888:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 114us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773233.710293:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 339 00000100:00100000:0.0:1790773233.710324:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 340 00000100:00100000:0.0:1790773233.710332:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2400:x1877761484502400:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1790773233.710360:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2400:x1877761484502400:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 29us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773233.710366:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 340 00000100:00100000:0.0:1790773233.710378:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 341 00000100:00100000:0.0:1790773233.710385:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+19:2400:x1877761484501760:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1790773233.710417:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:110130ab-04fa-4d7c-984e-562032df4432+19:2400:x1877761484501760:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 32us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773233.710423:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 341 00000100:00100000:0.0:1790773233.710434:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 342 00000100:00100000:0.0:1790773233.710440:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2400:x1877761484502272:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1790773233.710463:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2400:x1877761484502272:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 23us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773233.710469:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 342 00000100:00080000:0.0:1790773233.710493:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790773233.710498:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790773233.710743:0:8394:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484502144 00000100:00100000:1.0:1790773233.710749:0:8394:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484502144 00000100:00100000:1.0:1790773233.710797:0:8394:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484502016 00000100:00100000:1.0:1790773233.710801:0:8394:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484502016 00000100:00100000:1.0:1790773233.710829:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 133 00000100:00100000:1.0:1790773233.710838:0:8394:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:110130ab-04fa-4d7c-984e-562032df4432+7:2400:x1877761484502144:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773233.710874:0:8394:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:110130ab-04fa-4d7c-984e-562032df4432+7:2400:x1877761484502144:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 38us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773233.710881:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 133 00000100:00100000:1.0:1790773233.710896:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 134 00000100:00100000:1.0:1790773233.710902:0:8394:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:110130ab-04fa-4d7c-984e-562032df4432+5:2400:x1877761484502016:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773233.710927:0:8394:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:110130ab-04fa-4d7c-984e-562032df4432+5:2400:x1877761484502016:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 26us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773233.710932:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 134 00000100:00100000:3.0:1790773233.711120:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484501632 00000100:00100000:3.0:1790773233.711125:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484501632 00000100:00100000:3.0:1790773233.711191:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 395 00000100:00100000:3.0:1790773233.711199:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:2400:x1877761484501632:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1790773233.711264:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:2400:x1877761484501632:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 67us (1573us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773233.711271:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 395 00000100:00080000:0.0:1790773233.711546:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790773233.711551:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790773233.997826:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496076160:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790773233.997918:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773233.998063:0:8397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496076160 00000100:00100000:2.0:1790773233.998071:0:8397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496076160 00000100:00100000:2.0:1790773233.998134:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1790773233.998143:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496076160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790773233.998171:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1790773233.998233:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496076160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773233.998240:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:1.0:1790773233.998310:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790773233.998346:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496076160:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790773233.998667:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790773233.998680:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496076032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790773233.998716:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773233.998746:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496076032 00000100:00100000:0.0:1790773233.998750:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496076032 00000100:00100000:0.0:1790773233.998781:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1790773233.998787:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496076032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790773233.998798:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1790773233.998830:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496076032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773233.998836:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1790773233.998860:0:3606:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:0.0:1790773233.998866:0:3606:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93d144544380, transno 4294967323 00000004:00080000:0.0:1790773233.998875:0:3606:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:0.0:1790773233.998897:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496076032:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1790773233.999015:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790773234.005330:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144545180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496076672:0@lo:400:kworker.0 00000100:00100000:1.0:1790773234.005458:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773234.005513:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3604:1877761496077184:0@lo:400:kworker.0 00000100:00100000:1.0:1790773234.005542:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773234.005560:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3604:1877761496077696:0@lo:400:kworker.0 00000100:00100000:1.0:1790773234.005583:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773234.005635:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1790773234.005642:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144547800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496076288:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790773234.005667:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773234.005683:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144544380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496076800:0@lo:400:kworker.0 00000100:00100000:1.0:1790773234.005707:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773234.005724:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496077312:0@lo:400:kworker.0 00000100:00100000:1.0:1790773234.005753:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773234.005771:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496077824:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790773234.005791:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773234.005826:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496077184 00000100:00100000:1.0:1790773234.005835:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496077184 00000100:00100000:1.0:1790773234.005897:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496077696 00000100:00100000:1.0:1790773234.005900:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496077696 00000100:00100000:1.0:1790773234.005933:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1790773234.005945:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3604:x1877761496077184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773234.006111:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144545880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3607:1877761496076544:0@lo:400:kworker.0 00000100:00100000:3.0:1790773234.006148:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773234.006175:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3607:1877761496077056:0@lo:400:kworker.0 00000100:00100000:3.0:1790773234.006198:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773234.006252:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3607:1877761496077568:0@lo:400:kworker.0 00000100:00100000:3.0:1790773234.006271:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773234.006285:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1790773234.006290:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144545c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce0675b4-b0c5-48e7-b182-565e22fed04c:3607:1877761496076416:0@lo:400:kworker.0 00000100:00100000:3.0:1790773234.006332:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773234.006357:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877761496076928:0@lo:400:kworker.0 00000100:00100000:3.0:1790773234.006379:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773234.006390:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496077440:0@lo:400:kworker.0 00000100:00100000:3.0:1790773234.006412:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773234.006447:0:12789:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496076672 00000100:00100000:3.0:1790773234.006452:0:12789:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496076672 00000100:00100000:3.0:1790773234.006477:0:12789:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496076288 00000100:00100000:3.0:1790773234.006490:0:12789:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496076288 00000100:00100000:3.0:1790773234.006504:0:12789:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496076800 00000100:00100000:3.0:1790773234.006506:0:12789:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496076800 00000100:00100000:3.0:1790773234.006517:0:12789:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496077824 00000100:00100000:3.0:1790773234.006519:0:12789:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496077824 00000100:00100000:3.0:1790773234.006529:0:12789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1790773234.006535:0:12789:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:3604:x1877761496076672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773234.006583:0:12789:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:3604:x1877761496076672:12345-0@lo:400:kworker.0 Request processed in 47us (1125us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773234.006590:0:12789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1790773234.006610:0:12789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1790773234.006615:0:12789:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496076288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790773234.006648:0:12789:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1790773234.006684:0:12789:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496076288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (1017us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773234.006691:0:12789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1790773234.006704:0:12789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1790773234.006710:0:12789:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3604:x1877761496076800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773234.006739:0:12789:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3604:x1877761496076800:12345-0@lo:400:kworker.0 Request processed in 30us (1031us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773234.006746:0:12789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1790773234.006757:0:12789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1790773234.006764:0:12789:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14480c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496077824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790773234.006784:0:12789:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1790773234.006813:0:12789:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14480c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496077824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 49us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773234.006819:0:12789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1790773234.006851:0:8906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496077312 00000100:00100000:3.0:1790773234.006855:0:8906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496077312 00000100:00100000:3.0:1790773234.006883:0:8906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496077440 00000100:00100000:3.0:1790773234.006886:0:8906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496077440 00000100:00100000:3.0:1790773234.006910:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1790773234.006917:0:8906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14480d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496077312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773234.006952:0:8906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14480d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496077312:12345-0@lo:400:kworker.0 Request processed in 36us (1198us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773234.006959:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1790773234.006970:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1790773234.006976:0:8906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496077440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773234.007025:0:8906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496077440:12345-0@lo:400:kworker.0 Request processed in 49us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773234.007031:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1790773234.007049:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496076416 00000100:00100000:3.0:1790773234.007052:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496076416 00000100:00100000:3.0:1790773234.007077:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1790773234.007084:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3607:x1877761496076416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773234.007115:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3607:x1877761496076416:12345-0@lo:400:kworker.0 Request processed in 31us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773234.007121:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1790773234.007154:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496076544 00000100:00100000:3.0:1790773234.007158:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496076544 00000100:00100000:3.0:1790773234.007174:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496077056 00000100:00100000:3.0:1790773234.007177:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496077056 00000100:00100000:3.0:1790773234.007189:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496077568 00000100:00100000:3.0:1790773234.007191:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496077568 00000100:00100000:3.0:1790773234.007200:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496076928 00000100:00100000:3.0:1790773234.007202:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496076928 00000100:00100000:3.0:1790773234.007256:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1790773234.007262:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3604:x1877761496077696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773234.007291:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3604:x1877761496077696:12345-0@lo:400:kworker.0 Request processed in 30us (1708us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773234.007298:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1790773234.007324:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1790773234.007330:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1877761496076544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773234.007357:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1877761496076544:12345-0@lo:400:kworker.0 Request processed in 27us (1209us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773234.007362:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1790773234.007373:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1790773234.007378:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1877761496077056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773234.007405:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1877761496077056:12345-0@lo:400:kworker.0 Request processed in 27us (1206us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773234.007412:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1790773234.007422:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1790773234.007428:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1877761496077568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773234.007455:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1877761496077568:12345-0@lo:400:kworker.0 Request processed in 27us (1182us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773234.007461:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1790773234.007471:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1790773234.007476:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877761496076928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773234.007500:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877761496076928:12345-0@lo:400:kworker.0 Request processed in 24us (1120us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773234.007505:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1790773234.007568:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144545c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce0675b4-b0c5-48e7-b182-565e22fed04c:3607:1877761496076416:0@lo:400:kworker.0 00000100:00100000:3.0:1790773234.007583:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877761496076928:0@lo:400:kworker.0 00000100:00100000:3.0:1790773234.007593:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496077440:0@lo:400:kworker.0 00000100:00100000:3.0:1790773234.007603:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144545880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3607:1877761496076544:0@lo:400:kworker.0 00000100:00100000:3.0:1790773234.007611:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3607:1877761496077056:0@lo:400:kworker.0 00000100:00100000:3.0:1790773234.007622:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3607:1877761496077568:0@lo:400:kworker.0 00000100:00100000:3.0:1790773234.007742:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144547800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496076288:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790773234.007754:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144544380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496076800:0@lo:400:kworker.0 00000100:00100000:3.0:1790773234.007766:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496077312:0@lo:400:kworker.0 00000100:00100000:3.0:1790773234.007777:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496077824:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790773234.007787:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144545180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496076672:0@lo:400:kworker.0 00010000:00080000:3.0:1790773234.007803:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f9f5880 x1877761496077696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773234.007814:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3604:1877761496077696:0@lo:400:kworker.0 00000100:00100000:1.0:1790773234.007969:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3604:x1877761496077184:12345-0@lo:400:kworker.0 Request processed in 2026us (2425us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773234.007978:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00080000:0.0:1790773234.008642:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790773234.008650:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790773234.008654:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1790773234.009902:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f9f4380 x1877761496077184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773234.009919:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3604:1877761496077184:0@lo:400:kworker.0 00010000:00010000:1.0:1790773234.510248:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1790773235.040265:0:6457:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:0.0:1790773235.040364:0:6457:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1790773235.041553:0:6510:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1790773235.041585:0:6510:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:02000400:3.0:1790773235.159034:0:14923:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 09:00:33 (1790773233) 00010000:00010000:2.0:1790773235.534434:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790773236.558113:0:13753:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790773236.559562:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790773237.006459:0:13749:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790773237.006470:0:13749:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790773237.006589:0:13749:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1790773237.006596:0:13749:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790773237.069734:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790773237.069757:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14480ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496077952:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790773237.069833:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773237.069948:0:11145:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496077952 00000100:00100000:1.0:1790773237.069956:0:11145:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496077952 00000100:00100000:1.0:1790773237.070024:0:11145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1790773237.070034:0:11145:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14480ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496077952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790773237.070064:0:11145:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1790773237.070112:0:11145:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14480ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496077952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773237.070119:0:11145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:1.0:1790773237.070142:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790773237.070179:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14480ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496077952:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790773237.071734:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496078080:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790773237.074473:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773237.074935:0:8397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496078080 00000100:00100000:0.0:1790773237.074946:0:8397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496078080 00000100:00100000:0.0:1790773237.075029:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00080000:3.0:1790773237.075038:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790773237.075039:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14480ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496078080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790773237.075066:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790773237.075673:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14480ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496078080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 633us (1205us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773237.075690:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1790773237.075829:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496078080:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790773237.292917:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773237.293324:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484502528 00000100:00100000:3.0:1790773237.293341:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484502528 00000100:00100000:3.0:1790773237.293489:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 256 00000100:00100000:3.0:1790773237.293500:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:13133:x1877761484502528:12345-192.168.202.19@tcp:101:lsof.0 00010000:00010000:3.0:1790773237.293520:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773237.293574:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc78429f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bf67 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773237.293641:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc78429f8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773237.293655:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc78429f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773237.293669:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc78429f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790773237.293716:0:6478:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1790773237.293720:0:6478:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790773237.293756:0:6478:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc78429f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773237.293779:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ada00/0xabf1cc0bc78429f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf67 expref: 7 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773237.293798:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc78429f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf67 expref: 6 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773237.293807:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d26ede0b00) 00010000:00010000:3.0:1790773237.293824:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790773237.293828:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d1434ade00, rc 0) 00000100:00100000:3.0:1790773237.293909:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+6:13133:x1877761484502528:12345-192.168.202.19@tcp:101:lsof.0 Request processed in 411us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773237.293916:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 256 00000100:00080000:1.0:1790773237.295836:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790773237.581512:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773238.605590:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773238.620806:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773238.620926:0:14187:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484502784 00000100:00100000:2.0:1790773238.620941:0:14187:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484502784 00000100:00100000:2.0:1790773238.621152:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 66 00000100:00100000:2.0:1790773238.621167:0:14187:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:110130ab-04fa-4d7c-984e-562032df4432+18:13134:x1877761484502784:12345-192.168.202.19@tcp:35:umount.0 00000100:00100000:2.0:1790773238.621670:0:14187:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:110130ab-04fa-4d7c-984e-562032df4432+19:13134:x1877761484502784:12345-192.168.202.19@tcp:35:umount.0 Request processed in 507us (874us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1790773238.621681:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 66 00000100:00080000:0.0:1790773238.621827:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790773238.625381:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773238.625501:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484503040 00000100:00100000:3.0:1790773238.625510:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484503040 00000100:00100000:3.0:1790773238.625555:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 67 00000100:00100000:3.0:1790773238.625563:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:110130ab-04fa-4d7c-984e-562032df4432+19:13134:x1877761484503040:12345-192.168.202.19@tcp:35:umount.0 00000100:00100000:3.0:1790773238.625806:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:110130ab-04fa-4d7c-984e-562032df4432+20:13134:x1877761484503040:12345-192.168.202.19@tcp:35:umount.0 Request processed in 244us (434us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1790773238.625811:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 67 00000100:00100000:1.0:1790773238.630342:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773238.630442:0:14187:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484503296 00000100:00100000:2.0:1790773238.630451:0:14187:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484503296 00000100:00100000:2.0:1790773238.630734:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 68 00000100:00100000:2.0:1790773238.630743:0:14187:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d246a15450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:110130ab-04fa-4d7c-984e-562032df4432+20:13134:x1877761484503296:12345-192.168.202.19@tcp:35:umount.0 00000100:00100000:2.0:1790773238.630966:0:14187:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d246a15450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:110130ab-04fa-4d7c-984e-562032df4432+21:13134:x1877761484503296:12345-192.168.202.19@tcp:35:umount.0 Request processed in 224us (634us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1790773238.630972:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 68 00000100:00100000:0.0:1790773238.634807:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773238.634911:0:6482:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484503552 00000100:00100000:1.0:1790773238.634920:0:6482:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484503552 00000100:00100000:1.0:1790773238.635007:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 69 00000100:00100000:1.0:1790773238.635015:0:6482:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+21:13134:x1877761484503552:12345-192.168.202.19@tcp:35:umount.0 00000100:00100000:1.0:1790773238.635362:0:6482:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:110130ab-04fa-4d7c-984e-562032df4432+22:13134:x1877761484503552:12345-192.168.202.19@tcp:35:umount.0 Request processed in 345us (566us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1790773238.635369:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 69 00000100:00100000:1.0:1790773238.642855:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773238.642910:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773238.643027:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773238.648871:0:10300:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484503680 00000100:00100000:0.0:1790773238.648895:0:10300:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484503680 00000100:00100000:0.0:1790773238.649069:0:10300:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484503936 00000100:00100000:0.0:1790773238.649074:0:10300:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484503936 00000100:00100000:0.0:1790773238.649100:0:10300:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484503808 00000100:00100000:0.0:1790773238.649103:0:10300:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484503808 00000100:00100000:0.0:1790773238.649133:0:10300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00100000:0.0:1790773238.649146:0:10300:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14480f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3f7e9812-a56a-4fd4-8715-b93ef4652f29+15:2397:x1877761484503680:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790773238.649173:0:10300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773238.649221:0:10300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d26c4a3400/0xabf1cc0bc7841951 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bac1 expref: 15 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773238.649249:0:10300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790773238.649794:0:10300:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14480f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3f7e9812-a56a-4fd4-8715-b93ef4652f29+14:2397:x1877761484503680:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 647us (6952us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773238.649806:0:10300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00100000:0.0:1790773238.649837:0:10300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:0.0:1790773238.649845:0:10300:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14480fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3f7e9812-a56a-4fd4-8715-b93ef4652f29+13:2397:x1877761484503936:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790773238.649856:0:10300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773238.649868:0:10300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d1434aca00/0xabf1cc0bc7841c22 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb9a expref: 13 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773238.649904:0:10300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790773238.649930:0:10300:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14480fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3f7e9812-a56a-4fd4-8715-b93ef4652f29+12:2397:x1877761484503936:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 85us (7019us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773238.649938:0:10300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:0.0:1790773238.650019:0:10300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 22 00000100:00100000:0.0:1790773238.650027:0:10300:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14480dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3f7e9812-a56a-4fd4-8715-b93ef4652f29+11:2397:x1877761484503808:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790773238.650039:0:10300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773238.650050:0:10300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d279de3a00/0xabf1cc0bc7841912 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6ba82 expref: 11 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773238.650060:0:10300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790773238.650079:0:10300:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14480dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3f7e9812-a56a-4fd4-8715-b93ef4652f29+10:2397:x1877761484503808:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 53us (7053us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773238.650086:0:10300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 22 00000100:00100000:0.0:1790773238.654782:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773238.654892:0:8392:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484504320 00000100:00100000:2.0:1790773238.654906:0:8392:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484504320 00000100:00100000:2.0:1790773238.655110:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 80 00000100:00100000:2.0:1790773238.655126:0:8392:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:110130ab-04fa-4d7c-984e-562032df4432+7:2396:x1877761484504320:12345-192.168.202.19@tcp:9:umount.0 00000020:00000080:2.0:1790773238.655177:0:8392:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7841f6a 00000020:00010000:2.0:1790773238.655187:0:8392:0:(genops.c:1920:obd_stale_export_put()) Put export ffff93d27fa2d800: total 0 00000100:00080000:2.0:1790773238.655193:0:8392:0:(import.c:65:import_set_state_nolock()) ffff93d27fa2e000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790773238.655310:0:8392:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1790773238.655539:0:8392:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:110130ab-04fa-4d7c-984e-562032df4432+5:2396:x1877761484504320:12345-192.168.202.19@tcp:9:umount.0 Request processed in 418us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773238.655548:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 80 00000100:00080000:0.0:1790773238.655663:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00010000:1.0:1790773238.655805:0:6466:0:(genops.c:1906:obd_stale_export_get()) Get export ffff93d27fa2d800: total 0 00010000:00010000:1.0:1790773238.655854:0:6466:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93d27fa2d800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1790773238.655930:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ac0d10f/0xabf1cc0bc78429ea lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf60 expref: 4 pid: 8394 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773238.655982:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005dcf15f4/0xabf1cc0bc7842329 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd84 expref: 3 pid: 8393 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773238.655999:0:6466:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93d27fa2d800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1790773238.656011:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773238.656013:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773238.656015:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773238.664725:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773238.664855:0:8393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484504448 00000100:00100000:3.0:1790773238.664870:0:8393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484504448 00000100:00100000:3.0:1790773238.664985:0:8393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 81 00000100:00100000:3.0:1790773238.664998:0:8393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:110130ab-04fa-4d7c-984e-562032df4432+5:2396:x1877761484504448:12345-192.168.202.19@tcp:9:umount.0 00000020:00000080:3.0:1790773238.665055:0:8393:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7841cfb 00000100:00080000:3.0:1790773238.665069:0:8393:0:(import.c:65:import_set_state_nolock()) ffff93d143f87800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790773238.665150:0:8393:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00010000:00010000:1.0:1790773238.665277:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790773238.665594:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790773238.665829:0:8393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:110130ab-04fa-4d7c-984e-562032df4432+2:2396:x1877761484504448:12345-192.168.202.19@tcp:9:umount.0 Request processed in 830us (1127us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773238.665840:0:8393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 81 00000100:00100000:1.0:1790773238.686983:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773238.687059:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484505472 00000100:00100000:3.0:1790773238.687076:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484505472 00000100:00100000:3.0:1790773238.687168:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 257 00000100:00100000:3.0:1790773238.687182:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14480d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+22:2396:x1877761484505472:12345-192.168.202.19@tcp:39:umount.0 00000020:00000080:3.0:1790773238.687324:0:13768:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7841920 00000020:00010000:3.0:1790773238.687353:0:13768:0:(genops.c:1920:obd_stale_export_put()) Put export ffff93d1437ec000: total 0 00000100:00080000:3.0:1790773238.687361:0:13768:0:(import.c:65:import_set_state_nolock()) ffff93d1437ea000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790773238.687408:0:13768:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000020:00010000:2.0:1790773238.687471:0:6467:0:(genops.c:1906:obd_stale_export_get()) Get export ffff93d1437ec000: total 0 00010000:00010000:2.0:1790773238.687559:0:6467:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93d1437ec000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1790773238.687767:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93d26ede0200) 00010000:00010000:2.0:1790773238.687782:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1790773238.687801:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074a400/0xabf1cc0bc7842314 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd7d expref: 21 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773238.687835:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93d26ede0c00) 00010000:00010000:2.0:1790773238.687838:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790773238.687842:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad000/0xabf1cc0bc784268d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6be79 expref: 21 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773238.687866:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93d14363d100) 00010000:00010000:2.0:1790773238.687869:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790773238.687876:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434acc00/0xabf1cc0bc7841fcc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bc9d expref: 21 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773238.687924:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93d26ede0100) 00010000:00010000:2.0:1790773238.687927:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790773238.687949:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074be00/0xabf1cc0bc78429ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf4b expref: 18 pid: 14584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773238.687966:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93d26ede0500) 00010000:00010000:2.0:1790773238.687969:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790773238.687973:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b600/0xabf1cc0bc7841c76 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbaf expref: 17 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773238.687995:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93d26ede0100) 00010000:00010000:2.0:1790773238.687998:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1790773238.688001:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc78429d5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf59 expref: 16 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773238.688016:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93d26ede0200) 00010000:00010000:2.0:1790773238.688018:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790773238.688022:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ac800/0xabf1cc0bc784220a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd37 expref: 15 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773238.688035:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d26ede0b00) 00010000:00010000:2.0:1790773238.688037:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790773238.688041:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b800/0xabf1cc0bc7842384 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd99 expref: 14 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773238.688054:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93d26ede0100) 00010000:00010000:2.0:1790773238.688056:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790773238.688069:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074b000/0xabf1cc0bc78428cb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf13 expref: 13 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773238.688089:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93d280936b00) 00010000:00010000:2.0:1790773238.688092:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790773238.688099:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ad800/0xabf1cc0bc7841c5a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bba8 expref: 12 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773238.688117:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff93d26ede0c00) 00010000:00010000:2.0:1790773238.688119:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1790773238.688123:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc78423a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bda0 expref: 11 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773238.688142:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14480d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:110130ab-04fa-4d7c-984e-562032df4432+10:2396:x1877761484505472:12345-192.168.202.19@tcp:39:umount.0 Request processed in 958us (1173us total) trans 4294967527 rc 0/0 00010000:00010000:2.0:1790773238.688144:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff93d14363d100) 00010000:00010000:2.0:1790773238.688159:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00000100:00100000:3.0:1790773238.688169:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 257 00010000:00010000:2.0:1790773238.688170:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26efc5400/0xabf1cc0bc7841cd1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bbc4 expref: 10 pid: 8697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773238.688442:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff93d26ede0200) 00010000:00010000:2.0:1790773238.688446:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790773238.688452:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc78422ea lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bd6f expref: 8 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773238.688470:0:6467:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93d1437ec000, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1790773238.688519:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773238.688522:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773238.688526:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773238.708437:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773238.708627:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484505600 00000100:00100000:1.0:1790773238.708643:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484505600 00000100:00100000:1.0:1790773238.708767:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 258 00000100:00100000:1.0:1790773238.708779:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+5:2396:x1877761484505600:12345-192.168.202.19@tcp:39:umount.0 00000020:00000080:1.0:1790773238.708830:0:6479:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7841927 00000100:00080000:1.0:1790773238.708854:0:6479:0:(import.c:65:import_set_state_nolock()) ffff93d1437e9800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790773238.708893:0:6479:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1790773238.709148:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:110130ab-04fa-4d7c-984e-562032df4432+3:2396:x1877761484505600:12345-192.168.202.19@tcp:39:umount.0 Request processed in 370us (728us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1790773238.709158:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 258 00000100:00080000:0.0:1790773238.710248:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1790773238.714437:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773238.829638:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773238.829690:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773238.829883:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484505856 00000100:00100000:1.0:1790773238.829895:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484505856 00000100:00100000:1.0:1790773238.830313:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484505728 00000100:00100000:1.0:1790773238.830316:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484505728 00000100:00100000:1.0:1790773238.830354:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 349 00000100:00100000:1.0:1790773238.830363:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2400:x1877761484505856:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1790773238.830419:0:14584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 350 00000100:00100000:1.0:1790773238.830453:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2400:x1877761484505856:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 86us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773238.830456:0:14584:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+6:2400:x1877761484505728:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773238.830461:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 349 00000100:00100000:2.0:1790773238.830555:0:14584:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+6:2400:x1877761484505728:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 120us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773238.830564:0:14584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 350 00000100:00080000:0.0:1790773238.831008:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790773239.119873:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3605:1877761496078336:0@lo:400:kworker.0 00000100:00100000:0.0:1790773239.119953:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773239.120013:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3605:1877761496078848:0@lo:400:kworker.0 00000100:00100000:0.0:1790773239.120053:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773239.120074:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3605:1877761496079360:0@lo:400:kworker.0 00000100:00100000:0.0:1790773239.120090:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773239.120113:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1790773239.120118:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce0675b4-b0c5-48e7-b182-565e22fed04c:3605:1877761496078208:0@lo:400:kworker.0 00000100:00100000:0.0:1790773239.120146:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773239.120161:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3605:1877761496078720:0@lo:400:kworker.0 00000100:00100000:0.0:1790773239.120176:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773239.120192:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496078464:0@lo:400:kworker.0 00000100:00100000:0.0:1790773239.120201:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496079232:0@lo:400:kworker.0 00000100:00100000:0.0:1790773239.120288:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773239.120316:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496079744:0@lo:400:kworker.0 00000100:00100000:2.0:1790773239.120333:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773239.120351:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773239.120379:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3606:1877761496078976:0@lo:400:kworker.0 00000100:00100000:0.0:1790773239.120383:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496079872:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790773239.120438:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773239.120450:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773239.120477:0:6473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496078208 00000100:00100000:2.0:1790773239.120486:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3606:1877761496079488:0@lo:400:kworker.0 00000100:00100000:0.0:1790773239.120486:0:6473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496078208 00000100:00100000:2.0:1790773239.120531:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773239.120538:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:0.0:1790773239.120545:0:6473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3605:x1877761496078208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773239.120570:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1790773239.120581:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496078592:0@lo:400:kworker.0 00000100:00100000:0.0:1790773239.120597:0:6473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3605:x1877761496078208:12345-0@lo:400:kworker.0 Request processed in 51us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773239.120604:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:2.0:1790773239.120623:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773239.120646:0:8906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496079232 00000100:00100000:0.0:1790773239.120650:0:8906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496079232 00000100:00100000:2.0:1790773239.120658:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496079104:0@lo:400:kworker.0 00000100:00100000:0.0:1790773239.120681:0:8906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496079744 00000100:00100000:0.0:1790773239.120684:0:8906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496079744 00000100:00100000:2.0:1790773239.120700:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773239.120708:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1790773239.120730:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496079616:0@lo:400:kworker.0 00000100:00100000:0.0:1790773239.120730:0:8906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496079232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773239.120793:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773239.120798:0:8906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496079232:12345-0@lo:400:kworker.0 Request processed in 72us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773239.120803:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1790773239.120811:0:8906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496079104 00000100:00100000:0.0:1790773239.120813:0:8906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496079104 00000100:00100000:0.0:1790773239.120838:0:8906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496079616 00000100:00100000:0.0:1790773239.120840:0:8906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496079616 00000100:00100000:0.0:1790773239.120856:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1790773239.120861:0:8906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496079744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773239.120878:0:8906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496079744:12345-0@lo:400:kworker.0 Request processed in 17us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773239.120882:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1790773239.120888:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1790773239.120891:0:8906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496079104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773239.120909:0:8906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496079104:12345-0@lo:400:kworker.0 Request processed in 18us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773239.120913:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1790773239.120919:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1790773239.120922:0:8906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496079616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773239.120944:0:8906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496079616:12345-0@lo:400:kworker.0 Request processed in 21us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773239.120949:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1790773239.120969:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496078336 00000100:00100000:0.0:1790773239.120972:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496078336 00000100:00100000:0.0:1790773239.120989:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496078848 00000100:00100000:0.0:1790773239.120991:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496078848 00000100:00100000:0.0:1790773239.121013:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496079360 00000100:00100000:0.0:1790773239.121016:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496079360 00000100:00100000:0.0:1790773239.121027:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496078720 00000100:00100000:0.0:1790773239.121029:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496078720 00000100:00100000:0.0:1790773239.121039:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496078976 00000100:00100000:0.0:1790773239.121041:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496078976 00000100:00100000:0.0:1790773239.121051:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496079488 00000100:00100000:0.0:1790773239.121053:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496079488 00000100:00100000:0.0:1790773239.121060:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1790773239.121064:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3605:x1877761496078336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773239.121087:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3605:x1877761496078336:12345-0@lo:400:kworker.0 Request processed in 23us (1135us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773239.121091:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1790773239.121097:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1790773239.121101:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3605:x1877761496078848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773239.121115:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3605:x1877761496078848:12345-0@lo:400:kworker.0 Request processed in 14us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773239.121118:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1790773239.121124:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1790773239.121127:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3605:x1877761496079360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773239.121139:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3605:x1877761496079360:12345-0@lo:400:kworker.0 Request processed in 12us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773239.121143:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1790773239.121148:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1790773239.121151:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3605:x1877761496078720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773239.121163:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3605:x1877761496078720:12345-0@lo:400:kworker.0 Request processed in 13us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773239.121174:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1790773239.121185:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1790773239.121190:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1877761496078976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773239.121245:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1877761496078976:12345-0@lo:400:kworker.0 Request processed in 55us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773239.121251:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1790773239.121275:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1790773239.121281:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3606:x1877761496079488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773239.121310:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3606:x1877761496079488:12345-0@lo:400:kworker.0 Request processed in 29us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773239.121315:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1790773239.121347:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce0675b4-b0c5-48e7-b182-565e22fed04c:3605:1877761496078208:0@lo:400:kworker.0 00000100:00100000:0.0:1790773239.121357:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3605:1877761496078720:0@lo:400:kworker.0 00000100:00100000:0.0:1790773239.121363:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496079232:0@lo:400:kworker.0 00000100:00100000:0.0:1790773239.121369:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496079744:0@lo:400:kworker.0 00000100:00100000:0.0:1790773239.121375:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3605:1877761496078336:0@lo:400:kworker.0 00000100:00100000:0.0:1790773239.121381:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3605:1877761496078848:0@lo:400:kworker.0 00000100:00100000:0.0:1790773239.121386:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3605:1877761496079360:0@lo:400:kworker.0 00000100:00080000:0.0:1790773239.121414:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790773239.121418:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790773239.121419:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790773239.121421:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790773239.121470:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496079104:0@lo:400:kworker.0 00000100:00100000:0.0:1790773239.121478:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496079616:0@lo:400:kworker.0 00010000:00080000:0.0:1790773239.121488:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1437d5f80 x1877761496078976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773239.121496:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3606:1877761496078976:0@lo:400:kworker.0 00010000:00080000:0.0:1790773239.121503:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1437d6680 x1877761496079488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773239.121507:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3606:1877761496079488:0@lo:400:kworker.0 00000100:00100000:1.0:1790773239.121624:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790773239.121632:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14480c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496080000:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790773239.121655:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773239.121675:0:7666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496078464 00000100:00100000:1.0:1790773239.121678:0:7666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496078464 00000100:00100000:1.0:1790773239.121692:0:7666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496079872 00000100:00100000:1.0:1790773239.121694:0:7666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496079872 00000100:00100000:1.0:1790773239.121698:0:7666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496078592 00000100:00100000:1.0:1790773239.121700:0:7666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496078592 00000100:00100000:1.0:1790773239.121707:0:7666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496080000 00000100:00100000:1.0:1790773239.121708:0:7666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496080000 00000100:00100000:1.0:1790773239.121715:0:7666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1790773239.121718:0:7666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3606:x1877761496078464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773239.121740:0:7666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3606:x1877761496078464:12345-0@lo:400:kworker.0 Request processed in 22us (1411us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773239.121744:0:7666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1790773239.121753:0:7666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1790773239.121756:0:7666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496079872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790773239.121775:0:7666:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1790773239.121796:0:7666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496079872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 40us (1358us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773239.121800:0:7666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1790773239.121814:0:7666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1790773239.121817:0:7666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3606:x1877761496078592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773239.121836:0:7666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3606:x1877761496078592:12345-0@lo:400:kworker.0 Request processed in 19us (1217us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773239.121840:0:7666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1790773239.121846:0:7666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1790773239.121849:0:7666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14480ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496080000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790773239.121859:0:7666:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1790773239.121877:0:7666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14480ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496080000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 28us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773239.121881:0:7666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1790773239.121899:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14480c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496080000:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790773239.121919:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496079872:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790773239.121935:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496078592:0@lo:400:kworker.0 00000100:00100000:1.0:1790773239.121943:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496078464:0@lo:400:kworker.0 00000100:00100000:1.0:1790773239.124327:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496080128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790773239.124381:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773239.124662:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496080128 00000100:00100000:3.0:1790773239.124671:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496080128 00000100:00100000:3.0:1790773239.124730:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1790773239.124739:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14480c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496080128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790773239.124782:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1790773239.124831:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14480c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496080128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773239.124838:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1790773239.125027:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496080128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790773239.129445:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790773239.129470:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496080256:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790773239.129550:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773239.129664:0:11145:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496080256 00000100:00100000:2.0:1790773239.129684:0:11145:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496080256 00000100:00100000:2.0:1790773239.129789:0:11145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1790773239.129802:0:11145:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14480c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496080256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790773239.129840:0:11145:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1790773239.129967:0:11145:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14480c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496080256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 167us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773239.129977:0:11145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1790773239.130200:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496080256:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1790773239.629501:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773239.845046:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773239.845103:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773239.845202:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773239.845405:0:10300:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484506240 00000100:00100000:0.0:1790773239.845417:0:10300:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484506240 00000100:00100000:0.0:1790773239.845492:0:10300:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484506112 00000100:00100000:0.0:1790773239.845496:0:10300:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484506112 00000100:00100000:0.0:1790773239.845517:0:10300:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484505984 00000100:00100000:0.0:1790773239.845519:0:10300:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484505984 00000100:00100000:0.0:1790773239.845540:0:10300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 23 00000100:00100000:0.0:1790773239.845551:0:10300:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2461f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3f7e9812-a56a-4fd4-8715-b93ef4652f29+12:2399:x1877761484506240:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790773239.845574:0:10300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773239.845602:0:10300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d25074ac00/0xabf1cc0bc7841c1b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb93 expref: 12 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773239.845625:0:10300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790773239.845700:0:10300:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2461f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3f7e9812-a56a-4fd4-8715-b93ef4652f29+11:2399:x1877761484506240:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 150us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773239.845735:0:10300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 23 00000100:00100000:0.0:1790773239.845803:0:10300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 24 00000100:00100000:0.0:1790773239.845811:0:10300:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14480f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3f7e9812-a56a-4fd4-8715-b93ef4652f29+10:2397:x1877761484506112:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790773239.845818:0:10300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773239.845828:0:10300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d1434ad600/0xabf1cc0bc7841a2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bb07 expref: 10 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773239.845837:0:10300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790773239.845872:0:10300:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14480f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3f7e9812-a56a-4fd4-8715-b93ef4652f29+9:2397:x1877761484506112:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 62us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773239.845880:0:10300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 24 00000100:00100000:0.0:1790773239.845895:0:10300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 25 00000100:00100000:0.0:1790773239.845903:0:10300:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3f7e9812-a56a-4fd4-8715-b93ef4652f29+8:2397:x1877761484505984:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790773239.845911:0:10300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773239.845919:0:10300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d1434ac000/0xabf1cc0bc7841a23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bad6 expref: 8 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773239.845928:0:10300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790773239.845944:0:10300:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3f7e9812-a56a-4fd4-8715-b93ef4652f29+7:2397:x1877761484505984:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 43us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773239.845951:0:10300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 25 00000100:00100000:0.0:1790773239.849918:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773239.850016:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484506496 00000100:00100000:1.0:1790773239.850049:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484506496 00000100:00100000:1.0:1790773239.850193:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 259 00000100:00100000:1.0:1790773239.850234:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+6:2396:x1877761484506496:12345-192.168.202.19@tcp:39:umount.0 00000020:00000080:1.0:1790773239.850297:0:8697:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7841a3f 00000020:00010000:1.0:1790773239.850305:0:8697:0:(genops.c:1920:obd_stale_export_put()) Put export ffff93d281bd6800: total 0 00000100:00080000:1.0:1790773239.850310:0:8697:0:(import.c:65:import_set_state_nolock()) ffff93d281bd5800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790773239.850344:0:8697:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:1.0:1790773239.850551:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2396:x1877761484506496:12345-192.168.202.19@tcp:39:umount.0 Request processed in 347us (646us total) trans 4294967528 rc 0/0 00000100:00100000:1.0:1790773239.850561:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 259 00000020:00010000:3.0:1790773239.850624:0:6467:0:(genops.c:1906:obd_stale_export_get()) Get export ffff93d281bd6800: total 0 00010000:00010000:3.0:1790773239.850630:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773239.850685:0:6467:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93d281bd6800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1790773239.850724:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d26ede0b00) 00010000:00010000:3.0:1790773239.850728:0:6467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790773239.850737:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d1434ade00/0xabf1cc0bc78429f8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf67 expref: 4 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773239.850766:0:6467:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93d281bd6800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1790773239.850775:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773239.850785:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773239.850787:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790773239.854439:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790773239.862426:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773239.862644:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484506624 00000100:00100000:0.0:1790773239.862655:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484506624 00000100:00100000:0.0:1790773239.862718:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 260 00000100:00100000:0.0:1790773239.862740:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+5:2396:x1877761484506624:12345-192.168.202.19@tcp:39:umount.0 00000020:00000080:0.0:1790773239.862781:0:6480:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7841a38 00000100:00080000:0.0:1790773239.862791:0:6480:0:(import.c:65:import_set_state_nolock()) ffff93d1434cf000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790773239.862818:0:6480:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1790773239.862994:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f+3:2396:x1877761484506624:12345-192.168.202.19@tcp:39:umount.0 Request processed in 255us (583us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1790773239.863003:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 260 00010000:00010000:3.0:1790773239.863095:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773239.901350:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773239.901703:0:6471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484506880 00000100:00100000:0.0:1790773239.901720:0:6471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484506880 00000100:00100000:0.0:1790773239.901819:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 398 00000100:00100000:0.0:1790773239.901831:0:6471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+7:2396:x1877761484506880:12345-192.168.202.19@tcp:251:umount.0 00000020:00000080:0.0:1790773239.901910:0:6471:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc78418fd 00000020:00010000:0.0:1790773239.901922:0:6471:0:(genops.c:1920:obd_stale_export_put()) Put export ffff93d143c82800: total 0 00000100:00080000:0.0:1790773239.901929:0:6471:0:(import.c:65:import_set_state_nolock()) ffff93d143c86800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1790773239.902053:0:6471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f7e9812-a56a-4fd4-8715-b93ef4652f29+3:2396:x1877761484506880:12345-192.168.202.19@tcp:251:umount.0 Request processed in 223us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773239.902062:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 398 00000020:00010000:2.0:1790773239.902299:0:8409:0:(genops.c:1906:obd_stale_export_get()) Get export ffff93d143c82800: total 0 00010000:00010000:2.0:1790773239.902366:0:8409:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93d143c82800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1790773239.902404:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d26c4a3800/0xabf1cc0bc7841958 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bac8 expref: 2 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773239.902418:0:8409:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93d143c82800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1790773239.902429:0:8409:0:(genops.c:885:class_export_put()) final put ffff93d143c82800/3f7e9812-a56a-4fd4-8715-b93ef4652f29 00010000:00010000:2.0:1790773239.902443:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773239.902445:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773239.902447:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790773239.902983:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d143c82800/3f7e9812-a56a-4fd4-8715-b93ef4652f29 for MGS 00000020:00000080:0.0:1790773239.903033:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d143c86800 for MGS 00010000:00010000:3.0:1790773240.653570:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773241.677397:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1790773242.174856:0:15118:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000100:00100000:0.0:1790773242.190050:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496080384:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790773242.190167:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773242.190535:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790773242.190556:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496080512:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790773242.190595:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773242.190663:0:11145:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496080384 00000100:00100000:2.0:1790773242.190673:0:11145:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496080384 00000100:00100000:2.0:1790773242.190727:0:11145:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496080512 00000100:00100000:2.0:1790773242.190729:0:11145:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496080512 00000100:00100000:2.0:1790773242.190743:0:11145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1790773242.190750:0:11145:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496080384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790773242.190788:0:11145:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1790773242.190808:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1790773242.190821:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496080512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790773242.190837:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790773242.190838:0:11145:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496080384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773242.190848:0:11145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:2.0:1790773242.190872:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790773242.190888:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496080512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773242.190917:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496080512:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790773242.190946:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496080384:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790773242.191393:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000020:01000004:1.0:1790773242.195177:0:15118:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1790773242.196880:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc78419b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78419ba expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773242.199169:0:15118:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc78419b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc78419ba expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773242.199200:0:15118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc78419b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc78419ba expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773242.199236:0:15118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc78419b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc78419ba expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773242.199313:0:15118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1790773242.199321:0:15118:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1790773242.199393:0:15118:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790773242.199399:0:15118:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1790773242.199408:0:15118:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1790773242.199472:0:15118:0:(import.c:65:import_set_state_nolock()) ffff93d26ed8b800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1790773242.199755:0:8409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790773242.199765:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc78419b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc78419ba expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773242.199776:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a2000 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:0.0:1790773242.199780:0:8409:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc78419b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc78419ba expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773242.199792:0:8409:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc78419b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xabf1cc0bc78419ba expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790773242.199799:0:8409:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc78419b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xabf1cc0bc78419ba expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790773242.199806:0:8409:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790773242.199809:0:8409:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1790773242.199812:0:8409:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1790773242.199839:0:8409:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc78419b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc78419ba expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773242.199846:0:8409:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790773242.199872:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc78419b3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc78419ba expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773242.199880:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc78419b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc78419ba expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773242.199897:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773242.199899:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773242.199907:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773242.200005:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790773242.200033:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce0675b4-b0c5-48e7-b182-565e22fed04c:3606:1877761496080768:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790773242.200137:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773242.200252:0:10300:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496080768 00000100:00100000:0.0:1790773242.200261:0:10300:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496080768 00000100:00100000:0.0:1790773242.200332:0:10300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790773242.200343:0:10300:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3606:x1877761496080768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790773242.200358:0:10300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773242.200376:0:10300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d27b12b000/0xabf1cc0bc78419ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xabf1cc0bc78419b3 expref: 24 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773242.200389:0:10300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790773242.200429:0:10300:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ce0675b4-b0c5-48e7-b182-565e22fed04c+23:3606:x1877761496080768:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773242.200436:0:10300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790773242.202143:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3603:1877761496080640:0@lo:39:umount.0 00000100:00100000:1.0:1790773242.202271:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773242.204002:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce0675b4-b0c5-48e7-b182-565e22fed04c:3606:1877761496080768:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790773242.205164:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496080640 00000100:00100000:0.0:1790773242.205180:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496080640 00000100:00100000:0.0:1790773242.209037:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1790773242.209075:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3603:x1877761496080640:12345-0@lo:39:umount.0 00000020:00000080:0.0:1790773242.209137:0:6479:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7841514 00000100:00080000:0.0:1790773242.209153:0:6479:0:(import.c:65:import_set_state_nolock()) ffff93d26eed3800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1790773242.209396:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3603:x1877761496080640:12345-0@lo:39:umount.0 Request processed in 339us (7124us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773242.209405:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000020:00000080:0.0:1790773242.209422:0:6479:0:(genops.c:885:class_export_put()) final put ffff93d26be96800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:0.0:1790773242.209511:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d26ed8b800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1790773242.209548:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3603:1877761496080640:0@lo:39:umount.0 00000100:00080000:0.0:1790773242.209590:0:15118:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790773242.209595:0:15118:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1790773242.209602:0:15118:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1790773242.210167:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790773242.213417:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93d26be96800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1790773242.213525:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d26eed3800 for lustre-MDT0000 00010000:00010000:0.0:1790773242.214776:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d279de3c00/0xabf1cc0bc78419c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78419c8 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773242.214798:0:15118:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d279de3c00/0xabf1cc0bc78419c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc78419c8 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773242.214808:0:15118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d279de3c00/0xabf1cc0bc78419c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc78419c8 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773242.214815:0:15118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffff93d279de3c00/0xabf1cc0bc78419c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc78419c8 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773242.214846:0:15118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790773242.214853:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d279de3800/0xabf1cc0bc78418b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78418be expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773242.214861:0:15118:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d279de3800/0xabf1cc0bc78418b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc78418be expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773242.214867:0:15118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d279de3800/0xabf1cc0bc78418b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc78418be expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773242.214873:0:15118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffff93d279de3800/0xabf1cc0bc78418b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc78418be expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773242.214888:0:15118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1790773242.214917:0:8409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790773242.214923:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d279de3c00/0xabf1cc0bc78419c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc78419c8 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773242.214930:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d279de3c00 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:0.0:1790773242.214933:0:8409:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d279de3c00/0xabf1cc0bc78419c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc78419c8 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773242.214943:0:8409:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d279de3c00/0xabf1cc0bc78419c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xabf1cc0bc78419c8 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790773242.214951:0:8409:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d279de3c00/0xabf1cc0bc78419c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xabf1cc0bc78419c8 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790773242.214957:0:8409:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790773242.214960:0:8409:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1790773242.215004:0:8409:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d279de3c00/0xabf1cc0bc78419c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc78419c8 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773242.215011:0:8409:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790773242.215047:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d279de3c00/0xabf1cc0bc78419c1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc78419c8 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773242.215054:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d279de3c00/0xabf1cc0bc78419c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc78419c8 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773242.215068:0:8409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790773242.215071:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d279de3800/0xabf1cc0bc78418b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc78418be expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773242.215077:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d279de3800 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:0.0:1790773242.215085:0:8409:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d279de3800/0xabf1cc0bc78418b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc78418be expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773242.215092:0:8409:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d279de3800/0xabf1cc0bc78418b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xabf1cc0bc78418be expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790773242.215100:0:8409:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d279de3800/0xabf1cc0bc78418b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xabf1cc0bc78418be expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790773242.215105:0:8409:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1790773242.215107:0:8409:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1790773242.215111:0:8409:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1790773242.215124:0:8409:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d279de3800/0xabf1cc0bc78418b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc78418be expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773242.215129:0:8409:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790773242.215134:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d279de3800/0xabf1cc0bc78418b7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc78418be expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773242.215141:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d279de3800/0xabf1cc0bc78418b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc78418be expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773242.215149:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773242.215151:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773242.215152:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773242.215166:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d1434ac600/0xabf1cc0bc7841c0d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841c14 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773242.215172:0:15118:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d1434ac600/0xabf1cc0bc7841c0d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7841c14 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773242.215180:0:15118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d1434ac600/0xabf1cc0bc7841c0d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc7841c14 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773242.215192:0:15118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffff93d1434ac600/0xabf1cc0bc7841c0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc7841c14 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773242.218295:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce0675b4-b0c5-48e7-b182-565e22fed04c:3604:1877761496080896:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790773242.218421:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773242.218517:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790773242.218526:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce0675b4-b0c5-48e7-b182-565e22fed04c:3604:1877761496081024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790773242.218551:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773242.218597:0:6463:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496080896 00000100:00100000:2.0:1790773242.218608:0:6463:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496080896 00000100:00100000:2.0:1790773242.218683:0:6463:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496081024 00000100:00100000:2.0:1790773242.218687:0:6463:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496081024 00000100:00100000:2.0:1790773242.218718:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790773242.218728:0:6463:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce0675b4-b0c5-48e7-b182-565e22fed04c+24:3604:x1877761496080896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790773242.218746:0:6463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790773242.218771:0:6463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d26efc4a00/0xabf1cc0bc78419c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xabf1cc0bc78419c1 expref: 24 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773242.218794:0:6463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790773242.218833:0:6463:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce0675b4-b0c5-48e7-b182-565e22fed04c+23:3604:x1877761496080896:12345-0@lo:103:ldlm_bl.0 Request processed in 107us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773242.218841:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790773242.218863:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790773242.218869:0:6463:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce0675b4-b0c5-48e7-b182-565e22fed04c+22:3604:x1877761496081024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790773242.218878:0:6463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790773242.218886:0:6463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d279de2800/0xabf1cc0bc78418be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xabf1cc0bc78418b7 expref: 22 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773242.218895:0:6463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790773242.219078:0:6463:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:3604:x1877761496081024:12345-0@lo:103:ldlm_bl.0 Request processed in 209us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773242.219110:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790773242.219161:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce0675b4-b0c5-48e7-b182-565e22fed04c:3604:1877761496081024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790773242.219172:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce0675b4-b0c5-48e7-b182-565e22fed04c:3604:1877761496080896:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790773242.223966:0:15118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790773242.223995:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d2532e5600/0xabf1cc0bc7841473 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc784147a expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773242.224012:0:15118:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d2532e5600/0xabf1cc0bc7841473 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc784147a expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773242.224020:0:15118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d2532e5600/0xabf1cc0bc7841473 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc784147a expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773242.224028:0:15118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffff93d2532e5600/0xabf1cc0bc7841473 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc784147a expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773242.224062:0:15118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1790773242.224069:0:15118:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1790773242.224081:0:15118:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:0.0:1790773242.224163:0:8409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790773242.224174:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d1434ac600/0xabf1cc0bc7841c0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc7841c14 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773242.224182:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ac600 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:0.0:1790773242.224187:0:8409:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d1434ac600/0xabf1cc0bc7841c0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc7841c14 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773242.224198:0:8409:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d1434ac600/0xabf1cc0bc7841c0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xabf1cc0bc7841c14 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790773242.224252:0:8409:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d1434ac600/0xabf1cc0bc7841c0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xabf1cc0bc7841c14 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790773242.224259:0:8409:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1790773242.224262:0:8409:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1790773242.224264:0:8409:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1790773242.224314:0:8409:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d1434ac600/0xabf1cc0bc7841c0d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc7841c14 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773242.224320:0:8409:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790773242.224355:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d1434ac600/0xabf1cc0bc7841c0d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc7841c14 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773242.224362:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d1434ac600/0xabf1cc0bc7841c0d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc7841c14 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773242.224380:0:8409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790773242.224383:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d2532e5600/0xabf1cc0bc7841473 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc784147a expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773242.224388:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d2532e5600 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:0.0:1790773242.224391:0:8409:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d2532e5600/0xabf1cc0bc7841473 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc784147a expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773242.224397:0:8409:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d2532e5600/0xabf1cc0bc7841473 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xabf1cc0bc784147a expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790773242.224403:0:8409:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d2532e5600/0xabf1cc0bc7841473 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xabf1cc0bc784147a expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790773242.224419:0:8409:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1790773242.224421:0:8409:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1790773242.224423:0:8409:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1790773242.224436:0:8409:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d2532e5600/0xabf1cc0bc7841473 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc784147a expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773242.224442:0:8409:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790773242.224448:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d2532e5600/0xabf1cc0bc7841473 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc784147a expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773242.224454:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d2532e5600/0xabf1cc0bc7841473 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc784147a expref: -99 pid: 6455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773242.224463:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773242.224465:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773242.224466:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773242.224489:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce0675b4-b0c5-48e7-b182-565e22fed04c:3606:1877761496081152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790773242.224591:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773242.224656:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790773242.224663:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce0675b4-b0c5-48e7-b182-565e22fed04c:3606:1877761496081280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790773242.224690:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773242.224730:0:6465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496081152 00000100:00100000:0.0:1790773242.224738:0:6465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496081152 00000100:00100000:0.0:1790773242.224792:0:6465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496081280 00000100:00100000:0.0:1790773242.224796:0:6465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496081280 00000100:00100000:0.0:1790773242.224820:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790773242.224829:0:6465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+22:3606:x1877761496081152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790773242.224844:0:6465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773242.224866:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d27b12b800/0xabf1cc0bc7841c14 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xabf1cc0bc7841c0d expref: 22 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773242.224878:0:6465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790773242.224913:0:6465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+21:3606:x1877761496081152:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773242.224920:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790773242.224937:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790773242.224943:0:6465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2461f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+20:3606:x1877761496081280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790773242.224950:0:6465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773242.224958:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d26c4a3c00/0xabf1cc0bc784147a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xabf1cc0bc7841473 expref: 20 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773242.224966:0:6465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790773242.224986:0:6465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2461f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce0675b4-b0c5-48e7-b182-565e22fed04c+19:3606:x1877761496081280:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773242.224993:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790773242.225055:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce0675b4-b0c5-48e7-b182-565e22fed04c:3606:1877761496081280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790773242.225064:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce0675b4-b0c5-48e7-b182-565e22fed04c:3606:1877761496081152:0@lo:103:ldlm_bl.0 00000020:01000004:0.0:1790773242.225096:0:15118:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1790773242.225102:0:15118:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1790773242.225106:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790773242.225112:0:15118:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:0.0:1790773242.225118:0:15118:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff93d143287000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790773242.225125:0:15118:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff93d27b28e800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790773242.225130:0:15118:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff93d27c1d2000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790773242.225135:0:15118:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff93d26ec39800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:0.0:1790773242.225151:0:15118:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff93d281bd6800 18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f 192.168.202.19@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790773242.225156:0:15118:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff93d1437ec000 110130ab-04fa-4d7c-984e-562032df4432 192.168.202.19@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:0.0:1790773242.225162:0:15118:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff93d279ea0000) has exports, disconnecting them 00000020:00080000:0.0:1790773242.225166:0:15118:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff93d143287000), last request at 1790773239 00000020:00000080:0.0:1790773242.225175:0:15118:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc784182b 00000100:00080000:0.0:1790773242.225197:0:15118:0:(import.c:65:import_set_state_nolock()) ffff93d143281000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1790773242.225285:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1790773242.225300:0:15118:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93d143287000): rc 0 00000020:00000080:0.0:1790773242.225303:0:15118:0:(genops.c:885:class_export_put()) final put ffff93d143287000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1790773242.225314:0:15118:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff93d27b28e800), last request at 1790773239 00000020:00000080:0.0:1790773242.225316:0:15118:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc78416fe 00000100:00080000:0.0:1790773242.225322:0:15118:0:(import.c:65:import_set_state_nolock()) ffff93d27b289800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1790773242.225333:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1790773242.225341:0:15118:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93d27b28e800): rc 0 00000020:00000080:0.0:1790773242.225343:0:15118:0:(genops.c:885:class_export_put()) final put ffff93d27b28e800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1790773242.225347:0:15118:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff93d27c1d2000), last request at 1790773013 00000020:00000080:0.0:1790773242.225350:0:15118:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc784163a 00000100:00080000:0.0:1790773242.225354:0:15118:0:(import.c:65:import_set_state_nolock()) ffff93d27c1d2800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1790773242.225362:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1790773242.225367:0:15118:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93d27c1d2000): rc 0 00000020:00000080:0.0:1790773242.225369:0:15118:0:(genops.c:885:class_export_put()) final put ffff93d27c1d2000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1790773242.225373:0:15118:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff93d26ec39800), last request at 1790773013 00000020:00000080:0.0:1790773242.225376:0:15118:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc78415fb 00000100:00080000:0.0:1790773242.225379:0:15118:0:(import.c:65:import_set_state_nolock()) ffff93d26ec39000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1790773242.225388:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1790773242.225394:0:15118:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00010000:00010000:2.0:1790773242.227003:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773242.227717:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790773242.227734:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d143287000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1790773242.227816:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d27b28e800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1790773242.227848:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d27c1d2000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1790773242.227870:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d143281000 for lustre-MDT0000 00000020:00000080:1.0:1790773242.227876:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d27b289800 for lustre-MDT0000 00000020:00000080:1.0:1790773242.227880:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d27c1d2800 for lustre-MDT0000 00000001:00100000:3.0:1790773242.236457:0:6457:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f 00000001:00080000:3.0:1790773242.236476:0:6457:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:3.0:1790773242.236484:0:6457:0:(genops.c:885:class_export_put()) final put ffff93d281bd6800/18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f 00000001:00100000:3.0:1790773242.236512:0:6457:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 110130ab-04fa-4d7c-984e-562032df4432 00000001:00080000:3.0:1790773242.236519:0:6457:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:3.0:1790773242.236537:0:6457:0:(genops.c:885:class_export_put()) final put ffff93d1437ec000/110130ab-04fa-4d7c-984e-562032df4432 00000020:00000080:2.0:1790773242.236537:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93d281bd6800/18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f for lustre-MDT0000 00000020:00000080:3.0:1790773242.236732:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93d1437ec000/110130ab-04fa-4d7c-984e-562032df4432 for lustre-MDT0000 00000020:00000080:3.0:1790773242.236791:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d281bd5800 for lustre-MDT0000 00000020:00000080:3.0:1790773242.236797:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d1437ea000 for lustre-MDT0000 00000020:00080000:3.0:1790773242.242968:0:15118:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93d26ec39800): rc 0 00000004:00000080:3.0:1790773242.242982:0:15118:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb21f00d9bae0 00000100:00080000:3.0:1790773242.243003:0:15118:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1790773242.243007:0:15118:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00080000:3.0:1790773242.244001:0:15118:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1790773242.244036:0:15118:0:(import.c:65:import_set_state_nolock()) ffff93d27b155800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1790773242.245068:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496081408:0@lo:39:umount.0 00000100:00100000:0.0:1790773242.245198:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773242.245772:0:7666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496081408 00000100:00100000:1.0:1790773242.245783:0:7666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496081408 00000100:00100000:1.0:1790773242.245844:0:7666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1790773242.245854:0:7666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3603:x1877761496081408:12345-0@lo:39:umount.0 00000020:00000080:1.0:1790773242.245895:0:7666:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7841648 00000100:00080000:1.0:1790773242.245904:0:7666:0:(import.c:65:import_set_state_nolock()) ffff93d27c1d0800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790773242.245938:0:7666:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1790773242.246117:0:7666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3603:x1877761496081408:12345-0@lo:39:umount.0 Request processed in 264us (919us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1790773242.246125:0:7666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00080000:2.0:1790773242.246602:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d27b155800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1790773242.246616:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496081408:0@lo:39:umount.0 00000100:00080000:3.0:1790773242.246884:0:15118:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1790773242.246889:0:15118:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:3.0:1790773242.246952:0:15118:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1790773242.247017:0:15118:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1790773242.247043:0:15118:0:(import.c:65:import_set_state_nolock()) ffff93d27f91f800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1790773242.247057:0:15118:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1790773242.247059:0:15118:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:3.0:1790773242.247085:0:15118:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1790773242.247160:0:15118:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1790773242.247170:0:15118:0:(import.c:65:import_set_state_nolock()) ffff93d1437ed800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1790773242.247290:0:15118:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff93d279ea0000) has no exports 00010000:00010000:0.0:1790773242.247672:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773242.253601:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496081536:0@lo:9:umount.0 00000100:00100000:1.0:1790773242.253718:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773242.253767:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496081664:0@lo:9:umount.0 00000100:00100000:1.0:1790773242.253793:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773242.253843:0:8906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496081536 00000100:00100000:1.0:1790773242.253854:0:8906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496081536 00000100:00100000:1.0:1790773242.253906:0:8906:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496081664 00000100:00100000:1.0:1790773242.253924:0:8906:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496081664 00000100:00100000:1.0:1790773242.253958:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1790773242.253967:0:8906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3603:x1877761496081536:12345-0@lo:9:umount.0 00000020:00000080:1.0:1790773242.253997:0:8906:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc78417ad 00000100:00080000:1.0:1790773242.254006:0:8906:0:(import.c:65:import_set_state_nolock()) ffff93d14241e000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790773242.254062:0:8906:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1790773242.254256:0:8906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3603:x1877761496081536:12345-0@lo:9:umount.0 Request processed in 289us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773242.254264:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1790773242.254281:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1790773242.254288:0:8906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3603:x1877761496081664:12345-0@lo:9:umount.0 00000020:00000080:1.0:1790773242.254299:0:8906:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc78418e8 00000100:00080000:1.0:1790773242.254305:0:8906:0:(import.c:65:import_set_state_nolock()) ffff93d143272800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790773242.254328:0:8906:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1790773242.254400:0:8906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3603:x1877761496081664:12345-0@lo:9:umount.0 Request processed in 112us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773242.254407:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1790773242.254430:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1790773242.254443:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790773242.254476:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d27f91f800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:2.0:1790773242.261057:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1790773242.264365:0:3603:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1790773242.264381:0:3603:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790773242.264395:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496081536:0@lo:9:umount.0 00000100:00080000:1.0:1790773242.264463:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d1437ed800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1790773242.264485:0:3603:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1790773242.264488:0:3603:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790773242.264492:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496081664:0@lo:9:umount.0 00000020:00080000:2.0:1790773242.274768:0:15118:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff93d279ea0000) has no exports 00000020:00000080:2.0:1790773242.349146:0:15118:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc78414ce 00000020:00000080:2.0:1790773242.349171:0:15118:0:(genops.c:885:class_export_put()) final put ffff93d26ec3d800/lustre-QMT0000_UUID 00000020:01000000:2.0:1790773242.349382:0:15118:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1790773242.349566:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790773242.349583:0:15118:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1790773242.349589:0:15118:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff93d26ec24d40) has no exports 00000020:00000080:0.0:1790773242.350073:0:15118:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc78414c7 00000020:00000080:0.0:1790773242.350082:0:15118:0:(genops.c:885:class_export_put()) final put ffff93d250734800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1790773242.350119:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d26ec3d800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1790773242.350275:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d250734800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1790773242.350408:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790773242.350418:0:15118:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1790773242.350421:0:15118:0:(genops.c:885:class_export_put()) final put ffff93d25077f800/lustre-QMT0000_UUID 00000020:00000080:0.0:1790773242.350424:0:15118:0:(genops.c:844:class_export_destroy()) destroying export ffff93d25077f800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1790773242.350433:0:15118:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:0.0:1790773242.708376:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773243.725575:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773244.238166:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496082048:0@lo:400:kworker.0 00000100:00100000:3.0:1790773244.238287:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877761496082176:0@lo:400:kworker.0 00000100:00100000:2.0:1790773244.238412:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496081792:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790773244.238859:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce0675b4-b0c5-48e7-b182-565e22fed04c:3605:1877761496081920:0@lo:400:kworker.0 00000100:00100000:3.0:1790773244.239548:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773244.239717:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773244.239748:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14480f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496082560:0@lo:400:kworker.0 00000100:00100000:0.0:1790773244.239788:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773244.239888:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496083072:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790773244.239916:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773244.240127:0:8393:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496082560 00000100:00100000:0.0:1790773244.240136:0:8393:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496082560 00000100:00100000:0.0:1790773244.240237:0:8393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1790773244.240247:0:8393:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496082560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773244.240309:0:8393:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496082560:12345-0@lo:400:kworker.0 Request processed in 63us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773244.240317:0:8393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1790773244.240372:0:12789:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496082048 00000100:00100000:0.0:1790773244.240376:0:12789:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496082048 00000100:00100000:0.0:1790773244.240406:0:12789:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496083072 00000100:00100000:0.0:1790773244.240408:0:12789:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496083072 00000100:00100000:0.0:1790773244.240421:0:12789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1790773244.240425:0:12789:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3606:x1877761496082048:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1790773244.240432:0:12789:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1790773244.240461:0:12789:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3606:x1877761496082048:12345-0@lo:400:kworker.0 Request processed in 35us (745us total) trans 0 rc -107/-107 00000100:00100000:0.0:1790773244.240467:0:12789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1790773244.240477:0:12789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1790773244.240480:0:12789:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3606:x1877761496083072:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:0.0:1790773244.240484:0:12789:0:(tgt_handler.c:821:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1790773244.240504:0:12789:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3606:x1877761496083072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 22us (587us total) trans 0 rc -107/-107 00000100:00100000:0.0:1790773244.240509:0:12789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:02020000:0.0:1790773244.240748:0:3606:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00100000:3.0:1790773244.242988:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14480f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3607:1877761496082688:0@lo:400:kworker.0 00000100:00100000:3.0:1790773244.243082:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773244.243459:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496082176 00000100:00100000:3.0:1790773244.243470:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496082176 00000100:00100000:3.0:1790773244.243513:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496082688 00000100:00100000:3.0:1790773244.243516:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496082688 00000100:00100000:3.0:1790773244.243541:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1790773244.243547:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3607:x1877761496082176:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1790773244.243555:0:13768:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1790773244.243608:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3607:x1877761496082176:12345-0@lo:400:kworker.0 Request processed in 59us (4062us total) trans 0 rc -107/-107 00000100:00100000:3.0:1790773244.243615:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1790773244.246504:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1790773244.246517:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3607:x1877761496082688:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1790773244.246527:0:13768:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1790773244.246625:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3607:x1877761496082688:12345-0@lo:400:kworker.0 Request processed in 109us (3543us total) trans 0 rc -107/-107 00000100:00100000:3.0:1790773244.246633:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00080000:3.0:1790773244.246851:0:3607:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1790773244.246866:0:3607:0:(import.c:65:import_set_state_nolock()) ffff93d27c1d4800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1790773244.246870:0:3607:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1790773244.247545:0:3606:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1790773244.247551:0:3606:0:(import.c:65:import_set_state_nolock()) ffff93d26edf7000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1790773244.247555:0:3606:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1790773244.247561:0:3606:0:(import.c:65:import_set_state_nolock()) ffff93d26edf7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790773244.247723:0:3606:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 156 00000100:00080000:0.0:1790773244.247741:0:3606:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d26edf7000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:2.0:1790773244.248740:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773244.248780:0:3606:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d1437d4a80 x1877761496083200/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790773244.248783:0:11145:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496081792 00000100:00100000:2.0:1790773244.248791:0:11145:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496081792 00000100:00080000:0.0:1790773244.248834:0:3606:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1790773244.248837:0:3606:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff93d26edf7000 already not connected (conn 2, was 1): CONNECTING 00000100:00100000:0.0:1790773244.248843:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496082048:0@lo:400:kworker.0 00000100:00100000:2.0:1790773244.248850:0:11145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1790773244.248859:0:11145:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496081792:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790773244.248876:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14480f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496082560:0@lo:400:kworker.0 00002000:00000024:2.0:1790773244.248890:0:11145:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1790773244.248931:0:11145:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496081792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773244.248937:0:11145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:0.0:1790773244.248948:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790773244.248951:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790773244.248973:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761496083200:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1790773244.248979:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496081792:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790773244.248986:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3604:1877761496082304:0@lo:400:kworker.0 00000100:00100000:0.0:1790773244.249006:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773244.249014:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773244.249035:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496082304 00000100:00100000:0.0:1790773244.249035:0:12789:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496083200 00000100:00100000:2.0:1790773244.249038:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496082304 00000100:00100000:0.0:1790773244.249038:0:12789:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496083200 00000100:00100000:0.0:1790773244.249057:0:12789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1790773244.249062:0:12789:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3603:x1877761496083200:12345-0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1790773244.249072:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1790773244.249076:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3604:x1877761496082304:12345-0@lo:400:kworker.0 00010000:02000000:0.0:1790773244.249076:0:12789:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000020:00080000:2.0:1790773244.249082:0:6479:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1790773244.249109:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3604:x1877761496082304:12345-0@lo:400:kworker.0 Request processed in 31us (93us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790773244.249114:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:2.0:1790773244.249139:0:3604:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1790773244.249143:0:3604:0:(import.c:65:import_set_state_nolock()) ffff93d14241a800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1790773244.249147:0:3604:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1790773244.249151:0:3604:0:(import.c:65:import_set_state_nolock()) ffff93d14241a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790773244.249154:0:3604:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 179 00000100:00080000:2.0:1790773244.249160:0:3604:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d14241a800 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:2.0:1790773244.249175:0:3604:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d27f9f6680 x1877761496083328/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790773244.249226:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3604:1877761496082304:0@lo:400:kworker.0 00000100:00100000:2.0:1790773244.249238:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3603:1877761496083328:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1790773244.249260:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773244.249287:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496083328 00000100:00100000:2.0:1790773244.249291:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496083328 00000100:00100000:2.0:1790773244.249311:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1790773244.249315:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3603:x1877761496083328:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1790773244.249323:0:13768:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1790773244.249362:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3603:x1877761496083328:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 45us (101us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790773244.249368:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:2.0:1790773244.249392:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d14241a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790773244.249396:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790773244.249399:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3603:1877761496083328:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1790773244.249413:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14480fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3604:1877761496082816:0@lo:400:kworker.0 00000100:00100000:2.0:1790773244.249435:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773244.249451:0:14584:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496082816 00000100:00100000:2.0:1790773244.249454:0:14584:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496082816 00000100:00100000:2.0:1790773244.249483:0:14584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1790773244.249490:0:14584:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3604:x1877761496082816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773244.249520:0:14584:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3604:x1877761496082816:12345-0@lo:400:kworker.0 Request processed in 32us (86us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773244.249526:0:14584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00080000:2.0:1790773244.249542:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1790773244.249556:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d14480fb80 x1877761496082816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773244.249565:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14480fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3604:1877761496082816:0@lo:400:kworker.0 00000100:00100000:1.0:1790773244.251527:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773244.252492:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3605:1877761496082432:0@lo:400:kworker.0 00000100:00100000:1.0:1790773244.252553:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773244.252772:0:6472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496081920 00000100:00100000:2.0:1790773244.252782:0:6472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496081920 00000100:00100000:2.0:1790773244.252961:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:2.0:1790773244.252971:0:6472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2512ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+19:3605:x1877761496081920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773244.253028:0:6472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2512ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce0675b4-b0c5-48e7-b182-565e22fed04c+19:3605:x1877761496081920:12345-0@lo:400:kworker.0 Request processed in 59us (1511us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773244.253036:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:1.0:1790773244.253167:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496082432 00000100:00100000:1.0:1790773244.253172:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496082432 00000100:00100000:1.0:1790773244.253482:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1790773244.253490:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3605:x1877761496082432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773244.253529:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3605:x1877761496082432:12345-0@lo:400:kworker.0 Request processed in 41us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773244.253536:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00080000:2.0:1790773244.253957:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1790773244.254515:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143ce0e00 x1877761496082432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773244.254532:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3605:1877761496082432:0@lo:400:kworker.0 00000100:00100000:1.0:1790773244.254545:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14480dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496082944:0@lo:400:kworker.0 00000100:00100000:1.0:1790773244.255126:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773244.255290:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce0675b4-b0c5-48e7-b182-565e22fed04c:3605:1877761496081920:0@lo:400:kworker.0 00000100:00100000:2.0:1790773244.260789:0:8392:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496082944 00000100:00100000:2.0:1790773244.260800:0:8392:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496082944 00000100:00100000:2.0:1790773244.260978:0:8392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1790773244.260988:0:8392:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496082944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773244.260991:0:12789:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3603:x1877761496083200:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 11927us (11983us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790773244.261000:0:12789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00080000:1.0:1790773244.261280:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d26edf7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790773244.261286:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790773244.261290:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761496083200:0@lo:38:ptlrpcd_00_02.0 00000001:00100000:0.0:1790773244.261715:0:7410:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1790773244.261727:0:7410:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:0.0:1790773244.261732:0:7410:0:(genops.c:885:class_export_put()) final put ffff93d27c299800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1790773244.261747:0:7410:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f 00000001:00080000:0.0:1790773244.261754:0:7410:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:0.0:1790773244.261756:0:7410:0:(genops.c:885:class_export_put()) final put ffff93d1434c8800/18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f 00000001:00100000:0.0:1790773244.261762:0:7410:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 110130ab-04fa-4d7c-984e-562032df4432 00000001:00080000:0.0:1790773244.261767:0:7410:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:0.0:1790773244.261768:0:7410:0:(genops.c:885:class_export_put()) final put ffff93d1437e9000/110130ab-04fa-4d7c-984e-562032df4432 00000001:00100000:0.0:1790773244.261800:0:8388:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790773244.261803:0:8388:0:(genops.c:885:class_export_put()) final put ffff93d14241d000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1790773244.261810:0:8388:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 110130ab-04fa-4d7c-984e-562032df4432 00000020:00000080:0.0:1790773244.261813:0:8388:0:(genops.c:885:class_export_put()) final put ffff93d143f84000/110130ab-04fa-4d7c-984e-562032df4432 00000020:00000080:0.0:1790773244.261827:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d27c299800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1790773244.261933:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d1434c8800/18a0ab4c-2f8b-4c34-b415-5f9d63d97d8f for lustre-MDT0001 00000020:00000080:0.0:1790773244.261955:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d1437e9000/110130ab-04fa-4d7c-984e-562032df4432 for lustre-MDT0001 00000020:00000080:0.0:1790773244.261998:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d14241d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1790773244.262017:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d143f84000/110130ab-04fa-4d7c-984e-562032df4432 for lustre-OST0000 00000020:00000080:0.0:1790773244.262031:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d27c1d0800 for lustre-MDT0001 00000020:00000080:0.0:1790773244.262035:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d1434cf000 for lustre-MDT0001 00000020:00000080:0.0:1790773244.262038:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d1437e9800 for lustre-MDT0001 00000020:00000080:0.0:1790773244.262042:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d14241e000 for lustre-OST0000 00000020:00000080:0.0:1790773244.262045:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d143f87800 for lustre-OST0000 00000100:00100000:2.0:1790773244.264058:0:8392:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496082944:12345-0@lo:400:kworker.0 Request processed in 3050us (8912us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773244.264075:0:8392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1790773244.265175:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14480dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496082944:0@lo:400:kworker.0 00000100:00080000:3.0:1790773244.268041:0:3607:0:(import.c:65:import_set_state_nolock()) ffff93d27c1d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790773244.268056:0:3607:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 156 00000100:00080000:3.0:1790773244.268073:0:3607:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d27c1d4800 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:2.0:1790773244.268235:0:3607:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d27f9f4380 x1877761496083456/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790773244.268278:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877761496082176:0@lo:400:kworker.0 00000100:00080000:2.0:1790773244.268321:0:3607:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00100000:0.0:1790773244.268323:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3603:1877761496083456:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:2.0:1790773244.268324:0:3607:0:(import.c:65:import_set_state_nolock()) ffff93d141ce9000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1790773244.268328:0:3607:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1790773244.268331:0:3607:0:(import.c:65:import_set_state_nolock()) ffff93d141ce9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790773244.268334:0:3607:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 200 00000100:00080000:2.0:1790773244.268339:0:3607:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93d141ce9000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:2.0:1790773244.268351:0:3607:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d27f9f5880 x1877761496083584/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790773244.268361:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14480f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3607:1877761496082688:0@lo:400:kworker.0 00000100:00100000:0.0:1790773244.268397:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773244.268420:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496083456 00000100:00100000:2.0:1790773244.268427:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496083456 00000100:00100000:0.0:1790773244.268428:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3603:1877761496083584:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1790773244.268449:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773244.268460:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496083584 00000100:00100000:2.0:1790773244.268463:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496083584 00000100:00100000:2.0:1790773244.268483:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1790773244.268491:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3603:x1877761496083456:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1790773244.268526:0:13768:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1790773244.268577:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3603:x1877761496083456:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 85us (180us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790773244.268585:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1790773244.268601:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1790773244.268606:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3603:x1877761496083584:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1790773244.268613:0:13768:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1790773244.268636:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3603:x1877761496083584:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 29us (186us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790773244.268642:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:0.0:1790773244.268969:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d141ce9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790773244.268974:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790773244.268977:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3603:1877761496083584:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:0.0:1790773244.268984:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d27c1d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790773244.268987:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790773244.268990:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3603:1877761496083456:0@lo:38:ptlrpcd_00_03.0 00000001:00100000:2.0:1790773244.269629:0:9475:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790773244.269635:0:9475:0:(genops.c:885:class_export_put()) final put ffff93d143276800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1790773244.269654:0:9475:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 110130ab-04fa-4d7c-984e-562032df4432 00000020:00000080:2.0:1790773244.269656:0:9475:0:(genops.c:885:class_export_put()) final put ffff93d27fa2d800/110130ab-04fa-4d7c-984e-562032df4432 00000020:00000080:0.0:1790773244.269704:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93d143276800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1790773244.269808:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93d27fa2d800/110130ab-04fa-4d7c-984e-562032df4432 for lustre-OST0001 00000020:00000080:0.0:1790773244.269951:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d143272800 for lustre-OST0001 00000020:00000080:0.0:1790773244.269958:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d27fa2e000 for lustre-OST0001 00010000:00010000:2.0:1790773244.750733:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773245.773439:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773246.797462:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790773246.798080:0:13753:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1790773247.309779:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496083712:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790773247.309860:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773247.309994:0:8397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496083712 00000100:00100000:3.0:1790773247.310003:0:8397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496083712 00000100:00100000:3.0:1790773247.310072:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1790773247.310082:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496083712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790773247.310115:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1790773247.310174:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790773247.310341:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496083712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 260us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773247.310348:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1790773247.310355:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496083712:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1790773247.825084:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790773248.353555:0:6457:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1790773248.353574:0:6457:0:(genops.c:885:class_export_put()) final put ffff93d26ec39800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1790773248.356562:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d26ec39800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1790773248.356687:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d26ec39000 for lustre-MDT0000 00000020:01000000:0.0:1790773248.412584:0:15118:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff93d1425e2a80 - data ffff93d1420421b0/ffff93d1430d3400 00000020:01000000:0.0:1790773248.412746:0:15118:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff93d244fcd9c0 - data ffff93d27389de58/ffff93d26ededc00 00000001:00000004:0.0:1790773248.427737:0:15118:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:3.0:1790773248.530197:0:15118:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1790773248.530241:0:15118:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1790773248.530264:0:15118:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff93d1445d9180 x1877761496081408/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1790773252 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773248.530299:0:15118:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1790773248.531359:0:15118:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1790773248.531364:0:15118:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:3.0:1790773248.531385:0:15118:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790773248.531386:0:15118:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1790773248.532626:0:8904:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1790773248.532634:0:8904:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:1.0:1790773248.532645:0:8904:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1790773248.533323:0:15118:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1790773248.533328:0:15118:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:3.0:1790773248.533350:0:15118:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790773248.533366:0:15118:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1790773248.535140:0:9868:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1790773248.535147:0:9868:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1790773248.535159:0:9868:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1790773248.537154:0:15118:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7841496 00000020:00000080:3.0:1790773248.537176:0:15118:0:(genops.c:885:class_export_put()) final put ffff93d250735000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1790773248.538434:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d250735000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1790773248.548480:0:15118:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc78414ab 00000020:00000080:3.0:1790773248.548498:0:15118:0:(genops.c:885:class_export_put()) final put ffff93d25077d800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1790773248.548573:0:15118:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1790773248.548579:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790773248.548589:0:15118:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1790773248.548593:0:15118:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff93d279ea19c0) has no exports 00000004:01000000:3.0:1790773248.548777:0:15118:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1790773248.548785:0:15118:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc78418e1 00000020:00000080:3.0:1790773248.548789:0:15118:0:(genops.c:885:class_export_put()) final put ffff93d1437ee800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790773248.548816:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d25077d800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1790773248.555669:0:15118:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1790773248.555682:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790773248.555699:0:15118:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1790773248.555703:0:15118:0:(genops.c:1557:class_disconnect_exports()) OBD device 28 (ffff93d281bab380) has no exports 00000020:00000080:3.0:1790773248.555712:0:15118:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc78418da 00000020:00000080:3.0:1790773248.555720:0:15118:0:(genops.c:885:class_export_put()) final put ffff93d1437ee000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1790773248.560821:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d1437ee800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1790773248.562677:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d1437ee000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1790773248.564623:0:15118:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1790773248.564630:0:15118:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1790773248.564634:0:15118:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:3.0:1790773248.564640:0:15118:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790773248.564642:0:15118:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790773248.564738:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790773248.564764:0:15118:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790773248.564775:0:15118:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc784179f 00000020:00000080:3.0:1790773248.564784:0:15118:0:(genops.c:885:class_export_put()) final put ffff93d27f91e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790773248.566515:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d1437ed800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1790773248.566530:0:8:0:(genops.c:885:class_export_put()) final put ffff93d1437ea800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790773248.566532:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d1437ea800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1790773248.566538:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1790773248.566674:0:15118:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1790773248.566679:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790773248.566690:0:15118:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1790773248.566695:0:15118:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff93d2512d4d40) has no exports 00000020:00000080:3.0:1790773248.566702:0:15118:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7841798 00000020:00000080:3.0:1790773248.566707:0:15118:0:(genops.c:885:class_export_put()) final put ffff93d26ed8f800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1790773248.566917:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d27f91e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1790773248.566924:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d26ed8f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1790773248.567278:0:15118:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1790773248.567283:0:15118:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1790773248.567286:0:15118:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:3.0:1790773248.567290:0:15118:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790773248.567292:0:15118:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790773248.567402:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790773248.567409:0:15118:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1790773248.567421:0:15118:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1790773248.567427:0:15118:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc78415a0 00000020:00000080:3.0:1790773248.567431:0:15118:0:(genops.c:885:class_export_put()) final put ffff93d26eed6800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790773248.570694:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d27f91f800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1790773248.570715:0:8:0:(genops.c:885:class_export_put()) final put ffff93d142527800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790773248.570718:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d142527800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1790773248.570726:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1790773248.570911:0:15118:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1790773248.570942:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790773248.570960:0:15118:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00000080:1.0:1790773248.570965:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d26eed6800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00080000:3.0:1790773248.570969:0:15118:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff93d262664d40) has no exports 00000020:00000080:3.0:1790773248.570998:0:15118:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7841599 00000020:00000080:3.0:1790773248.571006:0:15118:0:(genops.c:885:class_export_put()) final put ffff93d26ed89800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1790773248.571265:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93d26ed89800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1790773248.579328:0:15118:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1790773248.579343:0:15118:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1790773248.579348:0:15118:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1790773248.579358:0:15118:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790773248.580147:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790773248.580172:0:15118:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790773248.580243:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790773248.580248:0:15118:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790773248.580254:0:15118:0:(genops.c:885:class_export_put()) final put ffff93d250734000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790773248.580280:0:15118:0:(genops.c:844:class_export_destroy()) destroying export ffff93d250734000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1790773248.580289:0:15118:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790773248.580404:0:15118:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc78414b2 00000020:00000080:0.0:1790773248.580412:0:15118:0:(genops.c:885:class_export_put()) final put ffff93d25077e000/lustre-MDD0000_UUID 00000020:00000080:1.0:1790773248.581680:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d27b155800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1790773248.581697:0:8:0:(genops.c:885:class_export_put()) final put ffff93d26eed2000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790773248.581700:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d26eed2000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1790773248.581708:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1790773248.582537:0:15118:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1790773248.582720:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d25077e000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1790773248.582854:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790773248.582864:0:15118:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1790773248.582869:0:15118:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff93d279ea4d40) has no exports 00000020:00000080:0.0:1790773248.582901:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790773248.582906:0:15118:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1790773248.582910:0:15118:0:(genops.c:885:class_export_put()) final put ffff93d250731000/lustre-MDD0000_UUID 00000020:00000080:0.0:1790773248.582912:0:15118:0:(genops.c:844:class_export_destroy()) destroying export ffff93d250731000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1790773248.582919:0:15118:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1790773248.583867:0:15118:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc78414b9 00000020:00000080:0.0:1790773248.583879:0:15118:0:(genops.c:885:class_export_put()) final put ffff93d25077d000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790773248.584877:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d25077d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:0.0:1790773248.584936:0:15118:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93d25268e800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1790773248.584941:0:15118:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93d25268e800 3 00000020:01000004:0.0:1790773248.584944:0:15118:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93d25268e800 from lustre-MDT0000 00000020:00000080:0.0:1790773248.584971:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790773248.584980:0:15118:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1790773248.584983:0:15118:0:(genops.c:885:class_export_put()) final put ffff93d250735800/lustre-MDT0000_UUID 00000020:00000080:0.0:1790773248.584986:0:15118:0:(genops.c:844:class_export_destroy()) destroying export ffff93d250735800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1790773248.584995:0:15118:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1790773248.585636:0:15118:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1790773248.585642:0:15118:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1790773248.585647:0:15118:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1790773248.585651:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790773248.585656:0:15118:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1790773248.585663:0:15118:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff93d251286000 ce0675b4-b0c5-48e7-b182-565e22fed04c 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790773248.585671:0:15118:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff93d2512d3380) has exports, disconnecting them 00000020:00080000:0.0:1790773248.585677:0:15118:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff93d251286000), last request at 1790772995 00000020:00000080:0.0:1790773248.585697:0:15118:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7841457 00000020:00010000:0.0:1790773248.585717:0:15118:0:(genops.c:1920:obd_stale_export_put()) Put export ffff93d251286000: total 0 00000100:00080000:0.0:1790773248.585722:0:15118:0:(import.c:65:import_set_state_nolock()) ffff93d251282800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1790773248.585738:0:15118:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93d251286000): rc 0 00000020:00080000:0.0:1790773248.585743:0:15118:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff93d2512d3380) has no exports 00000020:00010000:1.0:1790773248.586009:0:8409:0:(genops.c:1906:obd_stale_export_get()) Get export ffff93d251286000: total 0 00010000:00010000:1.0:1790773248.586050:0:8409:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93d251286000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1790773248.586088:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d26c4a3200/0xabf1cc0bc7841990 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xabf1cc0bc7841989 expref: 14 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773248.586107:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d279de2600/0xabf1cc0bc7841974 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xabf1cc0bc784196d expref: 13 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773248.586118:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d279de3e00/0xabf1cc0bc7841982 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xabf1cc0bc784197b expref: 12 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773248.586129:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d25074a000/0xabf1cc0bc7841c30 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xabf1cc0bc7841c29 expref: 11 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773248.586140:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d26efc5e00/0xabf1cc0bc784199e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xabf1cc0bc7841997 expref: 10 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773248.586151:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d27b12a000/0xabf1cc0bc78419ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xabf1cc0bc78419a5 expref: 9 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773248.586183:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d2532e5000/0xabf1cc0bc784156f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xabf1cc0bc7841568 expref: 8 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773248.586199:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d27b12a600/0xabf1cc0bc7841bf8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xabf1cc0bc7841bf1 expref: 7 pid: 6471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773248.586232:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d25074a200/0xabf1cc0bc7841c06 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xabf1cc0bc7841bff expref: 6 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773248.586244:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d26c4a2800/0xabf1cc0bc78419d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xabf1cc0bc78419cf expref: 5 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773248.586259:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d279de2400/0xabf1cc0bc7841966 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xabf1cc0bc784195f expref: 4 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773248.586434:0:6472:0:(service.c:3206:ptlrpc_main()) ll_mgs_0001: service thread [ffff93d248d9ee00:6472] 1 exiting: rc = 0 00010000:00010000:1.0:1790773248.586955:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d26c4a3e00/0xabf1cc0bc7841878 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xabf1cc0bc7841871 expref: 3 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773248.586973:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d2532e4000/0xabf1cc0bc784157d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xabf1cc0bc7841576 expref: 2 pid: 6472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773248.586988:0:8409:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93d251286000, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1790773248.587006:0:8409:0:(genops.c:885:class_export_put()) final put ffff93d251286000/ce0675b4-b0c5-48e7-b182-565e22fed04c 00010000:00010000:1.0:1790773248.587017:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773248.587019:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773248.587021:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773248.587044:0:6473:0:(service.c:3206:ptlrpc_main()) ll_mgs_0002: service thread [ffff93d248d9f800:6473] 2 exiting: rc = 0 00000020:00000080:0.0:1790773248.587130:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d251286000/ce0675b4-b0c5-48e7-b182-565e22fed04c for MGS 00000020:00000080:0.0:1790773248.587179:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d251282800 for MGS 00000100:00100000:2.0:1790773248.587501:0:6471:0:(service.c:3206:ptlrpc_main()) ll_mgs_0000: service thread [ffff93d244fdc200:6471] 0 exiting: rc = 1 00000100:00100000:0.0:1790773248.587705:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.587717:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.587726:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.587741:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.587747:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.587756:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.587763:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.587770:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.587778:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.587794:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.587800:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.587806:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.587813:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.587818:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.587824:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.587830:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.587838:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.587845:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.587851:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.587858:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.587866:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.587873:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.587879:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.587889:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.587896:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.587909:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.587917:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.587940:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.587947:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.587954:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.587960:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.587967:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.587973:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.587979:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.587985:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.587991:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.587996:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.588000:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.588006:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.588011:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.588016:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.588027:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.588032:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.588039:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.588045:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.588050:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.588056:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.588062:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.588068:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.588075:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.588081:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.588089:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.588096:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.588101:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.588107:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.588114:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.588119:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.588125:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.588130:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.588136:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.588141:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.588147:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.588176:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773248.588182:0:15118:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1790773248.593934:0:15118:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff93d248c110c0 - data ffff93d273a49288/ffff93d143c4a400 00000020:01000000:1.0:1790773248.594115:0:15118:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff93d244fcd600 - data ffff93d251ad01b0/ffff93d26be5dc00 00000020:00000080:1.0:1790773248.595902:0:15118:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc784143b 00000020:00000080:1.0:1790773248.595921:0:15118:0:(genops.c:885:class_export_put()) final put ffff93d2580dd000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1790773248.595985:0:15118:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93d25268e800 from MGS, refs=2 00000020:01000004:1.0:1790773248.595989:0:15118:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93d25268e800 2 00000020:01000004:1.0:1790773248.595993:0:15118:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93d25268e800 from MGS 00000020:00000080:1.0:1790773248.596018:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790773248.596028:0:15118:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1790773248.596031:0:15118:0:(genops.c:885:class_export_put()) final put ffff93d251fa1000/MGS 00000020:00000080:1.0:1790773248.596035:0:15118:0:(genops.c:844:class_export_destroy()) destroying export ffff93d251fa1000/MGS for MGS 00000020:01000000:1.0:1790773248.596044:0:15118:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1790773248.596133:0:15118:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1790773248.596136:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790773248.596142:0:15118:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1790773248.596150:0:15118:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff93d26ed8d800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790773248.596156:0:15118:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff93d2512d19c0) has exports, disconnecting them 00000020:00080000:1.0:1790773248.596160:0:15118:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff93d26ed8d800), last request at 1790772996 00000020:00000080:1.0:1790773248.596178:0:15118:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7841506 00000020:00080000:1.0:1790773248.596189:0:15118:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93d26ed8d800): rc 0 00000020:00000080:1.0:1790773248.596195:0:15118:0:(genops.c:885:class_export_put()) final put ffff93d26ed8d800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1790773248.597074:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93d2580dd000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1790773248.597088:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93d26ed8d800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1790773248.598383:0:15118:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1790773248.598394:0:15118:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790773248.598400:0:15118:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1790773248.598418:0:15118:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790773248.598462:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d26ed8b800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1790773248.598936:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790773248.598947:0:15118:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1790773248.598952:0:15118:0:(genops.c:885:class_export_put()) final put ffff93d24c34e000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1790773248.598956:0:15118:0:(genops.c:844:class_export_destroy()) destroying export ffff93d24c34e000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1790773248.598961:0:15118:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1790773248.599449:0:15118:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93d25268e800 1 00000020:00000080:0.0:1790773248.599460:0:15118:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc784142d 00000020:00000080:0.0:1790773248.599471:0:15118:0:(genops.c:885:class_export_put()) final put ffff93d251fa6000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1790773248.599492:0:15118:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1790773248.599509:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d251fa6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1790773248.599778:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790773248.599946:0:15118:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1790773248.599953:0:15118:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff93d279ea3380) has no exports 00000020:00000080:1.0:1790773248.701553:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790773248.701581:0:15118:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1790773248.701588:0:15118:0:(genops.c:885:class_export_put()) final put ffff93d2580df000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790773248.701594:0:15118:0:(genops.c:844:class_export_destroy()) destroying export ffff93d2580df000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1790773248.701612:0:15118:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1790773248.701758:0:15118:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93d253307800 00000020:02000400:1.0:1790773248.701850:0:15118:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1790773248.850324:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773249.357483:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790773249.357512:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496083840:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790773249.357613:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773249.357692:0:8396:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496083840 00000100:00100000:3.0:1790773249.357703:0:8396:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496083840 00000100:00100000:3.0:1790773249.357776:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1790773249.357789:0:8396:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496083840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790773249.357828:0:8396:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1790773249.357888:0:8396:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496083840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773249.357895:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:3.0:1790773249.357919:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790773249.357966:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496083840:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1790773249.359745:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790773249.359752:0:15123:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1790773249.359755:0:15123:0:(import.c:65:import_set_state_nolock()) ffff93d26edf7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790773249.359763:0:15123:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 387 00000100:00080000:0.0:1790773249.359769:0:15123:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790773249.359780:0:15123:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d26edf7000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:0.0:1790773249.359802:0:15123:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d1437d4e00 x1877761496084096/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790773249.359828:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790773249.359831:0:15123:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1790773249.359833:0:15123:0:(import.c:65:import_set_state_nolock()) ffff93d27c1d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790773249.359836:0:15123:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 387 00000100:00080000:0.0:1790773249.359838:0:15123:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790773249.359844:0:15123:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d27c1d4800 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:0.0:1790773249.359867:0:15123:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d1437d7100 x1877761496084224/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790773249.359877:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790773249.359880:0:15123:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1790773249.359882:0:15123:0:(import.c:65:import_set_state_nolock()) ffff93d14241a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790773249.359885:0:15123:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 387 00000100:00080000:0.0:1790773249.359887:0:15123:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790773249.359892:0:15123:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d14241a800 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:0.0:1790773249.359903:0:15123:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d1437d6a00 x1877761496084352/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790773249.359934:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790773249.359937:0:15123:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1790773249.359938:0:15123:0:(import.c:65:import_set_state_nolock()) ffff93d141ce9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790773249.359942:0:15123:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 387 00000100:00080000:0.0:1790773249.359945:0:15123:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790773249.359949:0:15123:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93d141ce9000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:0.0:1790773249.359960:0:15123:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d14480f800 x1877761496084736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790773249.360005:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761496084096:0@lo:38:kworker.0 00000100:00100000:2.0:1790773249.360029:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14480dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3604:1877761496084864:0@lo:400:kworker.0 00000100:00100000:2.0:1790773249.360443:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773249.360483:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790773249.360490:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce0675b4-b0c5-48e7-b182-565e22fed04c:3604:1877761496083968:0@lo:400:kworker.0 00000400:00000100:2.0:1790773249.360522:0:3604:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877761496083968 offset 0 length 224: 4 00000100:00100000:2.0:1790773249.360557:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496084608:0@lo:400:kworker.0 00000100:00100000:2.0:1790773249.360586:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773249.360603:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496084864 00000100:00100000:2.0:1790773249.360608:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790773249.360614:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3607:1877761496084480:0@lo:400:kworker.0 00000100:00100000:1.0:1790773249.360615:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496084864 00000100:00100000:2.0:1790773249.360637:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773249.360685:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496084480 00000100:00100000:1.0:1790773249.360689:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496084480 00000100:00100000:2.0:1790773249.360695:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1790773249.360704:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3604:x1877761496084864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773249.360721:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1790773249.360728:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1877761496084480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773249.360761:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3604:x1877761496084864:12345-0@lo:400:kworker.0 Request processed in 58us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773249.360761:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1877761496084480:12345-0@lo:400:kworker.0 Request processed in 34us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773249.360768:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00080000:3.0:1790773249.360879:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790773249.360905:0:8907:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496084608 00000100:00100000:1.0:1790773249.360910:0:8907:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496084608 00000100:00100000:1.0:1790773249.360951:0:8907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1790773249.360957:0:8907:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496084608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773249.360989:0:8907:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496084608:12345-0@lo:400:kworker.0 Request processed in 32us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773249.360996:0:8907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00010000:00080000:1.0:1790773249.361037:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff93d1437d7800 x1877761496084480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773249.361039:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1790773249.361051:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3607:1877761496084480:0@lo:400:kworker.0 00000100:00100000:1.0:1790773249.361064:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496084608:0@lo:400:kworker.0 00010000:00080000:2.0:1790773249.361067:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff93d14480dc00 x1877761496084864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773249.361075:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14480dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3604:1877761496084864:0@lo:400:kworker.0 00000100:00080000:3.0:1790773249.361946:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790773249.363823:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773249.364360:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3603:1877761496084224:0@lo:38:kworker.0 00000100:00100000:0.0:1790773249.364436:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773249.364464:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3603:1877761496084352:0@lo:38:kworker.0 00000100:00100000:0.0:1790773249.364487:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773249.364504:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14480f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3603:1877761496084736:0@lo:38:kworker.0 00000100:00100000:0.0:1790773249.364526:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773249.364708:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496084224 00000100:00100000:1.0:1790773249.364720:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496084224 00000100:00100000:1.0:1790773249.364754:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496084352 00000100:00100000:1.0:1790773249.364756:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496084352 00000100:00100000:1.0:1790773249.364768:0:8697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496084736 00000100:00100000:1.0:1790773249.364770:0:8697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496084736 00000100:00100000:1.0:1790773249.364799:0:8697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1790773249.364807:0:8697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14480f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3603:x1877761496084224:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1790773249.364830:0:8697:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790773249.364994:0:6483:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496084096 00000100:00100000:2.0:1790773249.365012:0:6483:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496084096 00000100:00100000:2.0:1790773249.365040:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1790773249.365046:0:6483:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14480fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3603:x1877761496084096:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1790773249.365058:0:6483:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790773249.365132:0:6483:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14480fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3603:x1877761496084096:12345-0@lo:38:kworker.0 Request processed in 84us (1318us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790773249.365140:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1790773249.365179:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1790773249.365183:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14480dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3603:x1877761496084352:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1790773249.365238:0:6480:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790773249.365266:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14480dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3603:x1877761496084352:12345-0@lo:38:kworker.0 Request processed in 81us (778us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790773249.365272:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1790773249.365288:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1790773249.365291:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3603:x1877761496084736:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1790773249.365300:0:6480:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790773249.365324:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3603:x1877761496084736:12345-0@lo:38:kworker.0 Request processed in 31us (796us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790773249.365329:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00080000:2.0:1790773249.365369:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d26edf7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790773249.365374:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790773249.365391:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761496084096:0@lo:38:kworker.0 00000100:00080000:2.0:1790773249.365402:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d14241a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790773249.365405:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790773249.365408:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3603:1877761496084352:0@lo:38:kworker.0 00000100:00080000:2.0:1790773249.365416:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d141ce9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790773249.365420:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790773249.365423:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14480f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3603:1877761496084736:0@lo:38:kworker.0 00000100:00100000:0.0:1790773249.409348:0:8697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14480f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3603:x1877761496084224:12345-0@lo:38:kworker.0 Request processed in 44530us (44901us total) trans 0 rc -19/-19 00000100:00100000:0.0:1790773249.409364:0:8697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:0.0:1790773249.409427:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d27c1d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790773249.409434:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790773249.409439:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3603:1877761496084224:0@lo:38:kworker.0 00010000:00010000:0.0:1790773249.871527:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773250.893955:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773251.917733:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773252.436509:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496084992:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790773252.436608:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773252.440175:0:8397:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496084992 00000100:00100000:2.0:1790773252.440188:0:8397:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496084992 00000100:00100000:2.0:1790773252.440272:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1790773252.440283:0:8397:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496084992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790773252.440316:0:8397:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1790773252.443274:0:8397:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496084992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2977us (6649us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773252.443295:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1790773252.444507:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496084992:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1790773252.444607:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790773252.941391:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790773253.011104:0:15321:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1790773253.026346:0:15321:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:0.0:1790773253.026402:0:15321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26efc5a00/0xabf1cc0bc7841997 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc784199e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773253.026415:0:15321:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26efc5a00/0xabf1cc0bc7841997 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc784199e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773253.026420:0:15321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26efc5a00/0xabf1cc0bc7841997 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc784199e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773253.026443:0:15321:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffff93d26efc5a00/0xabf1cc0bc7841997 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc784199e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773253.026462:0:15321:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1790773253.026467:0:15321:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1790773253.026493:0:15321:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790773253.026497:0:15321:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1790773253.026502:0:15321:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1790773253.026507:0:15321:0:(import.c:65:import_set_state_nolock()) ffff93d27c1d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1790773253.026512:0:15321:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790773253.026513:0:15321:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1790773253.026515:0:15321:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1790773253.028289:0:15321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d279de2a00/0xabf1cc0bc78419a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78419ac expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773253.028316:0:15321:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d279de2a00/0xabf1cc0bc78419a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc78419ac expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773253.028325:0:15321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d279de2a00/0xabf1cc0bc78419a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc78419ac expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773253.028333:0:15321:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffff93d279de2a00/0xabf1cc0bc78419a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc78419ac expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773253.028361:0:15321:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1790773253.028369:0:15321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12aa00/0xabf1cc0bc7841871 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841878 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773253.028376:0:15321:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12aa00/0xabf1cc0bc7841871 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7841878 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773253.028381:0:15321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12aa00/0xabf1cc0bc7841871 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc7841878 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773253.028388:0:15321:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffff93d27b12aa00/0xabf1cc0bc7841871 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc7841878 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773253.028403:0:15321:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1790773253.028419:0:6466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1790773253.028429:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d26efc5a00/0xabf1cc0bc7841997 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc784199e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773253.028463:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc5a00 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:1.0:1790773253.028467:0:6466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d26efc5a00/0xabf1cc0bc7841997 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc784199e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773253.028476:0:6466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d26efc5a00/0xabf1cc0bc7841997 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xabf1cc0bc784199e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790773253.028485:0:6466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d26efc5a00/0xabf1cc0bc7841997 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xabf1cc0bc784199e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790773253.028492:0:6466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1790773253.028495:0:6466:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1790773253.028498:0:6466:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1790773253.028539:0:6467:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790773253.028546:0:6467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d279de2a00/0xabf1cc0bc78419a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc78419ac expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773253.028554:0:6467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d279de2a00 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:0.0:1790773253.028557:0:6467:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d279de2a00/0xabf1cc0bc78419a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc78419ac expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773253.028564:0:6467:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d279de2a00/0xabf1cc0bc78419a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xabf1cc0bc78419ac expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790773253.028570:0:6467:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d279de2a00/0xabf1cc0bc78419a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xabf1cc0bc78419ac expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790773253.028576:0:6467:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790773253.028579:0:6467:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:0.0:1790773253.028605:0:6467:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d279de2a00/0xabf1cc0bc78419a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc78419ac expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773253.028612:0:6467:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790773253.028647:0:6467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d279de2a00/0xabf1cc0bc78419a5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc78419ac expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773253.028654:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d279de2a00/0xabf1cc0bc78419a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc78419ac expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773253.028673:0:6467:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790773253.028676:0:6467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d27b12aa00/0xabf1cc0bc7841871 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc7841878 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773253.028682:0:6467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12aa00 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:0.0:1790773253.028685:0:6467:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d27b12aa00/0xabf1cc0bc7841871 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc7841878 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773253.028691:0:6467:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d27b12aa00/0xabf1cc0bc7841871 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xabf1cc0bc7841878 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790773253.028758:0:6467:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d27b12aa00/0xabf1cc0bc7841871 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xabf1cc0bc7841878 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790773253.028764:0:6467:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1790773253.028766:0:6467:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1790773253.028768:0:6467:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1790773253.028782:0:6467:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d27b12aa00/0xabf1cc0bc7841871 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc7841878 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773253.028787:0:6467:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790773253.028845:0:6467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d27b12aa00/0xabf1cc0bc7841871 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc7841878 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773253.028856:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d27b12aa00/0xabf1cc0bc7841871 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc7841878 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773253.028871:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773253.028872:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773253.028874:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773253.028900:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce0675b4-b0c5-48e7-b182-565e22fed04c:3607:1877761496085376:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790773253.028943:0:6466:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d26efc5a00/0xabf1cc0bc7841997 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc784199e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773253.028949:0:6466:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790773253.028976:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d26efc5a00/0xabf1cc0bc7841997 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc784199e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773253.028980:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790773253.028983:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d26efc5a00/0xabf1cc0bc7841997 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc784199e expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773253.028993:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773253.028995:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773253.028996:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773253.029008:0:15321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d25074ba00/0xabf1cc0bc7841bff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841c06 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773253.029014:0:15321:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d25074ba00/0xabf1cc0bc7841bff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7841c06 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773253.029026:0:15321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d25074ba00/0xabf1cc0bc7841bff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc7841c06 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773253.029032:0:15321:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffff93d25074ba00/0xabf1cc0bc7841bff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc7841c06 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773253.029043:0:15321:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790773253.029049:0:15321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d2532e5400/0xabf1cc0bc7841576 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc784157d expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773253.029056:0:15321:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d2532e5400/0xabf1cc0bc7841576 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc784157d expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773253.029062:0:15321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d2532e5400/0xabf1cc0bc7841576 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc784157d expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773253.029068:0:15321:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffff93d2532e5400/0xabf1cc0bc7841576 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc784157d expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773253.029080:0:15321:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1790773253.029084:0:15321:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:1.0:1790773253.029087:0:15321:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000100:00100000:0.0:1790773253.029104:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790773253.029113:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce0675b4-b0c5-48e7-b182-565e22fed04c:3607:1877761496085248:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790773253.029136:0:6466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790773253.029141:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d25074ba00/0xabf1cc0bc7841bff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc7841c06 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773253.029147:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074ba00 already unused, calling callback (ffffffffc14cac20) 00000100:00100000:0.0:1790773253.029147:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:1.0:1790773253.029150:0:6466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d25074ba00/0xabf1cc0bc7841bff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc7841c06 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773253.029163:0:6466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d25074ba00/0xabf1cc0bc7841bff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xabf1cc0bc7841c06 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790773253.029169:0:6466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d25074ba00/0xabf1cc0bc7841bff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xabf1cc0bc7841c06 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790773253.029175:0:6466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1790773253.029175:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce0675b4-b0c5-48e7-b182-565e22fed04c:3604:1877761496085120:0@lo:103:ldlm_bl.0 10000000:01000000:1.0:1790773253.029177:0:6466:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1790773253.029179:0:6466:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1790773253.029192:0:6466:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d25074ba00/0xabf1cc0bc7841bff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc7841c06 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773253.029196:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790773253.029198:0:6466:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1790773253.029246:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790773253.029252:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce0675b4-b0c5-48e7-b182-565e22fed04c:3604:1877761496085504:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790773253.029272:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773253.029358:0:6465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496085376 00000100:00100000:0.0:1790773253.029365:0:6465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496085376 00000100:00100000:0.0:1790773253.029398:0:6465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496085248 00000100:00100000:0.0:1790773253.029400:0:6465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496085248 00000100:00100000:0.0:1790773253.029410:0:6465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496085120 00000100:00100000:0.0:1790773253.029412:0:6465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496085120 00000100:00100000:0.0:1790773253.029419:0:6465:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496085504 00000100:00100000:0.0:1790773253.029421:0:6465:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496085504 00000100:00100000:0.0:1790773253.029434:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790773253.029444:0:6465:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3607:x1877761496085376:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1790773253.029452:0:6465:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790773253 with bad export cookie 12389908400836973655 00010000:00010000:1.0:1790773253.029955:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d25074ba00/0xabf1cc0bc7841bff lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc7841c06 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773253.029965:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d25074ba00/0xabf1cc0bc7841bff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc7841c06 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773253.029976:0:6466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790773253.029980:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d2532e5400/0xabf1cc0bc7841576 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc784157d expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773253.029987:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d2532e5400 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:1.0:1790773253.029990:0:6466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d2532e5400/0xabf1cc0bc7841576 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc784157d expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773253.029998:0:6466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d2532e5400/0xabf1cc0bc7841576 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xabf1cc0bc784157d expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790773253.030016:0:6466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d2532e5400/0xabf1cc0bc7841576 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xabf1cc0bc784157d expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790773253.030021:0:6466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1790773253.030024:0:6466:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1790773253.030026:0:6466:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1790773253.030042:0:6466:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d2532e5400/0xabf1cc0bc7841576 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc784157d expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773253.030049:0:6466:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790773253.030061:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d2532e5400/0xabf1cc0bc7841576 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc784157d expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773253.030067:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d2532e5400/0xabf1cc0bc7841576 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc784157d expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773253.030081:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773253.030083:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773253.030084:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1790773253.030101:0:15321:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:1.0:1790773253.030105:0:15321:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:1.0:1790773253.030110:0:15321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790773253.030119:0:15321:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1790773253.030134:0:15321:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff93d26ef96000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790773253.030140:0:15321:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff93d142525000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790773253.030145:0:15321:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff93d2626619c0) has exports, disconnecting them 00000020:00080000:1.0:1790773253.030150:0:15321:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff93d26ef96000), last request at 1790773249 00000020:00000080:1.0:1790773253.030159:0:15321:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7841839 00000100:00080000:1.0:1790773253.030178:0:15321:0:(import.c:65:import_set_state_nolock()) ffff93d26ef95800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1790773253.030651:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1790773253.030667:0:15321:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93d26ef96000): rc 0 00000020:00000080:1.0:1790773253.030671:0:15321:0:(genops.c:885:class_export_put()) final put ffff93d26ef96000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:1.0:1790773253.030685:0:15321:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff93d142525000), last request at 1790773249 00000020:00000080:1.0:1790773253.030691:0:15321:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7841713 00000100:00080000:1.0:1790773253.030699:0:15321:0:(import.c:65:import_set_state_nolock()) ffff93d142527000 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1790773253.030715:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d26ef96000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:1.0:1790773253.030768:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d26ef95800 for lustre-MDT0001 00010000:00010000:1.0:1790773253.030779:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1790773253.030788:0:15321:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93d142525000): rc 0 00000020:00000080:1.0:1790773253.030790:0:15321:0:(genops.c:885:class_export_put()) final put ffff93d142525000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:1.0:1790773253.030802:0:15321:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb21f01a5fae0 00000020:00000080:1.0:1790773253.030814:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d142525000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1790773253.030847:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d142527000 for lustre-MDT0001 00010000:00010000:2.0:1790773253.031349:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773253.031369:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce0675b4-b0c5-48e7-b182-565e22fed04c:3606:1877761496085632:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790773253.031437:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790773253.031496:0:15321:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790773253.031497:0:10300:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496085632 00000100:00100000:2.0:1790773253.031507:0:10300:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496085632 00000100:00100000:1.0:1790773253.031508:0:15321:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff93d1437d6680 x1877761496083072/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1790773260 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773253.031525:0:15321:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00100000:2.0:1790773253.031536:0:10300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790773253.031543:0:10300:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3607:x1877761496085248:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1790773253.031549:0:10300:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790773253 with bad export cookie 12389908400836973655 00000100:00100000:2.0:1790773253.031592:0:10300:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3607:x1877761496085248:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (2444us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790773253.031599:0:10300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790773253.031614:0:10300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790773253.031618:0:10300:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3604:x1877761496085120:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1790773253.031623:0:10300:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790773253 with bad export cookie 12389908400836973655 00000100:00100000:2.0:1790773253.031648:0:10300:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3604:x1877761496085120:12345-0@lo:103:ldlm_bl.0 Request processed in 28us (2451us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790773253.031653:0:10300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790773253.031665:0:10300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790773253.031669:0:10300:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cc5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3604:x1877761496085504:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1790773253.031673:0:10300:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790773253 with bad export cookie 12389908400836973655 00000100:00100000:2.0:1790773253.031696:0:10300:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cc5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3604:x1877761496085504:12345-0@lo:103:ldlm_bl.0 Request processed in 25us (2423us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790773253.031701:0:10300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790773253.031723:0:10300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790773253.031727:0:10300:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3606:x1877761496085632:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1790773253.031731:0:10300:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790773253 with bad export cookie 12389908400836973655 00000100:00100000:2.0:1790773253.031756:0:10300:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3606:x1877761496085632:12345-0@lo:103:ldlm_bl.0 Request processed in 26us (319us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790773253.031761:0:10300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1790773253.031787:0:3606:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.119@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1790773253.031791:0:3606:0:(import.c:65:import_set_state_nolock()) ffff93d251280800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1790773253.031795:0:3606:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.119@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1790773253.036531:0:3604:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.119@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1790773253.038322:0:15321:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1790773253.038335:0:15321:0:(import.c:65:import_set_state_nolock()) ffff93d26edf7000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1790773253.039337:0:3607:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.119@tcp of MGS@0@lo abruptly disconnected: reconnecting 00010000:00010000:3.0:1790773253.052322:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773253.052442:0:6465:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3607:x1877761496085376:12345-0@lo:103:ldlm_bl.0 Request processed in 22991us (23454us total) trans 0 rc -107/-107 00000100:00100000:3.0:1790773253.052456:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1790773253.058411:0:15321:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1790773253.058419:0:15321:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:3.0:1790773253.058445:0:15321:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1790773253.058515:0:15321:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1790773253.058545:0:15321:0:(import.c:65:import_set_state_nolock()) ffff93d27c37b000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1790773253.058561:0:15321:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1790773253.058563:0:15321:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:3.0:1790773253.058571:0:15321:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1790773253.058639:0:15321:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1790773253.058647:0:15321:0:(import.c:65:import_set_state_nolock()) ffff93d27c37f800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1790773253.058670:0:15321:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff93d2626619c0) has no exports 00000100:00080000:2.0:1790773253.059367:0:3606:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.119@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1790773253.059371:0:3606:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1790773253.059379:0:3606:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d1437d6d80 x1877761496083968/t0(0) o400->MGC192.168.202.119@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790773265 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773253.059393:0:3606:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d143ce1180 x1877761496085376/t0(0) o103->MGC192.168.202.119@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790773269 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773253.059402:0:3606:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d143ce0e00 x1877761496085248/t0(0) o103->MGC192.168.202.119@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790773269 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773253.059412:0:3606:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d2526cd180 x1877761496085120/t0(0) o103->MGC192.168.202.119@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790773269 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773253.059420:0:3606:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d2526cca80 x1877761496085504/t0(0) o103->MGC192.168.202.119@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790773269 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773253.059429:0:3606:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d2526cc700 x1877761496085632/t0(0) o103->MGC192.168.202.119@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790773269 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790773253.059483:0:3604:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff93d251280800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1790773253.059513:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144546d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761496085760:0@lo:9:umount.0 00000100:00100000:0.0:1790773253.059583:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773253.059627:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144547100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761496085888:0@lo:9:umount.0 00000100:00100000:0.0:1790773253.059650:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773253.059696:0:8394:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496085760 00000100:00080000:1.0:1790773253.059783:0:3607:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff93d251280800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1790773253.059894:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce0675b4-b0c5-48e7-b182-565e22fed04c:3607:1877761496085376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790773253.059915:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce0675b4-b0c5-48e7-b182-565e22fed04c:3607:1877761496085248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790773253.059990:0:8394:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496085760 00000100:00100000:0.0:1790773253.060044:0:8394:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496085888 00000100:00100000:0.0:1790773253.060113:0:8394:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496085888 00000100:00100000:0.0:1790773253.060166:0:8394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1790773253.060177:0:8394:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3603:x1877761496085760:12345-0@lo:9:umount.0 00000020:00000080:0.0:1790773253.060236:0:8394:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7841760 00000100:00100000:3.0:1790773253.060237:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1790773253.060252:0:8906:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3603:x1877761496085888:12345-0@lo:9:umount.0 00000100:00080000:0.0:1790773253.060253:0:8394:0:(import.c:65:import_set_state_nolock()) ffff93d141fe8800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1790773253.060271:0:8906:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc78418a2 00000100:00080000:3.0:1790773253.060280:0:8906:0:(import.c:65:import_set_state_nolock()) ffff93d143275800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790773253.060307:0:8394:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000001:00000004:3.0:1790773253.060323:0:8906:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1790773253.060451:0:8394:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3603:x1877761496085760:12345-0@lo:9:umount.0 Request processed in 275us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773253.060458:0:8394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:0.0:1790773253.060477:0:6474:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1790773253.060489:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790773253.060512:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d27c37b000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1790773253.060524:0:3603:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1790773253.060527:0:3603:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790773253.060531:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144546d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761496085760:0@lo:9:umount.0 00000100:00100000:0.0:1790773253.060563:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce0675b4-b0c5-48e7-b182-565e22fed04c:3604:1877761496085120:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790773253.060575:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce0675b4-b0c5-48e7-b182-565e22fed04c:3604:1877761496083968:0@lo:400:kworker.0 00000100:00100000:3.0:1790773253.060599:0:8906:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3603:x1877761496085888:12345-0@lo:9:umount.0 Request processed in 350us (945us total) trans 0 rc 0/0 00000100:00080000:0.0:1790773253.060607:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d27c37f800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1790773253.060608:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000004:00080000:0.0:1790773253.060635:0:3603:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1790773253.060638:0:3603:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790773253.060641:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144547100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761496085888:0@lo:9:umount.0 00000100:00100000:0.0:1790773253.060667:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce0675b4-b0c5-48e7-b182-565e22fed04c:3604:1877761496085504:0@lo:103:ldlm_bl.0 10000000:01000000:2.0:1790773253.060983:0:3606:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1790773253.060987:0:3606:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1790773253.060989:0:3606:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1790773253.060992:0:3606:0:(import.c:65:import_set_state_nolock()) ffff93d251280800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790773253.060997:0:3606:0:(import.c:545:import_select_connection()) MGC192.168.202.119@tcp: connect to NID 0@lo last attempt 138 00000100:00080000:2.0:1790773253.061015:0:3606:0:(import.c:666:import_select_connection()) MGC192.168.202.119@tcp: import ffff93d251280800 using connection 192.168.202.119@tcp/0@lo 00010000:00010000:2.0:1790773253.061024:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773253.061061:0:3606:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d27f9f5880 x1877761496086016/t0(0) o250->MGC192.168.202.119@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790773253.061097:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496083072:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790773253.061111:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce0675b4-b0c5-48e7-b182-565e22fed04c:3606:1877761496085632:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790773253.061175:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ce0675b4-b0c5-48e7-b182-565e22fed04c:3603:1877761496086016:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:3.0:1790773253.061231:0:3603:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877761496086016 offset 0 length 520: 4 00000020:00080000:3.0:1790773253.080337:0:15321:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff93d2626619c0) has no exports 00000020:01000000:2.0:1790773253.182710:0:15321:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff93d1425e2ae0 - data ffff93d27397f360/ffff93d1430d2000 00000020:01000000:2.0:1790773253.183009:0:15321:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff93d27c215120 - data ffff93d2739ace58/ffff93d27c149800 00000001:00000004:0.0:1790773253.218115:0:15321:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:1.0:1790773253.338107:0:15321:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790773253.338131:0:15321:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:1.0:1790773253.339710:0:15321:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1790773253.353950:0:15321:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1790773253.353960:0:15321:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:1.0:1790773253.354025:0:15321:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790773253.354029:0:15321:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1790773253.358248:0:8898:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1790773253.358262:0:8898:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:3.0:1790773253.358284:0:8898:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1790773253.358982:0:15321:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1790773253.358988:0:15321:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:0.0:1790773253.359005:0:15321:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790773253.359008:0:15321:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1790773253.365833:0:9863:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1790773253.365842:0:9863:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:1.0:1790773253.365894:0:9863:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1790773253.369649:0:15321:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc78415bc 00000020:00000080:0.0:1790773253.370461:0:15321:0:(genops.c:885:class_export_put()) final put ffff93d27b288800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1790773253.370584:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d27b288800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1790773253.377908:0:15321:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc78415d1 00000020:00000080:0.0:1790773253.377924:0:15321:0:(genops.c:885:class_export_put()) final put ffff93d27b2ca000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1790773253.377940:0:15321:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:0.0:1790773253.377945:0:15321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790773253.377957:0:15321:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1790773253.377961:0:15321:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff93d262663380) has no exports 00000004:01000000:0.0:1790773253.378190:0:15321:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1790773253.378228:0:15321:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc784189b 00000020:00000080:0.0:1790773253.378234:0:15321:0:(genops.c:885:class_export_put()) final put ffff93d143275000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1790773253.378238:0:15321:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:0.0:1790773253.378243:0:15321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790773253.378252:0:15321:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1790773253.378254:0:15321:0:(genops.c:1557:class_disconnect_exports()) OBD device 27 (ffff93d281bacd40) has no exports 00000020:00000080:0.0:1790773253.378263:0:15321:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7841894 00000020:00000080:0.0:1790773253.378267:0:15321:0:(genops.c:885:class_export_put()) final put ffff93d141cec800/lustre-MDT0001-osd_UUID 00010000:01000000:0.0:1790773253.378749:0:15321:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:0.0:1790773253.378754:0:15321:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1790773253.378758:0:15321:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:0.0:1790773253.378764:0:15321:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790773253.378766:0:15321:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790773253.379610:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d27b2ca000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:1.0:1790773253.379629:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d143275000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1790773253.379649:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d141cec800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1790773253.379657:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d27c37f800 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1790773253.379700:0:15321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790773253.379717:0:15321:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1790773253.379722:0:15321:0:(genops.c:885:class_export_put()) final put ffff93d143282800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1790773253.379725:0:15321:0:(genops.c:844:class_export_destroy()) destroying export ffff93d143282800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1790773253.379731:0:15321:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1790773253.379891:0:15321:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7841759 00000020:00000080:0.0:1790773253.379898:0:15321:0:(genops.c:885:class_export_put()) final put ffff93d26eed4800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1790773253.379919:0:15321:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:0.0:1790773253.379923:0:15321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790773253.379929:0:15321:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1790773253.379933:0:15321:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff93d27b2c3380) has no exports 00000020:00000080:0.0:1790773253.379939:0:15321:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7841752 00000020:00000080:0.0:1790773253.379943:0:15321:0:(genops.c:885:class_export_put()) final put ffff93d27c37c800/lustre-MDT0001-osd_UUID 00010000:01000000:0.0:1790773253.380431:0:15321:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:0.0:1790773253.380438:0:15321:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1790773253.380443:0:15321:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:0.0:1790773253.380452:0:15321:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790773253.380455:0:15321:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790773253.381070:0:15321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790773253.381085:0:15321:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:0.0:1790773253.381106:0:15321:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1790773253.381116:0:15321:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc78415f4 00000020:00000080:0.0:1790773253.381132:0:15321:0:(genops.c:885:class_export_put()) final put ffff93d27b2ce800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1790773253.381140:0:15321:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:0.0:1790773253.381147:0:15321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790773253.381151:0:15321:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1790773253.381155:0:15321:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff93d26bfc19c0) has no exports 00000020:00000080:0.0:1790773253.381161:0:15321:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc78415ed 00000020:00000080:0.0:1790773253.381165:0:15321:0:(genops.c:885:class_export_put()) final put ffff93d26edf7800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1790773253.381937:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d26eed4800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1790773253.381952:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d27c37c800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1790773253.381958:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d27c37b000 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1790773253.381968:0:8:0:(genops.c:885:class_export_put()) final put ffff93d142524800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1790773253.381970:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d142524800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1790773253.381975:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1790773253.382078:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d27b2ce800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1790773253.382083:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d26edf7800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1790773253.553957:0:15321:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:3.0:1790773253.553967:0:15321:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790773253.553972:0:15321:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:3.0:1790773253.553982:0:15321:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790773253.554098:0:15321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790773253.554114:0:15321:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1790773253.554168:0:15321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790773253.554172:0:15321:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1790773253.554180:0:15321:0:(genops.c:885:class_export_put()) final put ffff93d27b289000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1790773253.554186:0:15321:0:(genops.c:844:class_export_destroy()) destroying export ffff93d27b289000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1790773253.554223:0:15321:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1790773253.554449:0:15321:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc78415d8 00000020:00000080:3.0:1790773253.554629:0:15321:0:(genops.c:885:class_export_put()) final put ffff93d27b2cf800/lustre-MDD0001_UUID 00000020:01000000:3.0:1790773253.554636:0:15321:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:3.0:1790773253.554641:0:15321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790773253.554647:0:15321:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1790773253.554650:0:15321:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff93d27b2c19c0) has no exports 00000020:00000080:3.0:1790773253.554692:0:15321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790773253.554697:0:15321:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:3.0:1790773253.554701:0:15321:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc78415df 00000020:00000080:3.0:1790773253.554706:0:15321:0:(genops.c:885:class_export_put()) final put ffff93d27b2cc000/lustre-MDT0001-osd_UUID 00000020:01000004:3.0:1790773253.554714:0:15321:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93d26ed89000 from lustre-MDT0001, refs=2 00000020:01000004:3.0:1790773253.554717:0:15321:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93d26ed89000 2 00000020:01000004:3.0:1790773253.554720:0:15321:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93d26ed89000 from lustre-MDT0001 00000020:00000080:3.0:1790773253.554738:0:15321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790773253.554752:0:15321:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:3.0:1790773253.554755:0:15321:0:(genops.c:885:class_export_put()) final put ffff93d27b28a800/lustre-MDT0001_UUID 00000020:00000080:3.0:1790773253.554758:0:15321:0:(genops.c:844:class_export_destroy()) destroying export ffff93d27b28a800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:3.0:1790773253.554767:0:15321:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:3.0:1790773253.554800:0:15321:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:3.0:1790773253.554805:0:15321:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:3.0:1790773253.554807:0:15321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790773253.554811:0:15321:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00000080:1.0:1790773253.554975:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d26edf7000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1790773253.554985:0:8:0:(genops.c:885:class_export_put()) final put ffff93d26edf1800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1790773253.554988:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d26edf1800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1790773253.554999:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00080000:3.0:1790773253.555079:0:15321:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff93d27c1d3000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790773253.555086:0:15321:0:(genops.c:1552:class_disconnect_exports()) OBD device 15 (ffff93d26bfc0000) has exports, disconnecting them 00000020:00080000:3.0:1790773253.555093:0:15321:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff93d27c1d3000), last request at 1790773013 00000020:00000080:3.0:1790773253.555097:0:15321:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7841633 00000020:00080000:3.0:1790773253.555112:0:15321:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93d27c1d3000): rc 0 00000020:00000080:3.0:1790773253.555126:0:15321:0:(genops.c:885:class_export_put()) final put ffff93d27c1d3000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1790773253.556551:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d27b2cf800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1790773253.556562:0:8:0:(genops.c:885:class_export_put()) final put ffff93d27b28c000/lustre-MDD0001_UUID 00000020:00000080:1.0:1790773253.556579:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d27b28c000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1790773253.556583:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1790773253.556788:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d27b2cc000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1790773253.556794:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d27c1d3000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1790773253.625725:0:15321:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1790773253.625737:0:15321:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790773253.625742:0:15321:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1790773253.625751:0:15321:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790773253.628257:0:15321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790773253.628277:0:15321:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1790773253.628288:0:15321:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93d26ed89000 1 00000020:00000080:3.0:1790773253.628296:0:15321:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7841530 00000020:00000080:3.0:1790773253.628306:0:15321:0:(genops.c:885:class_export_put()) final put ffff93d26eed3000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1790773253.629388:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d27c1d4800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1790773253.629401:0:8:0:(genops.c:885:class_export_put()) final put ffff93d27c1d0000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1790773253.629404:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d27c1d0000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1790773253.629417:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000000:3.0:1790773253.629690:0:15321:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1790773253.629697:0:15321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790773253.629704:0:15321:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1790773253.629708:0:15321:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff93d2512d0000) has no exports 00000020:00000080:1.0:1790773253.630950:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d26eed3000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1790773253.892553:0:15321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790773253.892572:0:15321:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1790773253.892579:0:15321:0:(genops.c:885:class_export_put()) final put ffff93d26ed8f000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1790773253.892584:0:15321:0:(genops.c:844:class_export_destroy()) destroying export ffff93d26ed8f000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1790773253.892597:0:15321:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1790773253.894492:0:15321:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93d26ed8a800 00000020:01000000:1.0:1790773253.894524:0:15321:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1790773253.894533:0:15321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790773253.894540:0:15321:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790773253.894544:0:15321:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff93d26bfc3380) has no exports 00000100:00100000:2.0:1790773253.894807:0:6480:0:(service.c:3206:ptlrpc_main()) mdt00_002: service thread [ffff93d279ed2800:6480] 2 exiting: rc = 0 00000100:00100000:3.0:1790773253.894822:0:14584:0:(service.c:3206:ptlrpc_main()) mdt00_005: service thread [ffff93d2512e8800:14584] 5 exiting: rc = 0 00000100:00100000:0.0:1790773253.895044:0:6479:0:(service.c:3206:ptlrpc_main()) mdt00_001: service thread [ffff93d279ed2000:6479] 1 exiting: rc = 0 00000100:00100000:1.0:1790773253.895397:0:13768:0:(service.c:3206:ptlrpc_main()) mdt00_004: service thread [ffff93d14377b800:13768] 4 exiting: rc = 0 00000100:00100000:2.0:1790773253.897263:0:6478:0:(service.c:3206:ptlrpc_main()) mdt00_000: service thread [ffff93d2468ece00:6478] 0 exiting: rc = 1 00000100:00100000:0.0:1790773253.899005:0:8697:0:(service.c:3206:ptlrpc_main()) mdt00_003: service thread [ffff93d26ef4de00:8697] 3 exiting: rc = 0 00000100:00100000:2.0:1790773253.899970:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.899983:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.899988:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.899994:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900001:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900005:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900012:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900018:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900024:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900030:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900035:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900042:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900050:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900056:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900063:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900069:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900075:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900083:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900090:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900097:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900137:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900143:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900150:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900155:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900160:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900166:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900171:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900177:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900182:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900188:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900194:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900201:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900239:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900252:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900263:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900273:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900300:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900307:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900313:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900319:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900325:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900330:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900336:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900341:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900346:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900351:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900356:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900362:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900367:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900373:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900379:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900384:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900389:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900394:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900400:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900413:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900419:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900424:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900431:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900436:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900442:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900448:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900453:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.900467:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.915318:0:6481:0:(service.c:3206:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff93d242cc5000:6481] 0 exiting: rc = 1 00000100:00100000:1.0:1790773253.915521:0:14187:0:(service.c:3206:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff93d141d67600:14187] 2 exiting: rc = 0 00000100:00100000:1.0:1790773253.915657:0:6482:0:(service.c:3206:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff93d252380200:6482] 1 exiting: rc = 0 00000100:00100000:2.0:1790773253.917167:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917181:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917190:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917197:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917222:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917230:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917238:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917246:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917253:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917262:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917270:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917278:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917287:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917307:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917316:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917601:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917611:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917617:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917623:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917629:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917635:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917640:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917645:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917650:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917656:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917684:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917690:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917695:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917701:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917717:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917723:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917738:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917743:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917749:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917754:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917759:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917764:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917770:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917775:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917780:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917785:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917792:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917798:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917804:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917810:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917816:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917822:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917838:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917844:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917849:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917855:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917871:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917876:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917881:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917887:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917893:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917898:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917904:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917909:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917915:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917931:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917937:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917943:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.917950:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.918616:0:6483:0:(service.c:3206:ptlrpc_main()) mdt_out00_000: service thread [ffff93d26c3cb600:6483] 0 exiting: rc = 1 00000100:00100000:2.0:1790773253.918758:0:6484:0:(service.c:3206:ptlrpc_main()) mdt_out00_001: service thread [ffff93d26c3cba00:6484] 1 exiting: rc = 0 00000100:00100000:2.0:1790773253.918824:0:7666:0:(service.c:3206:ptlrpc_main()) mdt_out00_002: service thread [ffff93d250722200:7666] 2 exiting: rc = 0 00000100:00100000:1.0:1790773253.921028:0:12789:0:(service.c:3206:ptlrpc_main()) mdt_out00_003: service thread [ffff93d143d8c600:12789] 3 exiting: rc = 0 00000100:00100000:2.0:1790773253.931077:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931093:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931099:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931142:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931152:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931159:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931168:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931176:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931182:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931189:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931196:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931228:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931238:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931245:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931252:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931276:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931285:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931292:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931300:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931307:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931312:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931331:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931340:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931347:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931354:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931359:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931366:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931385:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931410:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931416:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931425:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931431:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931437:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931444:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931451:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931457:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931463:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931469:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931475:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931492:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931499:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931505:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931511:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931517:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931523:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931530:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931535:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931542:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931551:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931557:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931565:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931584:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931591:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931597:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931604:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931613:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931620:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931626:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931636:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931643:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931650:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931657:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931662:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.931684:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:0.0:1790773253.971867:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773253.971947:0:6486:0:(service.c:3206:ptlrpc_main()) mdt_seqs_0001: service thread [ffff93d26c3ca800:6486] 1 exiting: rc = 0 00000100:00100000:2.0:1790773253.972149:0:6485:0:(service.c:3206:ptlrpc_main()) mdt_seqs_0000: service thread [ffff93d26c3cac00:6485] 0 exiting: rc = 1 00000100:00100000:3.0:1790773253.972344:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972355:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972361:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972377:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972382:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972388:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972393:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972398:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972404:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972411:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972416:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972422:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972428:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972434:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972441:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972446:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972452:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972458:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972463:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972468:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972472:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972478:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972483:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972488:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972493:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972498:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972504:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972510:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972515:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972520:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972525:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972530:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972535:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972542:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972548:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972553:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972558:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972564:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972578:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972583:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972588:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972594:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972599:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972603:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972609:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972613:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972619:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972625:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972630:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972636:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972642:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972647:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972651:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972657:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972662:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972667:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972673:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972678:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972684:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972689:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972695:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972701:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972707:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.972712:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.974037:0:6488:0:(service.c:3206:ptlrpc_main()) mdt_seqm_0001: service thread [ffff93d246141400:6488] 1 exiting: rc = 0 00000100:00100000:3.0:1790773253.974502:0:6487:0:(service.c:3206:ptlrpc_main()) mdt_seqm_0000: service thread [ffff93d26c3cb800:6487] 0 exiting: rc = 1 00000100:00100000:0.0:1790773253.974624:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974634:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974640:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974646:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974653:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974659:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974664:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974669:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974675:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974682:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974688:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974694:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974700:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974705:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974711:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974718:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974724:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974740:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974746:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974753:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974760:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974764:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974770:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974776:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974781:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974787:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974792:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974797:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974801:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974806:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974811:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974816:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974820:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974825:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974845:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974850:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974855:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974860:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974865:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974871:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974876:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974881:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974886:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974891:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974896:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974901:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974906:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974911:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974916:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974920:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974926:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974931:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974937:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974942:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974948:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974953:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974957:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974963:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974967:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974973:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974978:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974983:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974989:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.974994:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773253.975498:0:6489:0:(service.c:3206:ptlrpc_main()) mdt_fld_0000: service thread [ffff93d251464000:6489] 0 exiting: rc = 1 00000100:00100000:3.0:1790773253.975629:0:6490:0:(service.c:3206:ptlrpc_main()) mdt_fld_0001: service thread [ffff93d251465800:6490] 1 exiting: rc = 0 00000100:00100000:0.0:1790773253.976054:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976061:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976067:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976071:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976077:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976092:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976097:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976102:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976108:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976124:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976131:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976137:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976142:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976148:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976153:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976160:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976165:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976169:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976175:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976180:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976186:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976191:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976197:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976253:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976261:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976267:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976272:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976278:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976284:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976290:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976295:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976300:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976304:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976310:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976316:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976322:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976327:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976332:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976337:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976343:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976354:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976359:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976364:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976369:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976374:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976380:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976385:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976390:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976395:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976400:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976405:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976410:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976416:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976421:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976426:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976432:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976437:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976442:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976446:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976450:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976455:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976460:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976464:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773253.976469:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.977452:0:6491:0:(service.c:3206:ptlrpc_main()) mdt_io00_000: service thread [ffff93d2478ce000:6491] 0 exiting: rc = 1 00000100:00100000:0.0:1790773253.978969:0:6492:0:(service.c:3206:ptlrpc_main()) mdt_io00_001: service thread [ffff93d2478cea00:6492] 1 exiting: rc = 0 00000100:00100000:0.0:1790773253.980519:0:6493:0:(service.c:3206:ptlrpc_main()) mdt_io00_002: service thread [ffff93d2478ce800:6493] 2 exiting: rc = 0 00000100:00100000:3.0:1790773253.980682:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.980692:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.980698:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.980705:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.980711:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.980718:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.980758:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.980765:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.980771:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.980780:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.980787:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.980793:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.980799:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.980806:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.980812:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.980818:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.980823:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.980829:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.980835:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.980841:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.980848:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.980854:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.980860:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.980885:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.980892:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.980898:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.980904:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.980909:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.980914:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.980919:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.980925:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.980930:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.980937:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.980943:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.980948:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.980953:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.980958:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.980963:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.980969:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.980975:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.980981:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.980994:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.981000:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.981005:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.981012:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.981019:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.981025:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.981044:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.981052:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.981058:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.981064:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.981069:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.981074:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.981080:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.981086:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.981091:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.981097:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.981103:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.981108:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.981124:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.981131:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.981138:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.981143:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773253.981151:0:15321:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1790773253.991488:0:15321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790773253.991504:0:15321:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1790773253.991509:0:15321:0:(genops.c:885:class_export_put()) final put ffff93d26be97000/MDS_uuid 00000020:00000080:3.0:1790773253.991514:0:15321:0:(genops.c:844:class_export_destroy()) destroying export ffff93d26be97000/MDS_uuid for MDS 00000020:01000000:3.0:1790773253.991519:0:15321:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1790773253.991671:0:15321:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00000100:00080000:0.0:1790773254.477312:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) ce0675b4-b0c5-48e7-b182-565e22fed04c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790773254.477331:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) ce0675b4-b0c5-48e7-b182-565e22fed04c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790773254.477335:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790773254.477339:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1790773254.477345:0:38:0:(import.c:65:import_set_state_nolock()) ffff93d14241a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790773254.477358:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 392 00000100:00080000:0.0:1790773254.477408:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1790773254.477428:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d14241a800 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:0.0:1790773254.477486:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d143cc5f80 x1877761496086144/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790773254.477552:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790773254.477555:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1790773254.477557:0:38:0:(import.c:65:import_set_state_nolock()) ffff93d141ce9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790773254.477561:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 392 00000100:00080000:0.0:1790773254.477564:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1790773254.477568:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93d141ce9000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:0.0:1790773254.477578:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d143cc5500 x1877761496086400/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790773254.477710:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790773254.477734:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3606:1877761496086272:0@lo:400:kworker.0 00000400:00000100:2.0:1790773254.477828:0:3606:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877761496086272 offset 0 length 224: 4 00000100:00100000:0.0:1790773254.477990:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790773254.478000:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3605:1877761496086528:0@lo:400:kworker.0 00000400:00000100:0.0:1790773254.478023:0:3605:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877761496086528 offset 0 length 224: 4 00000100:00100000:3.0:1790773254.479266:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3603:1877761496086144:0@lo:38:kworker.0 00000400:00000100:3.0:1790773254.479314:0:3603:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877761496086144 offset 0 length 520: 4 00000100:00100000:3.0:1790773254.479343:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3603:1877761496086400:0@lo:38:kworker.0 00000400:00000100:3.0:1790773254.479359:0:3603:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877761496086400 offset 0 length 520: 4 00010000:00010000:0.0:1790773255.001966:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773256.013481:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773257.038924:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790773257.485463:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ce0675b4-b0c5-48e7-b182-565e22fed04c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790773257.485480:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ce0675b4-b0c5-48e7-b182-565e22fed04c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790773257.485483:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790773257.485488:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790773257.485566:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790773257.485571:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790773257.485628:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3606:1877761496086784:0@lo:400:kworker.0 00000400:00000100:2.0:1790773257.485711:0:3606:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877761496086784 offset 0 length 224: 4 00000100:00100000:3.0:1790773257.485819:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790773257.485829:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3604:1877761496086656:0@lo:400:kworker.0 00000400:00000100:3.0:1790773257.485850:0:3604:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877761496086656 offset 0 length 224: 4 00010000:00010000:2.0:1790773258.062441:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1790773258.460136:0:15522:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1790773258.472498:0:15522:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1790773258.472585:0:15522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3600/0xabf1cc0bc784197b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841982 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773258.472606:0:15522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3600/0xabf1cc0bc784197b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7841982 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773258.472640:0:15522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3600/0xabf1cc0bc784197b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc7841982 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773258.472648:0:15522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3600/0xabf1cc0bc784197b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc7841982 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773258.472676:0:15522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1790773258.472684:0:15522:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1790773258.472722:0:15522:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790773258.472738:0:15522:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d143cc5f80 x1877761496086144/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790773274 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773258.472779:0:15522:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1790773258.472784:0:15522:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1790773258.472790:0:15522:0:(import.c:65:import_set_state_nolock()) ffff93d14241a800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1790773258.472795:0:15522:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790773258.472800:0:15522:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d143cc5f80 x1877761496086144/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790773274 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773258.472806:0:15522:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1790773258.472809:0:15522:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 21s for inflight to error out 00010000:00010000:0.0:1790773258.472960:0:8409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790773258.472968:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3600/0xabf1cc0bc784197b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc7841982 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773258.472976:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a3600 already unused, calling callback (ffffffffc14cac20) 00000100:00100000:3.0:1790773258.472977:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3603:1877761496086144:0@lo:38:kworker.0 10000000:00010000:0.0:1790773258.472980:0:8409:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3600/0xabf1cc0bc784197b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc7841982 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773258.472990:0:8409:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3600/0xabf1cc0bc784197b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xabf1cc0bc7841982 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790773258.473005:0:8409:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3600/0xabf1cc0bc784197b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xabf1cc0bc7841982 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790773258.473011:0:8409:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790773258.473014:0:8409:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1790773258.473016:0:8409:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1790773258.473029:0:8409:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93d251280800 00010000:00010000:0.0:1790773258.473033:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3600/0xabf1cc0bc784197b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xabf1cc0bc7841982 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773258.473039:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3600/0xabf1cc0bc784197b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xabf1cc0bc7841982 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773258.473050:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773258.473052:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773258.473053:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790773258.474105:0:15522:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1790773258.474117:0:15522:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d143cc4a80 x1877761496086272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773270 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773258.474140:0:15522:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d27f9f7800 x1877761496086656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773273 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773258.474234:0:15522:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1790773258.474240:0:15522:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1790773258.474275:0:15522:0:(import.c:65:import_set_state_nolock()) ffff93d142526000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1790773258.474321:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3603:1877761496086912:0@lo:39:umount.0 00000100:00100000:0.0:1790773258.474358:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3604:1877761496086656:0@lo:400:kworker.0 00000400:00000100:3.0:1790773258.479578:0:3603:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877761496086912 offset 0 length 224: 4 00000100:00100000:2.0:1790773258.480262:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3606:1877761496086272:0@lo:400:kworker.0 00010000:00010000:1.0:1790773259.085601:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790773259.089635:0:9475:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1790773259.089656:0:9475:0:(genops.c:885:class_export_put()) final put ffff93d143271800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1790773259.090041:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d143271800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1790773259.091790:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d143275800 for lustre-OST0001 00000001:00100000:2.0:1790773259.094944:0:8388:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1790773259.094957:0:8388:0:(genops.c:885:class_export_put()) final put ffff93d141fea800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1790773259.095275:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d141fea800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1790773259.095355:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d141fe8800 for lustre-OST0000 00000100:00080000:1.0:1790773259.537319:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) ce0675b4-b0c5-48e7-b182-565e22fed04c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790773259.537336:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) ce0675b4-b0c5-48e7-b182-565e22fed04c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790773259.537340:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790773259.537343:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790773259.537541:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3607:1877761496087040:0@lo:400:kworker.0 00000400:00000100:2.0:1790773259.537639:0:3607:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877761496087040 offset 0 length 224: 4 00010000:00010000:2.0:1790773260.109601:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773261.133783:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773262.158715:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773263.185150:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773263.629455:0:3603:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790773253/real 1790773253] req@ffff93d27f9f5880 x1877761496086016/t0(0) o250->MGC192.168.202.119@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1790773263 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773263.629494:0:3603:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93d27f9f5880 x1877761496086016/t0(0) o250->MGC192.168.202.119@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1790773263 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790773263.629515:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d251280800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790773263.629564:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1790773263.629569:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ce0675b4-b0c5-48e7-b182-565e22fed04c:3603:1877761496086016:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:2.0:1790773263.629705:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ce0675b4-b0c5-48e7-b182-565e22fed04c->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790773263.629717:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1790773263.629719:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d251280800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790773263.629724:0:8:0:(import.c:545:import_select_connection()) MGC192.168.202.119@tcp: connect to NID 0@lo last attempt 395 00000100:00080000:2.0:1790773263.629729:0:8:0:(import.c:630:import_select_connection()) MGC192.168.202.119@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790773263.629740:0:8:0:(import.c:666:import_select_connection()) MGC192.168.202.119@tcp: import ffff93d251280800 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:2.0:1790773263.629769:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d27f9f6300 x1877761496087168/t0(0) o250->MGC192.168.202.119@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790773263.629795:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790773263.629799:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790773263.629913:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3604:1877761496087296:0@lo:400:kworker.0 00000400:00000100:3.0:1790773263.629977:0:3604:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877761496087296 offset 0 length 224: 4 00000100:00100000:0.0:1790773263.630938:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ce0675b4-b0c5-48e7-b182-565e22fed04c:3603:1877761496087168:0@lo:250:kworker.0 00000400:00000100:0.0:1790773263.630988:0:3603:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877761496087168 offset 0 length 520: 4 00010000:00010000:0.0:1790773264.211013:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773265.229733:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773266.254192:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773267.277616:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773268.301907:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773268.754430:0:3603:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790773258/real 1790773258] req@ffff93d2526cd500 x1877761496086912/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790773268 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773268.754488:0:3603:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93d2526cd500 x1877761496086912/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790773268 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790773268.754515:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d142526000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1790773268.754541:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3603:1877761496086912:0@lo:39:umount.0 00000100:00080000:1.0:1790773268.755150:0:15522:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1790773268.755158:0:15522:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1790773268.755167:0:15522:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1790773268.757186:0:15522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26efc4000/0xabf1cc0bc7841989 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841990 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773268.757461:0:15522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26efc4000/0xabf1cc0bc7841989 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7841990 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773268.757472:0:15522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26efc4000/0xabf1cc0bc7841989 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc7841990 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773268.757481:0:15522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffff93d26efc4000/0xabf1cc0bc7841989 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc7841990 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773268.757631:0:15522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790773268.757643:0:15522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d1434ac400/0xabf1cc0bc7841bf1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841bf8 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773268.757711:0:15522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d1434ac400/0xabf1cc0bc7841bf1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7841bf8 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773268.757743:0:15522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d1434ac400/0xabf1cc0bc7841bf1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc7841bf8 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773268.757749:0:15522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffff93d1434ac400/0xabf1cc0bc7841bf1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc7841bf8 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773268.762045:0:6466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790773268.762075:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d26efc4000/0xabf1cc0bc7841989 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc7841990 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773268.762092:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc4000 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:2.0:1790773268.762097:0:6466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d26efc4000/0xabf1cc0bc7841989 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc7841990 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773268.762112:0:6466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d26efc4000/0xabf1cc0bc7841989 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xabf1cc0bc7841990 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790773268.762121:0:6466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d26efc4000/0xabf1cc0bc7841989 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xabf1cc0bc7841990 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790773268.762128:0:6466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790773268.762132:0:6466:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:2.0:1790773268.762159:0:6466:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93d251280800 00010000:00010000:2.0:1790773268.762164:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d26efc4000/0xabf1cc0bc7841989 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xabf1cc0bc7841990 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773268.762203:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d26efc4000/0xabf1cc0bc7841989 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xabf1cc0bc7841990 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773268.762267:0:6466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790773268.762273:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d1434ac400/0xabf1cc0bc7841bf1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc7841bf8 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773268.762280:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ac400 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:2.0:1790773268.762283:0:6466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d1434ac400/0xabf1cc0bc7841bf1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc7841bf8 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773268.762291:0:6466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d1434ac400/0xabf1cc0bc7841bf1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xabf1cc0bc7841bf8 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790773268.762635:0:6466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d1434ac400/0xabf1cc0bc7841bf1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xabf1cc0bc7841bf8 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790773268.762643:0:6466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1790773268.762704:0:6466:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1790773268.762713:0:6466:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93d251280800 00010000:00010000:2.0:1790773268.762717:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d1434ac400/0xabf1cc0bc7841bf1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xabf1cc0bc7841bf8 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773268.762727:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773268.762729:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773268.762732:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773268.763049:0:15522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1790773268.763062:0:15522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d1434ac400/0xabf1cc0bc7841bf1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xabf1cc0bc7841bf8 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790773268.763077:0:15522:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1790773268.763089:0:15522:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:1.0:1790773268.763092:0:15522:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1790773268.763151:0:15522:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1790773268.763159:0:15522:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1790773268.763168:0:15522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790773268.763183:0:15522:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790773268.763193:0:15522:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff93d141d819c0) has no exports 00000020:00080000:1.0:1790773268.764558:0:15522:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff93d141d819c0) has no exports 00010000:00010000:0.0:1790773268.766592:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1790773268.774097:0:15522:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff93d1433eeb40 - data ffff93d2739cc5e8/ffff93d143c4d400 00000020:01000000:1.0:1790773268.774748:0:15522:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff93d141d99540 - data ffff93d2739ce6c0/ffff93d27c322400 00100000:10000000:2.0:1790773268.789010:0:15522:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1790773268.808293:0:15522:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc78416cd 00000020:00000080:0.0:1790773268.808310:0:15522:0:(genops.c:885:class_export_put()) final put ffff93d26ed8a000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1790773268.808343:0:15522:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93d26ff80800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1790773268.808348:0:15522:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93d26ff80800 2 00000020:01000004:0.0:1790773268.808352:0:15522:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93d26ff80800 from lustre-OST0000 00000020:00000080:3.0:1790773268.808388:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d26ed8a000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1790773268.808399:0:15522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790773268.808414:0:15522:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1790773268.808417:0:15522:0:(genops.c:885:class_export_put()) final put ffff93d26ef97000/lustre-OST0000_UUID 00000020:00000080:0.0:1790773268.808420:0:15522:0:(genops.c:844:class_export_destroy()) destroying export ffff93d26ef97000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1790773268.808429:0:15522:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1790773268.808512:0:15522:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1790773268.808519:0:15522:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1790773268.808523:0:15522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790773268.808531:0:15522:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1790773268.808555:0:15522:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff93d142418000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790773268.808821:0:15522:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff93d26ec23380) has exports, disconnecting them 00000020:00080000:0.0:1790773268.808829:0:15522:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff93d142418000), last request at 1790773037 00000020:00000080:0.0:1790773268.808835:0:15522:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc78416f7 00000020:00080000:0.0:1790773268.808854:0:15522:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93d142418000): rc 0 00000020:00000080:0.0:1790773268.808861:0:15522:0:(genops.c:885:class_export_put()) final put ffff93d142418000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1790773268.809010:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d142418000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1790773268.812704:0:15522:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1790773268.812720:0:15522:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790773268.812727:0:15522:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1790773268.812738:0:15522:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790773268.813052:0:15522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790773268.813066:0:15522:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:1.0:1790773268.813075:0:15522:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1790773268.813086:0:15522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790773268.813123:0:15522:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1790773268.813137:0:15522:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff93d142525800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790773268.813146:0:15522:0:(genops.c:1552:class_disconnect_exports()) OBD device 20 (ffff93d27b2c4d40) has exports, disconnecting them 00000020:00080000:1.0:1790773268.813152:0:15522:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff93d142525800), last request at 1790773037 00000020:00000080:1.0:1790773268.813159:0:15522:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc784170c 00000020:00080000:1.0:1790773268.813187:0:15522:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93d142525800): rc 0 00000020:00000080:1.0:1790773268.813193:0:15522:0:(genops.c:885:class_export_put()) final put ffff93d142525800/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1790773268.813429:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d14241a800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1790773268.813445:0:8:0:(genops.c:885:class_export_put()) final put ffff93d141cec000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1790773268.813449:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d141cec000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1790773268.813458:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1790773268.813578:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d142525800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00000100:00080000:3.0:1790773268.823228:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ce0675b4-b0c5-48e7-b182-565e22fed04c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790773268.823263:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ce0675b4-b0c5-48e7-b182-565e22fed04c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790773268.823267:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790773268.823273:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790773268.823475:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144547480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3605:1877761496087424:0@lo:400:kworker.0 00000400:00000100:3.0:1790773268.823594:0:3605:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877761496087424 offset 0 length 224: 4 00010000:01000000:0.0:1790773268.937184:0:15522:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1790773268.937198:0:15522:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1790773268.937504:0:15522:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1790773268.937516:0:15522:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790773268.937811:0:15522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790773268.937822:0:15522:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1790773268.937835:0:15522:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93d26ff80800 1 00000020:00000080:0.0:1790773268.937848:0:15522:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7841695 00000020:00000080:0.0:1790773268.937858:0:15522:0:(genops.c:885:class_export_put()) final put ffff93d26ef94800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1790773268.939057:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d142526000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1790773268.939072:0:8:0:(genops.c:885:class_export_put()) final put ffff93d142520800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1790773268.939075:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d142520800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1790773268.939094:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000000:0.0:1790773268.939368:0:15522:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1790773268.939378:0:15522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790773268.939389:0:15522:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1790773268.939396:0:15522:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff93d27b2c0000) has no exports 00000020:00000080:3.0:1790773268.940292:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d26ef94800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1790773269.003079:0:15522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790773269.003101:0:15522:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1790773269.003107:0:15522:0:(genops.c:885:class_export_put()) final put ffff93d27c299000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1790773269.003113:0:15522:0:(genops.c:844:class_export_destroy()) destroying export ffff93d27c299000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1790773269.003130:0:15522:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1790773269.003355:0:15522:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93d27c29c800 00000020:02000400:1.0:1790773269.003416:0:15522:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1790773269.328647:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773270.349608:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1790773270.861709:0:3605:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790773254/real 1790773254] req@ffff93d143cc4380 x1877761496086528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790773270 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773270.896578:0:3605:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff93d143cc4380 x1877761496086528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790773270 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790773270.896603:0:3605:0:(import.c:65:import_set_state_nolock()) ffff93d1434c9000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1790773270.896610:0:3605:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1790773270.913484:0:3605:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:3.0:1790773270.913581:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ce0675b4-b0c5-48e7-b182-565e22fed04c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790773270.913594:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ce0675b4-b0c5-48e7-b182-565e22fed04c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790773270.913599:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790773270.913603:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790773270.913607:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790773270.913611:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1790773270.913619:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d1434c9000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790773270.913644:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 200 00000100:00080000:3.0:1790773270.913668:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff93d1434c9000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:1.0:1790773270.913699:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3605:1877761496086528:0@lo:400:kworker.0 00000100:00100000:3.0:1790773270.913736:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d144545180 x1877761496087552/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790773270.913871:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144545180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3603:1877761496087552:0@lo:38:kworker.0 00000400:00000100:1.0:1790773270.913941:0:3603:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877761496087552 offset 0 length 520: 4 00010000:00010000:2.0:1790773271.374900:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773272.397550:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790773273.307402:0:15737:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1790773273.326467:0:15737:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1790773273.326596:0:15737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26efc4400/0xabf1cc0bc784195f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841966 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773273.326613:0:15737:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26efc4400/0xabf1cc0bc784195f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7841966 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773273.327038:0:15737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26efc4400/0xabf1cc0bc784195f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc7841966 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773273.327049:0:15737:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffff93d26efc4400/0xabf1cc0bc784195f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc7841966 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773273.327095:0:15737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1790773273.327101:0:15737:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1790773273.327135:0:15737:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790773273.327147:0:15737:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d143cc5500 x1877761496086400/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790773274 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773273.327164:0:15737:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1790773273.327201:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d141ce9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790773273.327236:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:0.0:1790773273.327240:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3603:1877761496086400:0@lo:38:kworker.0 00000100:00080000:0.0:1790773273.327267:0:15737:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1790773273.327273:0:15737:0:(import.c:65:import_set_state_nolock()) ffff93d141ce9000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1790773273.327278:0:15737:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790773273.327280:0:15737:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1790773273.327283:0:15737:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1790773273.328256:0:6466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790773273.328266:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d26efc4400/0xabf1cc0bc784195f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc7841966 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773273.328275:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc4400 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:3.0:1790773273.328279:0:6466:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d26efc4400/0xabf1cc0bc784195f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc7841966 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773273.328288:0:6466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d26efc4400/0xabf1cc0bc784195f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xabf1cc0bc7841966 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790773273.328305:0:6466:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d26efc4400/0xabf1cc0bc784195f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xabf1cc0bc7841966 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773273.328310:0:6466:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790773273.328313:0:6466:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1790773273.328315:0:6466:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1790773273.328328:0:6466:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93d251280800 00010000:00010000:3.0:1790773273.328332:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d26efc4400/0xabf1cc0bc784195f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xabf1cc0bc7841966 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773273.328338:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d26efc4400/0xabf1cc0bc784195f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xabf1cc0bc7841966 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773273.328348:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773273.328350:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773273.328351:0:6466:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790773273.328374:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ce0675b4-b0c5-48e7-b182-565e22fed04c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790773273.328379:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ce0675b4-b0c5-48e7-b182-565e22fed04c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790773273.328382:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790773273.328385:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790773273.336503:0:15737:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1790773273.336530:0:15737:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d27f9f5f80 x1877761496086784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773273 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773273.336578:0:15737:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d2526cd880 x1877761496087040/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773275 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773273.336840:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3606:1877761496086784:0@lo:400:kworker.0 00000100:00100000:1.0:1790773273.336864:0:15737:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d27f9f4000 x1877761496087296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773279 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773273.336887:0:15737:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d144547480 x1877761496087424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773284 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773273.336903:0:15737:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d144545180 x1877761496087552/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790773280 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773273.336917:0:15737:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:1.0:1790773273.336957:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144547480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3605:1877761496087424:0@lo:400:kworker.0 00000100:00100000:3.0:1790773273.336996:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3604:1877761496087296:0@lo:400:kworker.0 00000100:00100000:0.0:1790773273.337026:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3607:1877761496087040:0@lo:400:kworker.0 00000100:00080000:1.0:1790773273.337902:0:15737:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1790773273.337910:0:15737:0:(import.c:65:import_set_state_nolock()) ffff93d1434c9000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1790773273.337916:0:15737:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1790773273.337921:0:15737:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d2526cd880 x1877761496087040/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773275 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773273.337942:0:15737:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d27f9f4000 x1877761496087296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773279 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773273.337949:0:15737:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d144545180 x1877761496087552/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790773280 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773273.337956:0:15737:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1790773273.337960:0:15737:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:0.0:1790773273.338102:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144545180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3603:1877761496087552:0@lo:38:kworker.0 00010000:00010000:2.0:1790773273.339600:0:15737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3000/0xabf1cc0bc784196d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841974 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773273.339620:0:15737:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3000/0xabf1cc0bc784196d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7841974 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773273.339628:0:15737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3000/0xabf1cc0bc784196d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc7841974 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773273.339635:0:15737:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3000/0xabf1cc0bc784196d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc7841974 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773273.339695:0:15737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790773273.339706:0:15737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d1434adc00/0xabf1cc0bc7841c29 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7841c30 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773273.339712:0:15737:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d1434adc00/0xabf1cc0bc7841c29 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7841c30 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773273.339718:0:15737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d1434adc00/0xabf1cc0bc7841c29 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc7841c30 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773273.339726:0:15737:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffff93d1434adc00/0xabf1cc0bc7841c29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc7841c30 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773273.339794:0:8409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790773273.339806:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3000/0xabf1cc0bc784196d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc7841974 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773273.339815:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a3000 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:0.0:1790773273.339820:0:8409:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3000/0xabf1cc0bc784196d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc7841974 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773273.339829:0:8409:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3000/0xabf1cc0bc784196d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xabf1cc0bc7841974 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790773273.339858:0:8409:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3000/0xabf1cc0bc784196d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xabf1cc0bc7841974 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790773273.339864:0:8409:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790773273.339866:0:8409:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:0.0:1790773273.339880:0:8409:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93d251280800 00010000:00010000:0.0:1790773273.339884:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3000/0xabf1cc0bc784196d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xabf1cc0bc7841974 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773273.339890:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3000/0xabf1cc0bc784196d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xabf1cc0bc7841974 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773273.339905:0:8409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790773273.339908:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d1434adc00/0xabf1cc0bc7841c29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc7841c30 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773273.339914:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434adc00 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:0.0:1790773273.339916:0:8409:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d1434adc00/0xabf1cc0bc7841c29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc7841c30 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773273.339922:0:8409:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d1434adc00/0xabf1cc0bc7841c29 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xabf1cc0bc7841c30 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790773273.339939:0:8409:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d1434adc00/0xabf1cc0bc7841c29 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xabf1cc0bc7841c30 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790773273.339945:0:8409:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1790773273.339947:0:8409:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1790773273.339950:0:8409:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93d251280800 00010000:00010000:0.0:1790773273.339959:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d1434adc00/0xabf1cc0bc7841c29 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xabf1cc0bc7841c30 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773273.339967:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773273.339969:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773273.339971:0:8409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773273.340030:0:15737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1790773273.340034:0:15737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d1434adc00/0xabf1cc0bc7841c29 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xabf1cc0bc7841c30 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790773273.340056:0:15737:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:2.0:1790773273.340061:0:15737:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:2.0:1790773273.340064:0:15737:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1790773273.340099:0:15737:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1790773273.340104:0:15737:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1790773273.340111:0:15737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790773273.340119:0:15737:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1790773273.340124:0:15737:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff93d26ec219c0) has no exports 00000020:00080000:2.0:1790773273.340157:0:15737:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff93d26ec219c0) has no exports 00000020:01000000:2.0:1790773273.342620:0:15737:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff93d1433ee8a0 - data ffff93d273ae5798/ffff93d143c4d800 00000020:01000000:2.0:1790773273.342788:0:15737:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff93d1433ee120 - data ffff93d27383f948/ffff93d27f96f400 00010000:00010000:1.0:1790773273.343339:0:6467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1790773273.374337:0:15737:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1790773273.394143:0:15737:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc78417f3 00000020:00000080:3.0:1790773273.394157:0:15737:0:(genops.c:885:class_export_put()) final put ffff93d14241f800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1790773273.394182:0:15737:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93d141fee800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1790773273.394185:0:15737:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93d141fee800 2 00000020:01000004:3.0:1790773273.394200:0:15737:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93d141fee800 from lustre-OST0001 00000020:00000080:3.0:1790773273.394251:0:15737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790773273.394261:0:15737:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1790773273.394265:0:15737:0:(genops.c:885:class_export_put()) final put ffff93d141cef000/lustre-OST0001_UUID 00000020:00000080:3.0:1790773273.394268:0:15737:0:(genops.c:844:class_export_destroy()) destroying export ffff93d141cef000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1790773273.394275:0:15737:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1790773273.394415:0:15737:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import ce0675b4-b0c5-48e7-b182-565e22fed04c->MGS 00010000:00010000:3.0:1790773273.394432:0:15737:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d24166ec00/0xabf1cc0bc7841568 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xabf1cc0bc784156f expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790773273.394445:0:15737:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d24166ec00/0xabf1cc0bc7841568 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xabf1cc0bc784156f expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773273.394452:0:15737:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1790773273.394455:0:15737:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1790773273.394459:0:15737:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1790773273.394481:0:15737:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93d251280800 00010000:00010000:3.0:1790773273.394485:0:15737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d24166ec00/0xabf1cc0bc7841568 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xabf1cc0bc784156f expref: -99 pid: 7408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773273.394503:0:15737:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d279de2e00/0xabf1cc0bc78419cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xabf1cc0bc78419d6 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790773273.394510:0:15737:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d279de2e00/0xabf1cc0bc78419cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xabf1cc0bc78419d6 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773273.394516:0:15737:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790773273.394518:0:15737:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1790773273.394520:0:15737:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1790773273.394532:0:15737:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93d251280800 00010000:00010000:3.0:1790773273.394535:0:15737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d279de2e00/0xabf1cc0bc78419cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xabf1cc0bc78419d6 expref: -99 pid: 6475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1790773273.394565:0:15737:0:(import.c:65:import_set_state_nolock()) ffff93d251280800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1790773273.394570:0:15737:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1790773273.394573:0:15737:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1790773273.394574:0:15737:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1790773273.394579:0:15737:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1790773273.394590:0:15737:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d27f9f6300 x1877761496087168/t0(0) o250->MGC192.168.202.119@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1790773278 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1790773273.394604:0:15737:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1790773273.394606:0:15737:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000020:00000080:0.0:1790773273.394800:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93d14241f800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:0.0:1790773273.394839:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ce0675b4-b0c5-48e7-b182-565e22fed04c:3603:1877761496087168:0@lo:250:kworker.0 10000000:01000000:3.0:1790773273.394991:0:15737:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1790773273.394998:0:15737:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7841449 00000020:00000080:3.0:1790773273.395002:0:15737:0:(genops.c:885:class_export_put()) final put ffff93d26be95000/ce0675b4-b0c5-48e7-b182-565e22fed04c 00000020:01000000:3.0:1790773273.395048:0:15737:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.119@tcp (flags='') 00000020:00000080:3.0:1790773273.395053:0:15737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790773273.395058:0:15737:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.119@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1790773273.395063:0:15737:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff93d262660000) has no exports 10000000:01000000:1.0:1790773273.395251:0:6475:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1790773273.396882:0:15737:0:(obd_class.h:668:obd_cleanup_client_import()) MGC192.168.202.119@tcp: client import never connected 00000100:00080000:3.0:1790773273.396892:0:15737:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1790773273.396896:0:15737:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1790773273.396900:0:15737:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1790773273.396904:0:15737:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1790773273.396991:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93d26be95000/ce0675b4-b0c5-48e7-b182-565e22fed04c for MGC192.168.202.119@tcp 00000020:00000080:3.0:1790773273.397461:0:15737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790773273.397474:0:15737:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.119@tcp (uuid ce0675b4-b0c5-48e7-b182-565e22fed04c) 00000020:01000000:3.0:1790773273.397482:0:15737:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1790773273.397486:0:15737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790773273.397493:0:15737:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1790773273.397500:0:15737:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff93d141cee000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790773273.397506:0:15737:0:(genops.c:1552:class_disconnect_exports()) OBD device 25 (ffff93d26ec20000) has exports, disconnecting them 00000020:00080000:3.0:1790773273.397510:0:15737:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff93d141cee000), last request at 1790773057 00000020:00000080:3.0:1790773273.397515:0:15737:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc784181d 00000020:00080000:3.0:1790773273.397538:0:15737:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93d141cee000): rc 0 00000020:00000080:3.0:1790773273.397543:0:15737:0:(genops.c:885:class_export_put()) final put ffff93d141cee000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1790773273.397639:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d251280800 for MGC192.168.202.119@tcp 00000020:00000080:0.0:1790773273.397646:0:38:0:(genops.c:885:class_export_put()) final put ffff93d251286800/ce0675b4-b0c5-48e7-b182-565e22fed04c 00000020:00000080:0.0:1790773273.397648:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93d251286800/ce0675b4-b0c5-48e7-b182-565e22fed04c for MGC192.168.202.119@tcp 00000020:01000000:0.0:1790773273.397654:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.119@tcp (ce0675b4-b0c5-48e7-b182-565e22fed04c) 00000020:00000080:0.0:1790773273.399009:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93d141cee000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1790773273.405310:0:15737:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1790773273.405321:0:15737:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790773273.405327:0:15737:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1790773273.405337:0:15737:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790773273.405614:0:15737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790773273.405624:0:15737:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1790773273.405632:0:15737:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1790773273.405637:0:15737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790773273.405642:0:15737:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1790773273.405650:0:15737:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff93d141ceb000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790773273.405657:0:15737:0:(genops.c:1552:class_disconnect_exports()) OBD device 26 (ffff93d1435ecd40) has exports, disconnecting them 00000020:00080000:0.0:1790773273.405662:0:15737:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff93d141ceb000), last request at 1790773057 00000020:00000080:0.0:1790773273.405667:0:15737:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7841832 00000020:00080000:0.0:1790773273.405716:0:15737:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93d141ceb000): rc 0 00000020:00000080:0.0:1790773273.405723:0:15737:0:(genops.c:885:class_export_put()) final put ffff93d141ceb000/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1790773273.405784:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d141ce9000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1790773273.405792:0:38:0:(genops.c:885:class_export_put()) final put ffff93d1434ce800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1790773273.405795:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93d1434ce800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1790773273.405814:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1790773273.406741:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93d141ceb000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1790773273.408323:0:15737:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1790773273.408334:0:15737:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1790773273.408339:0:15737:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1790773273.408347:0:15737:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790773273.408384:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d1434c9000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1790773273.422041:0:6466:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1790773273.423262:0:8409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1790773273.423451:0:6467:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1790773273.423603:0:6461:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_000: service thread [ffff93d2512cfc00:6461] 0 exiting: rc = 1 00000100:00100000:1.0:1790773273.423711:0:9484:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_002: service thread [ffff93d26efcee00:9484] 2 exiting: rc = 0 00000100:00100000:0.0:1790773273.425331:0:6462:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_001: service thread [ffff93d2512cfa00:6462] 1 exiting: rc = 0 00000100:00100000:3.0:1790773273.425595:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.426648:0:6465:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_002: service thread [ffff93d244d05e00:6465] 2 exiting: rc = 0 00000100:00100000:0.0:1790773273.426883:0:6464:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_001: service thread [ffff93d2517a6600:6464] 1 exiting: rc = 0 00000100:00100000:0.0:1790773273.427151:0:8410:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_003: service thread [ffff93d141d11400:8410] 3 exiting: rc = 0 00000100:00100000:0.0:1790773273.427305:0:6463:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_000: service thread [ffff93d244d05400:6463] 0 exiting: rc = 1 00000100:00100000:0.0:1790773273.427370:0:10300:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_004: service thread [ffff93d2512e8a00:10300] 4 exiting: rc = 0 00000100:00100000:3.0:1790773273.427568:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.427575:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.427581:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.427589:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.427595:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.427600:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.427606:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.427614:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.427619:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.427625:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.427632:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.427638:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.427644:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.427649:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.427655:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.427661:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.427666:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.427673:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.427678:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.427684:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.427828:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.427836:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.427842:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.427847:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.427852:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.427858:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.427863:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.427868:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.427885:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.427890:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.427894:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.427899:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.427905:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.427910:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.427916:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.427921:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.427925:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.427944:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.427949:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.427955:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.428027:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.428041:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.428047:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.428052:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.428058:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.428063:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.428068:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.428074:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.428090:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.428096:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.428102:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.428108:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.428114:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.428120:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.428126:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.428133:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.428139:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.428144:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.428150:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.428156:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.428161:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.428167:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.428173:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.428186:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1790773273.429430:0:15737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790773273.429447:0:15737:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1790773273.429456:0:15737:0:(genops.c:885:class_export_put()) final put ffff93d141ce8000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1790773273.429462:0:15737:0:(genops.c:844:class_export_destroy()) destroying export ffff93d141ce8000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1790773273.429470:0:15737:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1790773273.429537:0:15737:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93d141fee800 1 00000020:00000080:3.0:1790773273.429545:0:15737:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc78417c2 00000020:00000080:3.0:1790773273.429553:0:15737:0:(genops.c:885:class_export_put()) final put ffff93d141ced000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1790773273.432720:0:15737:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1790773273.432737:0:15737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790773273.432748:0:15737:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1790773273.432754:0:15737:0:(genops.c:1557:class_disconnect_exports()) OBD device 23 (ffff93d1427399c0) has no exports 00000020:00000080:1.0:1790773273.435791:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93d141ced000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1790773273.477146:0:15737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790773273.477168:0:15737:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1790773273.477176:0:15737:0:(genops.c:885:class_export_put()) final put ffff93d27f91a000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1790773273.477183:0:15737:0:(genops.c:844:class_export_destroy()) destroying export ffff93d27f91a000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1790773273.477190:0:15737:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1790773273.477894:0:15737:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93d27f91a800 00000020:01000000:1.0:1790773273.477937:0:15737:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1790773273.477944:0:15737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790773273.477949:0:15737:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790773273.477955:0:15737:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff93d26bfc4d40) has no exports 00000020:00000080:1.0:1790773273.477982:0:15737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790773273.477990:0:15737:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1790773273.477995:0:15737:0:(genops.c:885:class_export_put()) final put ffff93d26ef93000/OSS_uuid 00000020:00000080:1.0:1790773273.477998:0:15737:0:(genops.c:844:class_export_destroy()) destroying export ffff93d26ef93000/OSS_uuid for OSS 00000020:01000000:1.0:1790773273.478004:0:15737:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1790773273.478240:0:8392:0:(service.c:3206:ptlrpc_main()) ll_ost00_000: service thread [ffff93d27c177c00:8392] 0 exiting: rc = 1 00000100:00100000:2.0:1790773273.478310:0:8394:0:(service.c:3206:ptlrpc_main()) ll_ost00_002: service thread [ffff93d27c28d000:8394] 2 exiting: rc = 0 00000100:00100000:3.0:1790773273.478875:0:8907:0:(service.c:3206:ptlrpc_main()) ll_ost00_004: service thread [ffff93d141fde000:8907] 4 exiting: rc = 0 00000100:00100000:3.0:1790773273.479168:0:8906:0:(service.c:3206:ptlrpc_main()) ll_ost00_003: service thread [ffff93d27c055200:8906] 3 exiting: rc = 0 00000100:00100000:2.0:1790773273.479355:0:8393:0:(service.c:3206:ptlrpc_main()) ll_ost00_001: service thread [ffff93d27c28c200:8393] 1 exiting: rc = 0 00000100:00100000:1.0:1790773273.479894:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.479923:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.479942:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.479953:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.479975:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.479981:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.479988:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.479994:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480000:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480006:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480013:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480019:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480025:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480032:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480039:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480044:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480050:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480057:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480062:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480068:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480073:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480078:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480083:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480088:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480093:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480098:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480103:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480107:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480113:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480118:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480123:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480129:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480134:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480139:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480143:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480148:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480153:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480164:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480171:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480186:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480192:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480200:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480227:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480233:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480238:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480244:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480249:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480259:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480265:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480271:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480277:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480283:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480288:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480294:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480299:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480304:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480309:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480314:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480319:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480324:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480329:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480334:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480339:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.480345:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.481291:0:11145:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_002: service thread [ffff93d27b0a4e00:11145] 2 exiting: rc = 0 00000100:00100000:2.0:1790773273.481664:0:8397:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_001: service thread [ffff93d26ec34400:8397] 1 exiting: rc = 0 00000100:00080000:0.0:1790773273.482052:0:6474:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1790773273.482730:0:8396:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_000: service thread [ffff93d24964e000:8396] 0 exiting: rc = 1 00000100:00100000:1.0:1790773273.482892:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.482903:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.482914:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.482920:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.482935:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.482942:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.482948:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.482953:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.482961:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.482981:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.482986:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.482993:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.482999:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.483005:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.483011:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.483018:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.483024:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.483029:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.483034:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.483040:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.483046:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.483051:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.483056:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.483062:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.483069:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.483075:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.483081:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.483086:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.483092:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.483097:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.483103:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.483109:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.483115:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.483120:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.483126:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.483131:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.483137:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.483142:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.483148:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.483153:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.483161:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.483166:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.483172:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.483177:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.483189:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.483194:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.483200:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.484394:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.484400:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.484406:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.484412:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.484419:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.484425:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.484432:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.484437:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.484443:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.484449:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.484455:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.484460:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.484466:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.484472:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.484478:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.484484:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.484498:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.488841:0:8399:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_001: service thread [ffff93d248c50a00:8399] 1 exiting: rc = 0 00000100:00100000:2.0:1790773273.490778:0:8398:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_000: service thread [ffff93d248c51600:8398] 0 exiting: rc = 1 00000100:00100000:2.0:1790773273.493443:0:8400:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_002: service thread [ffff93d248c50800:8400] 2 exiting: rc = 0 00000100:00100000:3.0:1790773273.493602:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.493629:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.493639:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.493648:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.493656:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.493663:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.493684:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.493692:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.493700:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.493708:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.493714:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.493723:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.493729:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.493739:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.493748:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.493772:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.493780:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.493787:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.493794:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.493800:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.493806:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.493814:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.493821:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.493828:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.493854:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.493863:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.493870:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.493877:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.493886:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.493893:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.493900:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.493907:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.493914:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.493941:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.493950:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.493957:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.493967:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.493974:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.493982:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.493989:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.493996:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.494003:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.494012:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.494019:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.494025:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.494033:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.494040:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.494047:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.494074:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.494083:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.494100:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.494107:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.494115:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.494122:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.494130:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.494139:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.494148:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.494156:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.494178:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.494188:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.494232:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.494248:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.494263:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.494271:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773273.500180:0:8401:0:(service.c:3206:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff93d26ec34a00:8401] 0 exiting: rc = 1 00000100:00100000:2.0:1790773273.501040:0:8402:0:(service.c:3206:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff93d26ede5200:8402] 1 exiting: rc = 0 00000100:00100000:0.0:1790773273.501157:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501167:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501177:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501184:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501196:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501236:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501254:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501263:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501269:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501275:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501282:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501288:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501295:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501300:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501306:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501312:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501317:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501323:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501330:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501336:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501342:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501346:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501350:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501355:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501359:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501364:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501390:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501394:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501399:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501403:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501407:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501411:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501415:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501418:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501421:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501425:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501428:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501431:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501434:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501438:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501441:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501445:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501449:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501452:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501456:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501459:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501462:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501466:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501469:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501472:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501476:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501479:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501482:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501485:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501488:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501492:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501496:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501501:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501504:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501507:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501511:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501519:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501524:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.501531:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773273.503242:0:8404:0:(service.c:3206:ptlrpc_main()) ll_ost_out00_001: service thread [ffff93d2512ce000:8404] 1 exiting: rc = 0 00000100:00100000:1.0:1790773273.503490:0:8403:0:(service.c:3206:ptlrpc_main()) ll_ost_out00_000: service thread [ffff93d26edfb800:8403] 0 exiting: rc = 1 00000100:00100000:0.0:1790773273.503546:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.503556:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.503570:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.503577:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.503584:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504378:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504398:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504423:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504431:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504439:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504446:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504453:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504459:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504465:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504470:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504476:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504481:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504487:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504492:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504507:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504513:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504518:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504523:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504531:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504538:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504545:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504553:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504559:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504565:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504573:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504580:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504605:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504631:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504636:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504641:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504647:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504651:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504657:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504661:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504666:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504671:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504676:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504681:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504694:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504699:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504703:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504708:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504713:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504717:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504722:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504727:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504732:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504736:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504741:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504747:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504760:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504766:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504771:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504775:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504780:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504785:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504789:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504794:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773273.504808:0:15737:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1790773273.517111:0:15737:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1790773295.880263:0:16501:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg219-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1790773306.290991:0:17101:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1790773306.291002:0:17101:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1790773306.291004:0:17101:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1790773306.291131:0:17101:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93d14444c000 00000020:01000004:1.0:1790773306.291153:0:17101:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1790773306.291164:0:17101:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1790773306.291185:0:17101:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff93d1435eb380) 00000020:00000080:1.0:1790773306.292188:0:17101:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1790773306.442315:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1790773306.445690:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1790773306.449169:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1790773306.449808:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1790773306.452187:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1790773306.454797:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1790773306.455632:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1790773306.456784:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1790773306.457293:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1790773306.457627:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1790773306.457940:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1790773306.458326:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1790773306.458592:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1790773306.458808:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1790773306.459282:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1790773306.459624:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1790773306.459827:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1790773306.471297:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1790773306.471694:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1790773306.471974:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1790773306.472405:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1790773306.472927:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1790773306.473314:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1790773306.474188:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1790773306.474491:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1790773306.474746:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1790773306.475022:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1790773306.475421:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1790773306.476360:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1790773306.476630:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1790773306.476919:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1790773306.477738:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1790773306.481587:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1790773306.484019:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1790773306.485417:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1790773306.492192:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1790773306.493694:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1790773306.495774:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1790773306.496691:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1790773306.497063:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1790773306.497442:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1790773306.497641:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1790773306.498069:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1790773306.499598:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1790773306.501191:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1790773306.506316:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1790773306.507829:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1790773306.518991:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1790773306.520107:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1790773306.520466:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1790773306.521767:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1790773306.522105:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1790773306.522651:0:17101:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:01000000:1.0:1790773306.524146:0:17101:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1790773306.525714:0:17101:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1790773306.525723:0:17101:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:1.0:1790773306.525739:0:17101:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xabf1cc0bc7842a06 00000020:01000004:1.0:1790773306.525746:0:17101:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1790773306.525751:0:17101:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1790773306.525756:0:17101:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93d14444c000 from MGS 00000020:01000004:1.0:1790773306.525759:0:17101:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1790773306.525770:0:17101:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff93d1435e99c0) 00000020:00000080:1.0:1790773306.525781:0:17101:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1790773306.525838:0:17101:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93d14444c000 from MGS, refs=2 00080000:01000000:1.0:1790773306.526257:0:17101:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:1.0:1790773306.526265:0:17101:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xabf1cc0bc7842a14 00000100:00100000:1.0:1790773306.527407:0:17101:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1790773306.527592:0:17101:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1790773306.527599:0:17101:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1790773306.532698:0:17101:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1790773306.532744:0:17101:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1790773306.533707:0:17101:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790773306.533906:0:17101:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1790773306.533914:0:17101:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1790773306.538945:0:17101:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1790773306.538960:0:17101:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1790773306.540431:0:17101:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1790773306.540441:0:17101:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1790773306.542133:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773306.542137:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773306.542139:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773306.559485:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773306.559493:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773306.559496:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773306.560418:0:17101:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1790773306.561661:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1790773306.570376:0:17101:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1790773306.578335:0:17114:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1790773306.580833:0:17101:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1790773306.580977:0:17101:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1790773306.583104:0:17101:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1790773306.583658:0:17101:0:(service.c:173:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790773306.584178:0:17101:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1790773306.584186:0:17101:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1790773306.594667:0:17101:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1790773306.594680:0:17101:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1790773306.595479:0:17101:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1790773306.595489:0:17101:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1790773306.596193:0:17101:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1790773306.596270:0:17101:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.119@tcp' 00000020:01000004:3.0:1790773306.596273:0:17101:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1790773306.596315:0:17101:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.119@tcp (typ=mgc) 00000020:00000080:3.0:1790773306.596331:0:17101:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.119@tcp (ffff93d281ba99c0) 00000020:00000080:3.0:1790773306.596352:0:17101:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1790773306.596449:0:17101:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d26ec39000@MGC192.168.202.119@tcp: add connection 192.168.202.119@tcp at head 00010000:00010000:3.0:1790773306.596634:0:17101:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.119@tcp-0 is initialized 00000040:01000000:3.0:1790773306.596641:0:17101:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.119@tcp ctxt 1 is initialized 00000100:00080000:0.0:1790773306.596929:0:17118:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1790773306.605493:0:17120:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1790773306.605598:0:17101:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.119@tcp (uuid cdd0c180-4c21-4c72-90c1-0147a5902c2f) 00000020:00000080:1.0:1790773306.605644:0:17101:0:(genops.c:1384:class_connect()) connect: client cdd0c180-4c21-4c72-90c1-0147a5902c2f, cookie 0xabf1cc0bc7842a22 00000100:00080000:1.0:1790773306.605658:0:17101:0:(import.c:545:import_select_connection()) MGC192.168.202.119@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790773306.605670:0:17101:0:(import.c:666:import_select_connection()) MGC192.168.202.119@tcp: import ffff93d26ec39000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:1.0:1790773306.605708:0:17101:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d2526cea00 x1877761496087680/t0(0) o250->MGC192.168.202.119@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790773306.605733:0:17101:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import cdd0c180-4c21-4c72-90c1-0147a5902c2f->MGS 00000020:01000004:1.0:1790773306.605761:0:17101:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1790773306.605766:0:17101:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1790773306.605782:0:17101:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff93d1435e8000) 00000020:00000080:1.0:1790773306.605796:0:17101:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1790773306.609060:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3603:1877761496087680:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1790773306.609156:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773306.609887:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496087680 00000100:00100000:0.0:1790773306.609897:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496087680 00000100:00100000:0.0:1790773306.609936:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790773306.609945:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3603:x1877761496087680:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1790773306.609972:0:17115:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from cdd0c180-4c21-4c72-90c1-0147a5902c2f@0@lo t0 exp 0000000000000000 cur 449 last 0 00000020:00000080:0.0:1790773306.609998:0:17115:0:(genops.c:1384:class_connect()) connect: client cdd0c180-4c21-4c72-90c1-0147a5902c2f, cookie 0xabf1cc0bc7842a30 00000100:00080000:0.0:1790773306.611258:0:17115:0:(import.c:65:import_set_state_nolock()) ffff93d1445e9000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790773306.611422:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+5:3603:x1877761496087680:12345-0@lo:250:mount.lustre.0 Request processed in 1475us (2264us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773306.611431:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790773306.611468:0:3603:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.119@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1790773306.611478:0:3603:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.202.119@tcp: connect to target with instance 0 00000100:00080000:3.0:1790773306.611485:0:3603:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.202.119@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1790773306.611490:0:3603:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1790773306.611493:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d26ec39000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1790773306.611496:0:3603:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1790773306.611511:0:3603:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1790773306.611516:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3603:1877761496087680:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1790773306.617081:0:17101:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790773306.617450:0:17101:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1790773306.617457:0:17101:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1790773306.618595:0:17101:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1790773306.618606:0:17101:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1790773306.619327:0:17101:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1790773306.619335:0:17101:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1790773306.620253:0:17101:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790773306.620442:0:17101:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1790773306.620450:0:17101:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1790773306.630671:0:17101:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1790773306.630683:0:17101:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1790773306.700335:0:17101:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790773306.700584:0:17101:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1790773306.700591:0:17101:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1790773306.703195:0:17101:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1790773306.703241:0:17101:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1790773306.707748:0:17101:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790773306.707968:0:17101:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1790773306.707975:0:17101:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1790773306.709829:0:17101:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1790773306.709858:0:17101:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1790773306.710489:0:17101:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790773306.710681:0:17101:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1790773306.710687:0:17101:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1790773306.714578:0:17101:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1790773306.714595:0:17101:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1790773306.715271:0:17101:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790773306.715470:0:17101:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1790773306.715475:0:17101:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1790773306.716422:0:17101:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1790773306.716430:0:17101:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1790773306.742090:0:17101:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790773306.743144:0:17101:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1790773306.743153:0:17101:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1790773306.746774:0:17101:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1790773306.746791:0:17101:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1790773306.748237:0:17101:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1790773306.748252:0:17101:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1790773306.749283:0:17101:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1790773306.749311:0:17101:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1790773306.749317:0:17101:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.119@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1790773306.749519:0:17101:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.119@tcp ctxt 0 is initialized 00000020:01000004:1.0:1790773306.749554:0:17101:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.119@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1790773306.749559:0:17101:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1790773306.749561:0:17101:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790773306.749563:0:17101:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790773306.749564:0:17101:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790773306.749565:0:17101:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790773306.749566:0:17101:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790773306.749568:0:17101:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790773306.749569:0:17101:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790773306.749572:0:17101:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790773306.749573:0:17101:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790773306.749576:0:17101:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1790773306.749578:0:17101:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790773306.749579:0:17101:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790773306.749580:0:17101:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790773306.749581:0:17101:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790773306.749582:0:17101:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790773306.749583:0:17101:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790773306.749584:0:17101:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790773306.749585:0:17101:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790773306.749586:0:17101:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790773306.749587:0:17101:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790773306.749625:0:17101:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1790773306.749652:0:17101:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17101:1877761496087808:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1790773306.749761:0:17101:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773306.749932:0:17101:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27b0d0780 going to sleep for 11 seconds 00000100:00100000:0.0:1790773306.750597:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496087808 00000100:00100000:0.0:1790773306.750606:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496087808 00000100:00100000:0.0:1790773306.750690:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790773306.750710:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+5:17101:x1877761496087808:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790773306.750757:0:17117:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1790773306.750760:0:17117:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1790773306.750763:0:17117:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1790773306.754532:0:17138:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1790773306.755062:0:17117:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:1.0:1790773306.759949:0:17139:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1790773306.759960:0:17139:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1790773306.759963:0:17139:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1790773306.759967:0:17139:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1790773306.761062:0:17139:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1790773306.761684:0:17117:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1790773306.761697:0:17117:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1790773306.763852:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+5:17101:x1877761496087808:12345-0@lo:253:mount.lustre.0 Request processed in 13123us (14070us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773306.763871:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790773306.764048:0:17101:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17101:1877761496087808:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1790773306.764064:0:17101:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1790773306.764067:0:17101:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790773306.764069:0:17101:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790773306.764070:0:17101:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790773306.764071:0:17101:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790773306.764073:0:17101:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790773306.764074:0:17101:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790773306.764075:0:17101:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790773306.764077:0:17101:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790773306.764078:0:17101:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790773306.764080:0:17101:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1790773306.764101:0:17101:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93d14444c000 from lustre-MDT0000 10000000:01000000:1.0:1790773306.764133:0:17101:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1790773306.764136:0:17101:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1790773306.764142:0:17101:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff93d281ba99c0 10000000:01000000:1.0:1790773306.764148:0:17101:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790773306.764156:0:17101:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93d281ba99c0 from 1 10000000:01000000:1.0:1790773306.764160:0:17101:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1790773306.764240:0:17101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12bc00/0xabf1cc0bc7842a37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773306.764251:0:17101:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d27b12bc00/0xabf1cc0bc7842a37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773306.764277:0:17101:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d27b12bc00/0xabf1cc0bc7842a37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773306.764298:0:17101:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17101:1877761496087936:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790773306.764370:0:17101:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773306.764403:0:17101:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27b0d0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790773306.764529:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496087936 00000100:00100000:0.0:1790773306.764536:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496087936 00000100:00100000:0.0:1790773306.764583:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790773306.764591:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+5:17101:x1877761496087936:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790773306.764605:0:17115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773306.764630:0:17115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d25074ac00/0xabf1cc0bc7842a3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7842a37 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773306.764653:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d25074ac00/0xabf1cc0bc7842a3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7842a37 expref: 6 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773306.764664:0:17115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d25074ac00/0xabf1cc0bc7842a3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7842a37 expref: 6 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773306.764673:0:17115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074ac00, rc 0) 00000100:00100000:0.0:1790773306.764713:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+6:17101:x1877761496087936:12345-0@lo:101:mount.lustre.0 Request processed in 123us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773306.764719:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790773306.764819:0:17101:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17101:1877761496087936:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790773306.764834:0:17101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d27b12bc00/0xabf1cc0bc7842a37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842a3e expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773306.764918:0:17101:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d27b12bc00/0xabf1cc0bc7842a37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7842a3e expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773306.764973:0:17101:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17101:1877761496088064:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790773306.764999:0:17101:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773306.765064:0:17101:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27b0d0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790773306.765817:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496088064 00000100:00100000:0.0:1790773306.765847:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496088064 00000100:00100000:0.0:1790773306.765885:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790773306.765892:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+6:17101:x1877761496088064:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790773306.765988:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+6:17101:x1877761496088064:12345-0@lo:501:mount.lustre.0 Request processed in 96us (987us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790773306.765995:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790773306.766141:0:17101:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17101:1877761496088064:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1790773306.766177:0:17101:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1790773306.766195:0:17101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12bc00/0xabf1cc0bc7842a37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842a3e expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773306.766231:0:17101:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d27b12bc00/0xabf1cc0bc7842a37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842a3e expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790773306.766240:0:17101:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93d14444c000 10000000:01000000:1.0:1790773306.766246:0:17101:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1790773306.766257:0:17101:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff93d14444c000 10000000:01000000:1.0:1790773306.766260:0:17101:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1790773306.766263:0:17101:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff93d14444c000 from 1 10000000:01000000:1.0:1790773306.766265:0:17101:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1790773306.766289:0:17101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12b600/0xabf1cc0bc7842a45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773306.766298:0:17101:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d27b12b600/0xabf1cc0bc7842a45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773306.766317:0:17101:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d27b12b600/0xabf1cc0bc7842a45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773306.766331:0:17101:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17101:1877761496088192:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790773306.766361:0:17101:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773306.766387:0:17101:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27b0d0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790773306.766465:0:17116:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496088192 00000100:00100000:2.0:1790773306.766470:0:17116:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496088192 00000100:00100000:2.0:1790773306.766506:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790773306.766514:0:17116:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+6:17101:x1877761496088192:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790773306.766523:0:17116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773306.766536:0:17116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d26efc4800/0xabf1cc0bc7842a4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7842a45 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773306.766555:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d26efc4800/0xabf1cc0bc7842a4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7842a45 expref: 7 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773306.766577:0:17116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d26efc4800/0xabf1cc0bc7842a4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7842a45 expref: 7 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773306.766584:0:17116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26efc4800, rc 0) 00000100:00100000:2.0:1790773306.766629:0:17116:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+7:17101:x1877761496088192:12345-0@lo:101:mount.lustre.0 Request processed in 116us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773306.766636:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790773306.766671:0:17101:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17101:1877761496088192:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790773306.766683:0:17101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d27b12b600/0xabf1cc0bc7842a45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842a4c expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773306.766691:0:17101:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d27b12b600/0xabf1cc0bc7842a45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7842a4c expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790773306.766703:0:17101:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1790773306.766707:0:17101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12b600/0xabf1cc0bc7842a45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842a4c expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773306.766714:0:17101:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d27b12b600/0xabf1cc0bc7842a45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842a4c expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790773306.766719:0:17101:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1790773306.766723:0:17101:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790773306.766727:0:17101:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff93d14444c000 10000000:01000000:2.0:1790773306.766730:0:17101:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1790773306.766733:0:17101:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1790773306.766735:0:17101:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1790773306.766755:0:17101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26efc5a00/0xabf1cc0bc7842a53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773306.766764:0:17101:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d26efc5a00/0xabf1cc0bc7842a53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773306.766771:0:17101:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d26efc5a00/0xabf1cc0bc7842a53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773306.766783:0:17101:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17101:1877761496088320:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790773306.766808:0:17101:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773306.766825:0:17101:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279e96480 going to sleep for 11 seconds 00000100:00100000:2.0:1790773306.766848:0:17116:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496088320 00000100:00100000:2.0:1790773306.766853:0:17116:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496088320 00000100:00100000:2.0:1790773306.766869:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790773306.766875:0:17116:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+7:17101:x1877761496088320:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790773306.766882:0:17116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773306.766889:0:17116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d26efc5200/0xabf1cc0bc7842a5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7842a53 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773306.766903:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d26efc5200/0xabf1cc0bc7842a5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7842a53 expref: 8 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773306.766911:0:17116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d26efc5200/0xabf1cc0bc7842a5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7842a53 expref: 8 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773306.766917:0:17116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26efc5200, rc 0) 00000100:00100000:2.0:1790773306.766944:0:17116:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+8:17101:x1877761496088320:12345-0@lo:101:mount.lustre.0 Request processed in 68us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773306.766950:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790773306.766985:0:17101:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17101:1877761496088320:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790773306.766997:0:17101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d26efc5a00/0xabf1cc0bc7842a53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842a5a expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773306.767005:0:17101:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d26efc5a00/0xabf1cc0bc7842a53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7842a5a expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773306.767050:0:17101:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17101:1877761496088448:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790773306.767075:0:17101:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773306.767085:0:17101:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279e96480 going to sleep for 11 seconds 00000100:00100000:2.0:1790773306.767097:0:17116:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496088448 00000100:00100000:2.0:1790773306.767100:0:17116:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496088448 00000100:00100000:2.0:1790773306.767116:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790773306.767121:0:17116:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143066850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+8:17101:x1877761496088448:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790773306.767275:0:17116:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143066850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+9:17101:x1877761496088448:12345-0@lo:501:mount.lustre.0 Request processed in 152us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773306.767282:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790773306.767313:0:17101:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17101:1877761496088448:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790773306.767339:0:17101:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17101:1877761496088576:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790773306.767379:0:17101:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773306.767397:0:17101:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26c742840 going to sleep for 11 seconds 00000100:00100000:2.0:1790773306.767409:0:17116:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496088576 00000100:00100000:2.0:1790773306.767413:0:17116:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496088576 00000100:00100000:2.0:1790773306.767431:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790773306.767436:0:17116:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143067050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+9:17101:x1877761496088576:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790773306.768420:0:17116:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143067050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+9:17101:x1877761496088576:12345-0@lo:503:mount.lustre.0 Request processed in 977us (1034us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773306.768437:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790773306.768534:0:17101:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17101:1877761496088576:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790773306.769036:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144545500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17140:1877761496088704:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790773306.769084:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773306.769123:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279eda240 going to sleep for 11 seconds 00000100:00100000:1.0:1790773306.769182:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496088704 00000100:00100000:1.0:1790773306.769188:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496088704 00000100:00100000:1.0:1790773306.769257:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790773306.769265:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143067450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+9:17140:x1877761496088704:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790773306.769930:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143067450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+9:17140:x1877761496088704:12345-0@lo:502:llog_process_th.0 Request processed in 665us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773306.769939:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790773306.770092:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144545500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17140:1877761496088704:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790773306.770120:0:17140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790773306.770133:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773306.770135:0:17140:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1790773306.770141:0:17140:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1790773306.770144:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790773306.770161:0:17140:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff93d281ba8000) 00000020:00000080:3.0:1790773306.770179:0:17140:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1790773306.770185:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1790773306.770291:0:17140:0:(osd_handler.c:8931:osd_obd_connect()) connect #2 00000020:00000080:3.0:1790773306.770299:0:17140:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xabf1cc0bc7842a68 00000020:00000080:3.0:1790773306.770541:0:17140:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1790773306.770546:0:17140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790773306.770549:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773306.770551:0:17140:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1790773306.770555:0:17140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790773306.770559:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773306.770560:0:17140:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1790773306.770564:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790773306.770571:0:17140:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff93d281bacd40) 00000020:00000080:3.0:1790773306.770582:0:17140:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1790773306.770585:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1790773306.770587:0:17140:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1790773306.770590:0:17140:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1790773306.770595:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1790773306.770652:0:17140:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93d14444c000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1790773306.770665:0:17140:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff93d281bab380) 00000020:00000080:3.0:1790773306.770673:0:17140:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1790773306.770736:0:17140:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1790773306.770741:0:17140:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xabf1cc0bc7842a7d 00000020:00000080:3.0:1790773306.770835:0:17140:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1790773306.770856:0:17140:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1790773306.770860:0:17140:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xabf1cc0bc7842a84 00080000:01000000:3.0:1790773306.770866:0:17140:0:(osd_handler.c:8931:osd_obd_connect()) connect #3 00000020:00000080:3.0:1790773306.770870:0:17140:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xabf1cc0bc7842a8b 00010000:00010000:0.0:1790773306.868069:0:17140:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1790773306.868829:0:17140:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:0.0:1790773306.869111:0:17140:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1790773306.869848:0:17140:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff93d141d819c0) 00000020:00000080:0.0:1790773306.869868:0:17140:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1790773306.869942:0:17140:0:(osd_handler.c:8931:osd_obd_connect()) connect #4 00000020:00000080:0.0:1790773306.869949:0:17140:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xabf1cc0bc7842a99 00000020:00000080:2.0:1790773306.870671:0:17140:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1790773306.873843:0:17140:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xabf1cc0bc7842aa0 00000020:00000080:2.0:1790773306.880888:0:17140:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1790773306.880905:0:17140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790773306.880914:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773306.880916:0:17140:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1790773306.880921:0:17140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1790773306.880938:0:17140:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1790773306.880939:0:17140:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790773306.880941:0:17140:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790773306.880943:0:17140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1790773306.880946:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773306.880947:0:17140:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1790773306.880950:0:17140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790773306.880969:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773306.880971:0:17140:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1790773306.880978:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1790773306.881051:0:17140:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1790773306.881076:0:17140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790773306.881079:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773306.881081:0:17140:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1790773306.881084:0:17140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790773306.881088:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773306.881089:0:17140:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1790773306.881091:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790773306.881112:0:17140:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.119@tcp to nid 0x20000c0a8ca77 (192.168.202.119@tcp) 00000020:00000080:2.0:1790773306.881169:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790773306.881252:0:17140:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff93d142738000) 00000020:00000080:2.0:1790773306.881333:0:17140:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1790773306.881341:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790773306.881468:0:17140:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1790773306.881475:0:17140:0:(osd_handler.c:8931:osd_obd_connect()) connect #5 00000020:00000080:2.0:1790773306.881483:0:17140:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xabf1cc0bc7842aae 00010000:00080000:2.0:1790773306.881520:0:17140:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d251285800@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.119@tcp at head 00010000:00010000:2.0:1790773306.883605:0:17140:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:0.0:1790773306.888107:0:17140:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790773306.888125:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1790773306.888171:0:17140:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1790773306.888301:0:17140:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xabf1cc0bc7842ab5 00000100:00080000:0.0:1790773306.888326:0:17140:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790773306.888337:0:17140:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff93d251285800 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:0.0:1790773306.888402:0:17140:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d143cc5500 x1877761496088832/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790773306.888452:0:17140:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1790773306.888529:0:17140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790773306.888534:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773306.888536:0:17140:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1790773306.888539:0:17140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1790773306.888541:0:17140:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1790773306.888543:0:17140:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790773306.888545:0:17140:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790773306.888554:0:17140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1790773306.888556:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773306.888558:0:17140:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1790773306.888560:0:17140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790773306.888565:0:17140:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1790773306.888569:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773306.888570:0:17140:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1790773306.888573:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1790773306.888576:0:17140:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.119@tcp to nid 0x20000c0a8ca77 (192.168.202.119@tcp) 00000020:01000000:0.0:1790773306.888628:0:17140:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1790773306.888631:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790773306.888646:0:17140:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff93d141d80000) 00000020:00000080:0.0:1790773306.888663:0:17140:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1790773306.888668:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1790773306.888727:0:17140:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1790773306.888733:0:17140:0:(osd_handler.c:8931:osd_obd_connect()) connect #6 00000020:00000080:0.0:1790773306.888738:0:17140:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xabf1cc0bc7842ac3 00010000:00080000:0.0:1790773306.888784:0:17140:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d251282000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.119@tcp at head 00010000:00010000:0.0:1790773306.889045:0:17140:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:3.0:1790773306.889646:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496088832:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790773306.889730:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:2.0:1790773306.890536:0:17140:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1790773306.890824:0:17140:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1790773306.892791:0:17140:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790773306.893010:0:17140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000100:00100000:0.0:1790773306.895483:0:17127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496088832 00000100:00100000:0.0:1790773306.895500:0:17127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496088832 00000100:00100000:0.0:1790773306.895543:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790773306.895553:0:17127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144545500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3603:x1877761496088832:12345-0@lo:38:llog_process_th.0 00010000:00020000:0.0:1790773306.895573:0:17127:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:00080000:2.0:1790773306.901793:0:17140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1790773306.903449:0:17146:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1790773306.903456:0:17146:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00100000:0.0:1790773306.907792:0:17127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144545500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3603:x1877761496088832:12345-0@lo:38:llog_process_th.0 Request processed in 12229us (18052us total) trans 0 rc -19/-19 00000100:00100000:0.0:1790773306.907808:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:00000080:2.0:1790773306.908492:0:17140:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790773306.908507:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1790773306.908557:0:17140:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1790773306.908578:0:17140:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xabf1cc0bc7842aca 00000100:00080000:2.0:1790773306.908586:0:17140:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790773306.908598:0:17140:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93d251282000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:2.0:1790773306.908655:0:17140:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d27f9f7100 x1877761496088960/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790773306.908672:0:17140:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1790773306.909126:0:17140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790773306.909131:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773306.909133:0:17140:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1790773306.909137:0:17140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1790773306.909140:0:17140:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:2.0:1790773306.909142:0:17140:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790773306.909144:0:17140:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790773306.909145:0:17140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1790773306.909148:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773306.909149:0:17140:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:2.0:1790773306.909164:0:17140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790773306.909168:0:17140:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1790773306.909172:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773306.909173:0:17140:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1790773306.909176:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790773306.909179:0:17140:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.119@tcp to nid 0x20000c0a8ca77 (192.168.202.119@tcp) 00000020:01000000:2.0:1790773306.909202:0:17140:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1790773306.909236:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790773306.909250:0:17140:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff93d14273cd40) 00000020:00000080:2.0:1790773306.909265:0:17140:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1790773306.909271:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790773306.909347:0:17140:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1790773306.909354:0:17140:0:(osd_handler.c:8931:osd_obd_connect()) connect #7 00000020:00000080:2.0:1790773306.909361:0:17140:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xabf1cc0bc7842ad8 00010000:00080000:2.0:1790773306.909389:0:17140:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d143276000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.119@tcp at head 00010000:00010000:2.0:1790773306.909618:0:17140:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1790773306.909693:0:17140:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1790773306.909708:0:17140:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1790773306.912606:0:17140:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:3.0:1790773306.913104:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d251285800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790773306.913115:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790773306.913120:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496088832:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790773306.913155:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496088960:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1790773306.913226:0:3603:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877761496088960 offset 0 length 520: 4 00000040:00080000:2.0:1790773306.914078:0:17140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1790773306.914432:0:17140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1790773306.915063:0:17148:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1790773306.915070:0:17148:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1790773306.916016:0:17140:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790773306.916030:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1790773306.916069:0:17140:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1790773306.916091:0:17140:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xabf1cc0bc7842adf 00000100:00080000:2.0:1790773306.916101:0:17140:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790773306.916113:0:17140:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93d143276000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:2.0:1790773306.916153:0:17140:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d27f9f7b80 x1877761496089088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790773306.916248:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496089088:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1790773306.916654:0:3603:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877761496089088 offset 0 length 520: 4 00000100:00080000:2.0:1790773306.916750:0:17140:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1790773306.916982:0:17140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790773306.916990:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773306.916991:0:17140:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1790773306.916996:0:17140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790773306.917000:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773306.917001:0:17140:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790773306.917004:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790773306.917006:0:17140:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1790773306.917009:0:17140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790773306.917011:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773306.917013:0:17140:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:2.0:1790773306.917015:0:17140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790773306.917018:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773306.917019:0:17140:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1790773306.917022:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1790773306.917058:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17140:1877761496089216:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790773306.917114:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773306.917139:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d25318f180 going to sleep for 11 seconds 00000100:00100000:2.0:1790773306.917160:0:17116:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496089216 00000100:00100000:2.0:1790773306.917166:0:17116:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496089216 00000100:00100000:2.0:1790773306.917237:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790773306.917247:0:17116:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143065450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+9:17140:x1877761496089216:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790773306.917378:0:17116:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143065450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+9:17140:x1877761496089216:12345-0@lo:502:llog_process_th.0 Request processed in 132us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773306.917386:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790773306.917451:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17140:1877761496089216:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790773306.917474:0:17140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790773306.917479:0:17140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773306.917481:0:17140:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1790773306.917484:0:17140:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1790773306.917621:0:17101:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1790773306.917643:0:17101:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1790773306.917657:0:17101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26efc5a00/0xabf1cc0bc7842a53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842a5a expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773306.917670:0:17101:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d26efc5a00/0xabf1cc0bc7842a53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842a5a expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790773306.917679:0:17101:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93d14444c000 from 1 10000000:01000000:2.0:1790773306.917682:0:17101:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790773306.917710:0:17101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26efc4c00/0xabf1cc0bc7842ae6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773306.917718:0:17101:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d26efc4c00/0xabf1cc0bc7842ae6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773306.917729:0:17101:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d26efc4c00/0xabf1cc0bc7842ae6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773306.917742:0:17101:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17101:1877761496089344:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790773306.917771:0:17101:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773306.917789:0:17101:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d244d21540 going to sleep for 11 seconds 00000100:00100000:0.0:1790773306.917865:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496089344 00000100:00100000:0.0:1790773306.917876:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496089344 00000100:00100000:0.0:1790773306.917907:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790773306.917914:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143067850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+9:17101:x1877761496089344:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790773306.917924:0:17115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773306.917937:0:17115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d25074aa00/0xabf1cc0bc7842aed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7842ae6 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773306.917960:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d25074aa00/0xabf1cc0bc7842aed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7842ae6 expref: 10 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773306.917971:0:17115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d25074aa00/0xabf1cc0bc7842aed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7842ae6 expref: 10 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773306.917981:0:17115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074aa00, rc 0) 00000100:00100000:0.0:1790773306.918009:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143067850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+10:17101:x1877761496089344:12345-0@lo:101:mount.lustre.0 Request processed in 95us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773306.918016:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790773306.918416:0:17101:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17101:1877761496089344:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790773306.918431:0:17101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d26efc4c00/0xabf1cc0bc7842ae6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842aed expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773306.918440:0:17101:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d26efc4c00/0xabf1cc0bc7842ae6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7842aed expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773306.919379:0:17101:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17101:1877761496089472:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1790773306.919465:0:17101:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773306.919540:0:17101:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d244d21540 going to sleep for 11 seconds 00000100:00100000:0.0:1790773306.919694:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496089472 00000100:00100000:0.0:1790773306.919701:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496089472 00000100:00100000:0.0:1790773306.919774:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790773306.919784:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143064850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+10:17101:x1877761496089472:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1790773306.919803:0:17115:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1790773306.919809:0:17115:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1790773306.919971:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143064850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+10:17101:x1877761496089472:12345-0@lo:256:mount.lustre.0 Request processed in 188us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773306.919979:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790773306.920048:0:17101:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17101:1877761496089472:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1790773306.920680:0:17101:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790773306.920702:0:17101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26efc4c00/0xabf1cc0bc7842ae6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842aed expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773306.920716:0:17101:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d26efc4c00/0xabf1cc0bc7842ae6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842aed expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790773306.920725:0:17101:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d14444c000 from 1 10000000:01000000:2.0:1790773306.920728:0:17101:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790773306.920762:0:17101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26efc5000/0xabf1cc0bc7842af4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773306.920770:0:17101:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d26efc5000/0xabf1cc0bc7842af4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773306.920780:0:17101:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d26efc5000/0xabf1cc0bc7842af4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773306.920799:0:17101:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17101:1877761496089600:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790773306.920854:0:17101:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773306.921262:0:17101:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d244d21540 going to sleep for 11 seconds 00000100:00100000:1.0:1790773306.921410:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496089600 00000100:00100000:1.0:1790773306.921418:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496089600 00000100:00100000:1.0:1790773306.921452:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790773306.921461:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143067c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+10:17101:x1877761496089600:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790773306.921473:0:17117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773306.921488:0:17117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d27b12a200/0xabf1cc0bc7842afb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7842af4 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773306.921524:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d27b12a200/0xabf1cc0bc7842afb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7842af4 expref: 11 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773306.921535:0:17117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d27b12a200/0xabf1cc0bc7842afb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7842af4 expref: 11 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773306.921543:0:17117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12a200, rc 0) 00000100:00100000:1.0:1790773306.921589:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143067c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+11:17101:x1877761496089600:12345-0@lo:101:mount.lustre.0 Request processed in 129us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773306.921597:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790773306.921685:0:17101:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17101:1877761496089600:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790773306.921700:0:17101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d26efc5000/0xabf1cc0bc7842af4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842afb expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773306.921720:0:17101:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d26efc5000/0xabf1cc0bc7842af4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7842afb expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773306.921785:0:17101:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17101:1877761496089728:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790773306.921816:0:17101:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773306.921909:0:17101:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d244d21540 going to sleep for 11 seconds 00000100:00100000:1.0:1790773306.922146:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496089728 00000100:00100000:1.0:1790773306.922151:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496089728 00000100:00100000:1.0:1790773306.922171:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790773306.922177:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143064050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+11:17101:x1877761496089728:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790773306.922414:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143064050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+11:17101:x1877761496089728:12345-0@lo:501:mount.lustre.0 Request processed in 236us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773306.922422:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790773306.922515:0:17101:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17101:1877761496089728:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790773306.922547:0:17101:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17101:1877761496089856:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790773306.922592:0:17101:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773306.922634:0:17101:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d244d21540 going to sleep for 11 seconds 00000100:00100000:1.0:1790773306.922703:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496089856 00000100:00100000:1.0:1790773306.922707:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496089856 00000100:00100000:1.0:1790773306.922727:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790773306.922734:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143064450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+11:17101:x1877761496089856:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790773306.922819:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143064450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+11:17101:x1877761496089856:12345-0@lo:503:mount.lustre.0 Request processed in 86us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773306.922826:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790773306.922974:0:17101:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17101:1877761496089856:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790773306.923601:0:17150:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17150:1877761496089984:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790773306.923675:0:17150:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773306.923737:0:17150:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d244d219c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790773306.924086:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496089984 00000100:00100000:0.0:1790773306.924094:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496089984 00000100:00100000:1.0:1790773306.924149:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790773306.924159:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143065050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+11:17150:x1877761496089984:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790773306.924788:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143065050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+11:17150:x1877761496089984:12345-0@lo:502:llog_process_th.0 Request processed in 629us (1112us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773306.924797:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790773306.925073:0:17150:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17150:1877761496089984:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790773306.925119:0:17150:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790773306.925129:0:17150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773306.925132:0:17150:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1790773306.925140:0:17150:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93d14444c000 00000020:00000080:2.0:1790773306.925143:0:17150:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790773306.925151:0:17150:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790773306.925154:0:17150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773306.925155:0:17150:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1790773306.925158:0:17150:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790773306.925160:0:17150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773306.925168:0:17150:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1790773306.925174:0:17150:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93d14444c000 00000020:00000080:2.0:1790773306.925176:0:17150:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790773306.927014:0:17150:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790773306.927028:0:17150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773306.927030:0:17150:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1790773306.927035:0:17150:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790773306.927040:0:17150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773306.927041:0:17150:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790773306.927046:0:17150:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93d14444c000 00000020:00000080:2.0:1790773306.927048:0:17150:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790773306.930598:0:17150:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790773306.930943:0:17150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773306.930946:0:17150:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790773306.930952:0:17150:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790773306.930958:0:17150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773306.930959:0:17150:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1790773306.930965:0:17150:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93d14444c000 00000020:00000080:3.0:1790773306.930967:0:17150:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790773306.931062:0:17150:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144544380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17150:1877761496090112:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790773306.931159:0:17150:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773306.931245:0:17150:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279eda6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790773306.931512:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496090112 00000100:00100000:0.0:1790773306.931530:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496090112 00000100:00100000:0.0:1790773306.931599:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790773306.931628:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143065c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+11:17150:x1877761496090112:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790773306.931797:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143065c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+11:17150:x1877761496090112:12345-0@lo:502:llog_process_th.0 Request processed in 189us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773306.931806:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790773306.931951:0:17150:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144544380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17150:1877761496090112:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790773306.931978:0:17150:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790773306.931984:0:17150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773306.931986:0:17150:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1790773306.931993:0:17150:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1790773306.932488:0:17101:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1790773306.932510:0:17101:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790773306.932524:0:17101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26efc5000/0xabf1cc0bc7842af4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842afb expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773306.932536:0:17101:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d26efc5000/0xabf1cc0bc7842af4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842afb expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773306.932589:0:17101:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790773306.932592:0:17101:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93d14444c000 10000000:01000000:3.0:1790773306.932595:0:17101:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93d14444c000 10000000:01000000:3.0:1790773306.932600:0:17101:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790773306.932606:0:17101:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93d14444c000 from 1 10000000:01000000:3.0:1790773306.932620:0:17101:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790773306.932655:0:17101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d1434ade00/0xabf1cc0bc7842b02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773306.932664:0:17101:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d1434ade00/0xabf1cc0bc7842b02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773306.932674:0:17101:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d1434ade00/0xabf1cc0bc7842b02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773306.932693:0:17101:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144547800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17101:1877761496090240:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790773306.932738:0:17101:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773306.932814:0:17101:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279edad80 going to sleep for 11 seconds 00000100:00100000:2.0:1790773306.934338:0:17116:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496090240 00000100:00100000:2.0:1790773306.934355:0:17116:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496090240 00000100:00100000:2.0:1790773306.934415:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790773306.934426:0:17116:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143066450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+11:17101:x1877761496090240:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790773306.934446:0:17116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773306.934465:0:17116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d26efc4e00/0xabf1cc0bc7842b09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7842b02 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773306.934497:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d26efc4e00/0xabf1cc0bc7842b09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7842b02 expref: 12 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773306.934509:0:17116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d26efc4e00/0xabf1cc0bc7842b09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7842b02 expref: 12 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773306.934531:0:17116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26efc4e00, rc 0) 00000100:00100000:2.0:1790773306.934627:0:17116:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143066450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+12:17101:x1877761496090240:12345-0@lo:101:mount.lustre.0 Request processed in 202us (1886us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773306.934634:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790773306.936549:0:17101:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144547800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17101:1877761496090240:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790773306.936583:0:17101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d1434ade00/0xabf1cc0bc7842b02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842b09 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773306.936595:0:17101:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d1434ade00/0xabf1cc0bc7842b02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7842b09 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773306.936694:0:17101:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17101:1877761496090368:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790773306.936763:0:17101:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773306.936818:0:17101:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d244d213c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790773306.936961:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496090368 00000100:00100000:3.0:1790773306.936969:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496090368 00000100:00100000:3.0:1790773306.937020:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790773306.937031:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143066c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+12:17101:x1877761496090368:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790773306.937188:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143066c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+12:17101:x1877761496090368:12345-0@lo:501:mount.lustre.0 Request processed in 158us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773306.937197:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790773306.937483:0:17101:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17101:1877761496090368:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790773306.937519:0:17101:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17101:1877761496090496:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790773306.937563:0:17101:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773306.937584:0:17101:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d244d213c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790773306.937598:0:17116:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496090496 00000100:00100000:2.0:1790773306.937602:0:17116:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496090496 00000100:00100000:2.0:1790773306.937638:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790773306.937644:0:17116:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143065850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+13:17101:x1877761496090496:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790773306.937729:0:17116:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143065850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+13:17101:x1877761496090496:12345-0@lo:503:mount.lustre.0 Request processed in 83us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773306.937745:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790773306.937796:0:17101:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17101:1877761496090496:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790773306.939106:0:17152:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17152:1877761496090624:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790773306.939178:0:17152:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773306.939483:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496090624 00000100:00100000:0.0:1790773306.939491:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496090624 00000100:00100000:0.0:1790773306.939537:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790773306.939546:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d255216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+12:17152:x1877761496090624:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790773306.939678:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d255216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+12:17152:x1877761496090624:12345-0@lo:502:llog_process_th.0 Request processed in 132us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773306.939685:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790773306.940559:0:17152:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d244d216c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790773306.940597:0:17152:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17152:1877761496090624:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1790773306.940688:0:17152:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1790773306.940707:0:17152:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff93d14273b380) 00000020:00000080:2.0:1790773306.940730:0:17152:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1790773306.942041:0:17152:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93d14444c000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1790773306.942053:0:17152:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93d14444c000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1790773306.942057:0:17152:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93d14444c000 4 00010000:00080000:2.0:1790773306.942123:0:17152:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d26c380000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.119@tcp at head 00010000:00010000:2.0:1790773306.953711:0:17152:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1790773306.953962:0:17152:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1790773306.954010:0:17152:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790773306.954023:0:17152:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xabf1cc0bc7842b17 00000100:00080000:2.0:1790773306.954036:0:17152:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790773306.954048:0:17152:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff93d26c380000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:2.0:1790773306.954083:0:17152:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d27f9f6a00 x1877761496090752/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790773306.954107:0:17152:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1790773306.955498:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3603:1877761496090752:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790773306.955590:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773306.957484:0:17122:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496090752 00000100:00100000:3.0:1790773306.957499:0:17122:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496090752 00000100:00100000:3.0:1790773306.957543:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790773306.957552:0:17122:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3603:x1877761496090752:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790773306.957677:0:17122:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3603:x1877761496090752:12345-0@lo:38:llog_process_th.0 Request processed in 124us (2086us total) trans 0 rc -11/-11 00000100:00100000:3.0:1790773306.957685:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790773306.957741:0:3603:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790773306.957751:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d26c380000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790773306.957755:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1790773306.957760:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3603:1877761496090752:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790773306.960600:0:17152:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17152:1877761496090880:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790773306.960740:0:17152:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773306.960775:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496090880 00000100:00100000:2.0:1790773306.960783:0:17152:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27b2d0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790773306.960784:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496090880 00000100:00100000:0.0:1790773306.960825:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790773306.960834:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d255214850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+12:17152:x1877761496090880:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790773306.961104:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d255214850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+12:17152:x1877761496090880:12345-0@lo:502:llog_process_th.0 Request processed in 269us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773306.961112:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790773306.962530:0:17152:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17152:1877761496090880:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790773306.962624:0:17152:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17152:1877761496091008:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790773306.962690:0:17152:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773306.962778:0:17152:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27b2d0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790773306.962824:0:17116:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496091008 00000100:00100000:0.0:1790773306.962833:0:17116:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496091008 00000100:00100000:0.0:1790773306.962941:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790773306.962950:0:17116:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+12:17152:x1877761496091008:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790773306.963113:0:17116:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+12:17152:x1877761496091008:12345-0@lo:502:llog_process_th.0 Request processed in 163us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773306.963131:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790773306.963465:0:17152:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17152:1877761496091008:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1790773306.963495:0:17152:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1790773306.963572:0:17101:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1790773306.963592:0:17101:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790773306.963657:0:17101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d1434ade00/0xabf1cc0bc7842b02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842b09 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773306.963669:0:17101:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d1434ade00/0xabf1cc0bc7842b02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842b09 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790773306.963724:0:17101:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790773306.963727:0:17101:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790773306.963728:0:17101:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790773306.963730:0:17101:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790773306.963731:0:17101:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790773306.963732:0:17101:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790773306.963734:0:17101:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790773306.963736:0:17101:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790773306.963739:0:17101:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790773306.963740:0:17101:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790773306.963746:0:17101:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1790773306.963749:0:17101:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790773306.963750:0:17101:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790773306.963751:0:17101:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790773306.963757:0:17101:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790773306.963758:0:17101:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790773306.963759:0:17101:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790773306.963760:0:17101:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790773306.963761:0:17101:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790773306.963762:0:17101:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790773306.963762:0:17101:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790773306.963781:0:17101:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1790773306.963793:0:17101:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17101:1877761496091136:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790773306.963835:0:17101:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773306.963871:0:17101:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27b2d0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790773306.964065:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496091136 00000100:00100000:0.0:1790773306.964073:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496091136 00000100:00100000:0.0:1790773306.964105:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790773306.964113:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+12:17101:x1877761496091136:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790773306.964137:0:17115:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1790773306.964155:0:17115:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1790773306.969405:0:17115:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790773306.969421:0:17115:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1790773306.969519:0:17138:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1790773306.969524:0:17138:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1790773306.969547:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93d27b12a000/0xabf1cc0bc7842b1e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773306.969567:0:17138:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d25074aa00/0xabf1cc0bc7842aed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7842ae6 expref: 12 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773306.969577:0:17138:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93d27b12a000/0xabf1cc0bc7842b1e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773306.969649:0:17138:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d25074aa00/0xabf1cc0bc7842aed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc7842ae6 expref: 12 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773306.969666:0:17138:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d25074aa00/0xabf1cc0bc7842aed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc7842ae6 expref: 12 pid: 17115 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773306.969683:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cf480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17138:1877761496091264:0@lo:104: 00000100:00100000:1.0:1790773306.969760:0:17138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773306.969802:0:17138:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2465e59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790773306.969841:0:17105:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496091264 00000100:00100000:1.0:1790773306.969849:0:17105:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496091264 00000100:00100000:1.0:1790773306.969945:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790773306.969956:0:17105:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+3:17138:x1877761496091264:12345-0@lo:104: 00010000:00010000:1.0:1790773306.969970:0:17105:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d26efc4c00/0xabf1cc0bc7842ae6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7842aed expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773306.970027:0:17105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790773306.970034:0:17105:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+3:17138:x1877761496091264:12345-0@lo:104: Request processed in 81us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773306.970042:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1790773306.970887:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790773306.970898:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d26efc4c00/0xabf1cc0bc7842ae6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7842aed expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773306.970908:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc4c00 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:1.0:1790773306.970913:0:17111:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d26efc4c00/0xabf1cc0bc7842ae6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc7842aed expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773306.970923:0:17111:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d26efc4c00/0xabf1cc0bc7842ae6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc7842aed expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790773306.970930:0:17111:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d26efc4c00/0xabf1cc0bc7842ae6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc7842aed expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790773306.970936:0:17111:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790773306.970984:0:17111:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d26efc4c00/0xabf1cc0bc7842ae6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7842aed expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773306.970991:0:17111:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790773306.971012:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d26efc4c00/0xabf1cc0bc7842ae6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7842aed expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773306.971020:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d26efc4c00/0xabf1cc0bc7842ae6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7842aed expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773306.971046:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773306.971048:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773306.971050:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773306.971086:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3606:1877761496091392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790773306.971230:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773306.971314:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cf480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17138:1877761496091264:0@lo:104: 00010000:00010000:1.0:1790773306.971334:0:17138:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93d27b12a000/0xabf1cc0bc7842b1e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773306.971401:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+12:17101:x1877761496091136:12345-0@lo:253:mount.lustre.0 Request processed in 7288us (7564us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773306.971410:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790773306.972628:0:17107:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496091392 00000100:00100000:1.0:1790773306.972644:0:17107:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496091392 00010000:00010000:1.0:1790773306.972679:0:17107:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d25074aa00/0xabf1cc0bc7842aed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7842ae6 expref: 12 pid: 17115 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773306.972713:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790773306.972722:0:17107:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+12:3606:x1877761496091392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790773306.972736:0:17107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790773306.972741:0:17107:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d25074aa00/0xabf1cc0bc7842aed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7842ae6 expref: 12 pid: 17115 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773306.972753:0:17107:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d25074aa00/0xabf1cc0bc7842aed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc7842ae6 expref: 12 pid: 17115 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773306.972772:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d25074aa00/0xabf1cc0bc7842aed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc7842ae6 expref: 12 pid: 17115 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773306.972794:0:17107:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93d27b12a000/0xabf1cc0bc7842b1e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773306.972802:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d27b12a000/0xabf1cc0bc7842b1e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790773306.972818:0:17107:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003294386s 00010000:00010000:1.0:1790773306.972822:0:17107:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d27b12a000/0xabf1cc0bc7842b1e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773306.972829:0:17107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d27b12a000/0xabf1cc0bc7842b1e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773306.972837:0:17107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93d27b12a000/0xabf1cc0bc7842b1e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773306.972844:0:17107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93d27b12a000/0xabf1cc0bc7842b1e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773306.972850:0:17107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12a000 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:1.0:1790773306.972854:0:17107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93d27b12a000/0xabf1cc0bc7842b1e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773306.972863:0:17107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93d27b12a000/0xabf1cc0bc7842b1e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773306.972879:0:17107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93d27b12a000/0xabf1cc0bc7842b1e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773306.972888:0:17107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790773306.972950:0:17107:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+11:3606:x1877761496091392:12345-0@lo:103:ldlm_bl.0 Request processed in 228us (1719us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773306.972957:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790773306.972998:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3606:1877761496091392:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790773306.973023:0:17138:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93d27b12a000/0xabf1cc0bc7842b1e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773306.973031:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93d27b12a000/0xabf1cc0bc7842b1e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773306.973037:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d27b12a000/0xabf1cc0bc7842b1e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773306.973736:0:17101:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17101:1877761496091136:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790773306.973754:0:17101:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1790773306.973757:0:17101:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790773306.973759:0:17101:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790773306.973760:0:17101:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790773306.973762:0:17101:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790773306.973763:0:17101:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790773306.973764:0:17101:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790773306.973765:0:17101:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790773306.973767:0:17101:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790773306.973770:0:17101:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790773306.973771:0:17101:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790773306.973786:0:17101:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:3.0:1790773306.989954:0:17101:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1790773306.990477:0:17101:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1790773306.990731:0:17163:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1790773306.990977:0:17101:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:1.0:1790773306.991336:0:17164:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff93d2526cf800 x1877761496091520/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773306.991350:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2465e56c0 going to sleep for 0 seconds 00000040:01000000:3.0:1790773306.991798:0:17101:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1790773306.992062:0:17101:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1790773306.992496:0:17101:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1790773306.992506:0:17101:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1790773306.992562:0:17101:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790773306.993305:0:17163:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:0.0:1790773306.994622:0:17162:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1790773306.994632:0:17162:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:3.0:1790773306.995963:0:17101:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1790773306.996659:0:17101:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1790773306.996698:0:17101:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1790773306.998261:0:17163:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1790773306.998956:0:17163:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00080000:10000000:1.0:1790773307.002064:0:17101:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:1.0:1790773307.003801:0:17101:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1790773307.005384:0:17101:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1790773307.005421:0:17101:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb21f018bf988 00100000:10000000:1.0:1790773307.005431:0:17101:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1790773307.005953:0:17101:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790773307.005971:0:17101:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.119@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790773307.005994:0:17101:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=45 00000080:00000004:3.0:1790773307.006025:0:17101:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1790773307.012568:0:17101:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790773307.012814:0:17101:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1790773307.597739:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790773307.984858:0:17158:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1790773308.045552:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2465e56c0 going to sleep for 0 seconds 10000000:01000000:1.0:1790773308.301358:0:17120:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790773308.301365:0:17120:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93d14444c000 from 7 10000000:01000000:1.0:1790773308.301369:0:17120:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790773308.301423:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12b800/0xabf1cc0bc7842b25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773308.301436:0:17120:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d27b12b800/0xabf1cc0bc7842b25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773308.301447:0:17120:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d27b12b800/0xabf1cc0bc7842b25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773308.301474:0:17120:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496091648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790773308.301547:0:17120:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773308.301602:0:17120:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d243301240 going to sleep for 11 seconds 00000100:00100000:0.0:1790773308.301779:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496091648 00000100:00100000:0.0:1790773308.301788:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496091648 00000100:00100000:0.0:1790773308.301847:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790773308.301856:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+11:17120:x1877761496091648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790773308.301871:0:17117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773308.301885:0:17117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d25074b800/0xabf1cc0bc7842b2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7842b25 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773308.301907:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d25074b800/0xabf1cc0bc7842b2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7842b25 expref: 12 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773308.301918:0:17117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d25074b800/0xabf1cc0bc7842b2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7842b25 expref: 12 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773308.301928:0:17117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074b800, rc 0) 00000100:00100000:0.0:1790773308.301981:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+12:17120:x1877761496091648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773308.301998:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790773308.302101:0:17120:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496091648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790773308.302117:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d27b12b800/0xabf1cc0bc7842b25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842b2c expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773308.302126:0:17120:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d27b12b800/0xabf1cc0bc7842b25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7842b2c expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773308.302178:0:17120:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496091776:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1790773308.302261:0:17120:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773308.302282:0:17120:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27b2d0540 going to sleep for 11 seconds 00000100:00100000:0.0:1790773308.302438:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496091776 00000100:00100000:0.0:1790773308.302444:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496091776 00000100:00100000:0.0:1790773308.302480:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790773308.302487:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+12:17120:x1877761496091776:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1790773308.302502:0:17115:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790773308.302519:0:17115:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790773308.302522:0:17115:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1790773308.302617:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+12:17120:x1877761496091776:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 129us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773308.302625:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790773308.302929:0:17120:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496091776:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1790773308.302974:0:17120:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790773308.302982:0:17120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12b800/0xabf1cc0bc7842b25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842b2c expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773308.302991:0:17120:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d27b12b800/0xabf1cc0bc7842b25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842b2c expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773308.621462:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790773309.008999:0:17158:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1790773309.072271:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2465e56c0 going to sleep for 0 seconds 00010000:00010000:0.0:1790773309.650127:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773310.098437:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2465e56c0 going to sleep for 0 seconds 00010000:00010000:3.0:1790773310.670427:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773311.117418:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2465e56c0 going to sleep for 0 seconds 00010000:00010000:3.0:1790773311.700744:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790773311.864734:0:17406:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg219-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1790773312.144375:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2465e56c0 going to sleep for 0 seconds 00000100:00080000:1.0:1790773312.337111:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1790773312.337117:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1790773312.337120:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d251285800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790773312.337128:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 449 00000100:00080000:1.0:1790773312.337134:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1790773312.337144:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff93d251285800 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:1.0:1790773312.337166:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d2526cc380 x1877761496092032/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790773312.337180:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790773312.337184:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790773312.337186:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790773312.337200:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790773312.337222:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1790773312.337225:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1790773312.337227:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d26c380000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790773312.337235:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff93d26c380000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:1.0:1790773312.337249:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d2526cce00 x1877761496092160/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790773312.337307:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790773312.337324:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3606:1877761496091904:0@lo:400:kworker.0 00000100:00100000:2.0:1790773312.337402:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773312.337497:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496091904 00000100:00100000:1.0:1790773312.337505:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496091904 00000100:00100000:1.0:1790773312.337563:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790773312.337574:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+12:3606:x1877761496091904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773312.337644:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+12:3606:x1877761496091904:12345-0@lo:400:kworker.0 Request processed in 71us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773312.337652:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790773312.337701:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3606:1877761496091904:0@lo:400:kworker.0 00000100:00100000:3.0:1790773312.338051:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496092032:0@lo:38:kworker.0 00000100:00100000:3.0:1790773312.338128:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773312.338159:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3603:1877761496092160:0@lo:38:kworker.0 00000100:00100000:3.0:1790773312.338185:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773312.338329:0:17124:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496092160 00000100:00100000:2.0:1790773312.338334:0:17124:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496092160 00000100:00100000:2.0:1790773312.338362:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790773312.338367:0:17124:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144546680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3603:x1877761496092160:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1790773312.338392:0:17124:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 455 last 0 00000020:00000080:2.0:1790773312.338434:0:17124:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xabf1cc0bc7842b33 00000004:00100000:2.0:1790773312.338450:0:17124:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790773312.338602:0:17124:0:(import.c:65:import_set_state_nolock()) ffff93d26c387000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790773312.338647:0:17124:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144546680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3603:x1877761496092160:12345-0@lo:38:kworker.0 Request processed in 277us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773312.338655:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790773312.338794:0:17128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496092032 00000100:00100000:0.0:1790773312.338798:0:17128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496092032 00000100:00100000:0.0:1790773312.338826:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790773312.338831:0:17128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144545880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3603:x1877761496092032:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1790773312.338842:0:17128:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:3.0:1790773312.342994:0:3603:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93d2526cce00 x1877761496092160/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790773322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790773312.343036:0:3603:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1790773312.343045:0:3603:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1790773312.343050:0:3603:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1790773312.343054:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d26c380000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1790773312.343062:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3603:1877761496092160:0@lo:38:kworker.0 00000100:00100000:1.0:1790773312.365055:0:17128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144545880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3603:x1877761496092032:12345-0@lo:38:kworker.0 Request processed in 26215us (26919us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790773312.365073:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1790773312.365178:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d251285800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790773312.365184:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790773312.365189:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496092032:0@lo:38:kworker.0 00010000:00010000:0.0:1790773312.718968:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1790773312.781863:0:17459:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790773312.782145:0:17459:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1790773313.165332:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2465e56c0 going to sleep for 0 seconds 00000020:00000004:2.0:1790773313.645771:0:17509:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790773313.645950:0:17509:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790773313.753614:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773314.206173:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2465e56c0 going to sleep for 0 seconds 00010000:00010000:0.0:1790773314.765566:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773315.213303:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2465e56c0 going to sleep for 0 seconds 00010000:00010000:0.0:1790773315.791007:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773316.237398:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2465e56c0 going to sleep for 0 seconds 00000100:00100000:0.0:1790773316.430361:0:3603:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790773306/real 1790773306] req@ffff93d27f9f7b80 x1877761496089088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790773316 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773316.430399:0:3603:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93d27f9f7b80 x1877761496089088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790773316 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773316.430424:0:3603:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790773306/real 1790773306] req@ffff93d27f9f7100 x1877761496088960/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790773316 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773316.430437:0:3603:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93d27f9f7100 x1877761496088960/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790773316 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790773316.430456:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d143276000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790773316.430475:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790773316.430479:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496089088:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1790773316.430485:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d251282000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790773316.430489:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790773316.430492:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496088960:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1790773316.430617:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1790773316.430623:0:15123:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1790773316.430626:0:15123:0:(import.c:65:import_set_state_nolock()) ffff93d251285800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790773316.430632:0:15123:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 455 00000100:00080000:3.0:1790773316.430639:0:15123:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1790773316.430652:0:15123:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff93d251285800 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:3.0:1790773316.430674:0:15123:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d144547800 x1877761496092416/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790773316.430687:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790773316.430696:0:15123:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1790773316.430698:0:15123:0:(import.c:65:import_set_state_nolock()) ffff93d251282000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790773316.430702:0:15123:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 449 00000100:00080000:3.0:1790773316.430705:0:15123:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1790773316.430710:0:15123:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93d251282000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:3.0:1790773316.430722:0:15123:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d144544380 x1877761496092544/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790773316.430731:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790773316.430734:0:15123:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790773316.430736:0:15123:0:(import.c:65:import_set_state_nolock()) ffff93d143276000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790773316.430738:0:15123:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 449 00000100:00080000:3.0:1790773316.430741:0:15123:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1790773316.430751:0:15123:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93d143276000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:3.0:1790773316.430762:0:15123:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d144544a80 x1877761496092672/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790773316.430892:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144545180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3605:1877761496092800:0@lo:400:kworker.0 00000100:00100000:2.0:1790773316.430978:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773316.431039:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790773316.431045:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144545c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3605:1877761496092288:0@lo:400:kworker.0 00000100:00100000:2.0:1790773316.431077:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773316.431121:0:17123:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496092800 00000100:00100000:2.0:1790773316.431129:0:17123:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496092800 00000100:00100000:2.0:1790773316.431169:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790773316.431178:0:17123:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3605:x1877761496092800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773316.431272:0:17123:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3605:x1877761496092800:12345-0@lo:400:kworker.0 Request processed in 94us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773316.431280:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790773316.431302:0:17116:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496092288 00000100:00100000:2.0:1790773316.431306:0:17116:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496092288 00000100:00100000:2.0:1790773316.431332:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790773316.431338:0:17116:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+12:3605:x1877761496092288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773316.431368:0:17116:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+12:3605:x1877761496092288:12345-0@lo:400:kworker.0 Request processed in 30us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773316.431374:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790773316.431418:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144545c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3605:1877761496092288:0@lo:400:kworker.0 00010000:00080000:2.0:1790773316.431429:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93d144545180 x1877761496092800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773316.431466:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144545180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3605:1877761496092800:0@lo:400:kworker.0 00000100:00100000:0.0:1790773316.431728:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144547800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496092416:0@lo:38:kworker.0 00000100:00100000:0.0:1790773316.431770:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773316.431789:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144544380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496092544:0@lo:8:kworker.0 00000400:00000100:0.0:1790773316.431814:0:3603:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877761496092544 offset 0 length 520: 4 00000100:00100000:0.0:1790773316.431832:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144544a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496092672:0@lo:8:kworker.0 00000400:00000100:0.0:1790773316.431852:0:3603:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877761496092672 offset 0 length 520: 4 00000100:00100000:2.0:1790773316.432110:0:17127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496092416 00000100:00100000:2.0:1790773316.432117:0:17127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496092416 00000100:00100000:2.0:1790773316.432149:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790773316.432154:0:17127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3603:x1877761496092416:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1790773316.432169:0:17127:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790773316.443633:0:17127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3603:x1877761496092416:12345-0@lo:38:kworker.0 Request processed in 11464us (11848us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790773316.443651:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1790773316.443693:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d251285800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790773316.443700:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790773316.443704:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144547800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496092416:0@lo:38:kworker.0 00010000:00010000:0.0:1790773316.817243:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773317.261570:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2465e56c0 going to sleep for 0 seconds 00010000:00010000:3.0:1790773317.839038:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773318.285356:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2465e56c0 going to sleep for 0 seconds 00010000:00010000:0.0:1790773318.863243:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790773319.246871:0:17158:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1790773319.312645:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2465e56c0 going to sleep for 0 seconds 00010000:00010000:3.0:1790773319.885519:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790773320.282030:0:17854:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1790773320.282040:0:17854:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1790773320.282041:0:17854:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1790773320.282162:0:17854:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93d27f91f800 00000020:01000004:0.0:1790773320.282194:0:17854:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1790773320.282230:0:17854:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1790773320.282245:0:17854:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff93d141d84d40) 00000020:00000080:0.0:1790773320.282263:0:17854:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00000100:00100000:3.0:1790773320.333300:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2465e56c0 going to sleep for 0 seconds 00100000:10000000:2.0:1790773320.384986:0:17854:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1790773320.387544:0:17854:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1790773320.389000:0:17854:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1790773320.389311:0:17854:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1790773320.390326:0:17854:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1790773320.390689:0:17854:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:1.0:1790773320.391913:0:17854:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1790773320.392297:0:17854:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1790773320.392706:0:17854:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1790773320.392944:0:17854:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1790773320.393455:0:17854:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1790773320.393741:0:17854:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1790773320.393977:0:17854:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1790773320.394177:0:17854:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1790773320.394673:0:17854:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:1.0:1790773320.394858:0:17854:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1790773320.395051:0:17854:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1790773320.395564:0:17854:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1790773320.395825:0:17854:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1790773320.396024:0:17854:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1790773320.396499:0:17854:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:1.0:1790773320.396788:0:17854:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:1.0:1790773320.397043:0:17854:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1790773320.397494:0:17854:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:1.0:1790773320.397725:0:17854:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1790773320.397962:0:17854:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1790773320.398304:0:17854:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1790773320.398681:0:17854:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:1.0:1790773320.398864:0:17854:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:1.0:1790773320.399066:0:17854:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1790773320.399569:0:17854:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1790773320.399778:0:17854:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:1.0:1790773320.400003:0:17854:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:1.0:1790773320.400321:0:17854:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1790773320.402983:0:17854:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:1.0:1790773320.403308:0:17854:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1790773320.403718:0:17854:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1790773320.404305:0:17854:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1790773320.404680:0:17854:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1790773320.404879:0:17854:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1790773320.405107:0:17854:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1790773320.405447:0:17854:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1790773320.405737:0:17854:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1790773320.405965:0:17854:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:1.0:1790773320.406298:0:17854:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1790773320.406671:0:17854:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:01000000:1.0:1790773320.407625:0:17854:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1790773320.407943:0:17854:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1790773320.407955:0:17854:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:1.0:1790773320.407968:0:17854:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xabf1cc0bc7842b41 00000020:01000004:1.0:1790773320.407975:0:17854:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1790773320.407997:0:17854:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.119@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1790773320.408002:0:17854:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.119@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1790773320.408010:0:17854:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1790773320.408045:0:17854:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1790773320.408049:0:17854:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.119@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1790773320.416141:0:17854:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.119@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790773320.416289:0:17854:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.119@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1790773320.416294:0:17854:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790773320.416296:0:17854:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1790773320.416297:0:17854:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790773320.416298:0:17854:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790773320.416299:0:17854:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790773320.416301:0:17854:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790773320.416302:0:17854:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790773320.416304:0:17854:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790773320.416305:0:17854:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790773320.416309:0:17854:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1790773320.416311:0:17854:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790773320.416313:0:17854:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1790773320.416314:0:17854:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790773320.416315:0:17854:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790773320.416316:0:17854:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790773320.416317:0:17854:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790773320.416318:0:17854:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790773320.416324:0:17854:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790773320.416325:0:17854:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790773320.416350:0:17854:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1790773320.416428:0:17854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17854:1877761496092928:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790773320.416517:0:17854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773320.416605:0:17854:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d252f7bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1790773320.419819:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496092928 00000100:00100000:0.0:1790773320.419839:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496092928 00000100:00100000:0.0:1790773320.419965:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790773320.419977:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+12:17854:x1877761496092928:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790773320.420022:0:17117:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1790773320.420026:0:17117:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1790773320.420034:0:17117:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1790773320.420498:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+12:17854:x1877761496092928:12345-0@lo:253:mount.lustre.0 Request processed in 521us (3979us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773320.420506:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790773320.420615:0:17854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17854:1877761496092928:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1790773320.420650:0:17854:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1790773320.420654:0:17854:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790773320.420655:0:17854:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1790773320.420656:0:17854:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790773320.420658:0:17854:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790773320.420659:0:17854:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790773320.420660:0:17854:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790773320.420661:0:17854:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790773320.420663:0:17854:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790773320.420665:0:17854:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1790773320.420688:0:17854:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93d27f91f800 from lustre-MDT0001 10000000:01000000:3.0:1790773320.420719:0:17854:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1790773320.420722:0:17854:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1790773320.420730:0:17854:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93d281ba99c0 local copy 00010000:00010000:3.0:1790773320.420742:0:17854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12bc00/0xabf1cc0bc7842a37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842a3e expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773320.420854:0:17854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144547480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17854:1877761496093056:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790773320.420894:0:17854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773320.421161:0:17854:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d249659900 going to sleep for 11 seconds 00000100:00100000:2.0:1790773320.421504:0:17116:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496093056 00000100:00100000:2.0:1790773320.421513:0:17116:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496093056 00000100:00100000:2.0:1790773320.421550:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790773320.421559:0:17116:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+12:17854:x1877761496093056:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790773320.421700:0:17116:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+12:17854:x1877761496093056:12345-0@lo:501:mount.lustre.0 Request processed in 142us (806us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790773320.421708:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790773320.421807:0:17854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144547480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17854:1877761496093056:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1790773320.421824:0:17854:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.119@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1790773320.421845:0:17854:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.119@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1790773320.421852:0:17854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12bc00/0xabf1cc0bc7842a37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842a3e expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773320.421863:0:17854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d27b12bc00/0xabf1cc0bc7842a37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842a3e expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773320.421890:0:17854:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93d27f91f800 10000000:01000000:3.0:1790773320.421904:0:17854:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790773320.421979:0:17854:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff93d281ba99c0 10000000:01000000:3.0:1790773320.421983:0:17854:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1790773320.421987:0:17854:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff93d281ba99c0 from 1 10000000:01000000:3.0:1790773320.421990:0:17854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1790773320.422016:0:17854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d1434ada00/0xabf1cc0bc7842b48 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773320.422025:0:17854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d1434ada00/0xabf1cc0bc7842b48 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773320.422035:0:17854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d1434ada00/0xabf1cc0bc7842b48 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773320.422049:0:17854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144547480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17854:1877761496093184:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790773320.422082:0:17854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773320.422115:0:17854:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d249659900 going to sleep for 11 seconds 00000100:00100000:2.0:1790773320.422169:0:17116:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496093184 00000100:00100000:2.0:1790773320.422183:0:17116:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496093184 00000100:00100000:2.0:1790773320.422238:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790773320.422245:0:17116:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+12:17854:x1877761496093184:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790773320.422255:0:17116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773320.422270:0:17116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d26efc4400/0xabf1cc0bc7842b4f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7842b48 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773320.422291:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d26efc4400/0xabf1cc0bc7842b4f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7842b48 expref: 13 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773320.422303:0:17116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d26efc4400/0xabf1cc0bc7842b4f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7842b48 expref: 13 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773320.422312:0:17116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26efc4400, rc 0) 00000100:00100000:2.0:1790773320.422339:0:17116:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+13:17854:x1877761496093184:12345-0@lo:101:mount.lustre.0 Request processed in 94us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773320.422352:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790773320.422600:0:17854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144547480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17854:1877761496093184:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790773320.422617:0:17854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d1434ada00/0xabf1cc0bc7842b48 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842b4f expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773320.422626:0:17854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d1434ada00/0xabf1cc0bc7842b48 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7842b4f expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773320.422641:0:17854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1790773320.422658:0:17854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d1434ada00/0xabf1cc0bc7842b48 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842b4f expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773320.422665:0:17854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d1434ada00/0xabf1cc0bc7842b48 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842b4f expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773320.422685:0:17854:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff93d27f91f800 10000000:01000000:3.0:1790773320.422689:0:17854:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1790773320.422692:0:17854:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff93d27f91f800 from 1 10000000:01000000:3.0:1790773320.422694:0:17854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1790773320.422708:0:17854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d1434ad200/0xabf1cc0bc7842b56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773320.422716:0:17854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d1434ad200/0xabf1cc0bc7842b56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773320.422723:0:17854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d1434ad200/0xabf1cc0bc7842b56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773320.422735:0:17854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144547480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17854:1877761496093312:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790773320.422763:0:17854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773320.422790:0:17854:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d249659900 going to sleep for 11 seconds 00000100:00100000:0.0:1790773320.422848:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496093312 00000100:00100000:0.0:1790773320.422853:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496093312 00000100:00100000:0.0:1790773320.422891:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790773320.422899:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+13:17854:x1877761496093312:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790773320.422918:0:17117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773320.422927:0:17117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d25074a400/0xabf1cc0bc7842b5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7842b56 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773320.422943:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d25074a400/0xabf1cc0bc7842b5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7842b56 expref: 14 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773320.422952:0:17117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d25074a400/0xabf1cc0bc7842b5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7842b56 expref: 14 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773320.422968:0:17117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074a400, rc 0) 00000100:00100000:0.0:1790773320.422999:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+14:17854:x1877761496093312:12345-0@lo:101:mount.lustre.0 Request processed in 101us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773320.423004:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790773320.423188:0:17854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144547480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17854:1877761496093312:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790773320.423200:0:17854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d1434ad200/0xabf1cc0bc7842b56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842b5d expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773320.423236:0:17854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d1434ad200/0xabf1cc0bc7842b56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7842b5d expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773320.423248:0:17854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1790773320.423258:0:17854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d1434ad200/0xabf1cc0bc7842b56 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842b5d expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773320.423265:0:17854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d1434ad200/0xabf1cc0bc7842b56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842b5d expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773320.423279:0:17854:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1790773320.423283:0:17854:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790773320.423288:0:17854:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff93d27f91f800 10000000:01000000:3.0:1790773320.423291:0:17854:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1790773320.423293:0:17854:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1790773320.423295:0:17854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1790773320.423309:0:17854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d1434ac200/0xabf1cc0bc7842b64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773320.423316:0:17854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d1434ac200/0xabf1cc0bc7842b64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773320.423323:0:17854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d1434ac200/0xabf1cc0bc7842b64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773320.423334:0:17854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144547480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17854:1877761496093440:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790773320.423360:0:17854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773320.423563:0:17854:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d249659900 going to sleep for 11 seconds 00000100:00100000:0.0:1790773320.423617:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496093440 00000100:00100000:0.0:1790773320.423622:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496093440 00000100:00100000:0.0:1790773320.423653:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790773320.423660:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+14:17854:x1877761496093440:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790773320.423667:0:17117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773320.423675:0:17117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d25074b400/0xabf1cc0bc7842b6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7842b64 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773320.423690:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d25074b400/0xabf1cc0bc7842b6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7842b64 expref: 15 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773320.423699:0:17117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d25074b400/0xabf1cc0bc7842b6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7842b64 expref: 15 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773320.423706:0:17117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074b400, rc 0) 00000100:00100000:0.0:1790773320.423822:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+15:17854:x1877761496093440:12345-0@lo:101:mount.lustre.0 Request processed in 161us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773320.423828:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790773320.424026:0:17854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144547480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17854:1877761496093440:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790773320.424040:0:17854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d1434ac200/0xabf1cc0bc7842b64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842b6b expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773320.424048:0:17854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d1434ac200/0xabf1cc0bc7842b64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7842b6b expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790773320.425774:0:17854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:2.0:1790773320.426808:0:17854:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790773320.432067:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1790773320.432128:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1790773320.432146:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1790773320.432160:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1790773320.432176:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:2.0:1790773320.432546:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:2.0:1790773320.432563:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:2.0:1790773320.432578:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:2.0:1790773320.432595:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:2.0:1790773320.432611:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:2.0:1790773320.432627:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:2.0:1790773320.432640:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:2.0:1790773320.432653:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:2.0:1790773320.432666:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:2.0:1790773320.432680:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:2.0:1790773320.432695:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:2.0:1790773320.432716:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:2.0:1790773320.432731:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:2.0:1790773320.432743:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:2.0:1790773320.432757:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:2.0:1790773320.432787:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1790773320.432803:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:2.0:1790773320.432820:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:2.0:1790773320.432851:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:2.0:1790773320.432857:0:17854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:2.0:1790773320.433001:0:17854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17854:1877761496093568:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790773320.433090:0:17854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773320.433143:0:17854:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27b2d0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790773320.433292:0:17116:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496093568 00000100:00100000:0.0:1790773320.433302:0:17116:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496093568 00000100:00100000:0.0:1790773320.433359:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790773320.433382:0:17116:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+15:17854:x1877761496093568:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790773320.433577:0:17116:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+15:17854:x1877761496093568:12345-0@lo:501:mount.lustre.0 Request processed in 209us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773320.433593:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790773320.433889:0:17854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17854:1877761496093568:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790773320.433946:0:17854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526ce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17854:1877761496093696:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790773320.433996:0:17854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773320.434027:0:17854:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d251f19840 going to sleep for 11 seconds 00000100:00100000:2.0:1790773320.434131:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496093696 00000100:00100000:2.0:1790773320.434137:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496093696 00000100:00100000:2.0:1790773320.434178:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790773320.434186:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+15:17854:x1877761496093696:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790773320.435167:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+15:17854:x1877761496093696:12345-0@lo:503:mount.lustre.0 Request processed in 977us (1165us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773320.435266:0:17854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526ce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17854:1877761496093696:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1790773320.435825:0:17854:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790773320.436008:0:17854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526ce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17854:1877761496093824:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790773320.436063:0:17854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773320.436118:0:17854:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d243f8f900 going to sleep for 11 seconds 00000100:00100000:2.0:1790773320.436232:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790773320.436274:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496093824 00000100:00100000:2.0:1790773320.436279:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496093824 00000100:00100000:2.0:1790773320.436311:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790773320.436319:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+15:17854:x1877761496093824:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790773320.437006:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+15:17854:x1877761496093824:12345-0@lo:502:mount.lustre.0 Request processed in 686us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773320.437016:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790773320.437274:0:17854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526ce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17854:1877761496093824:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790773320.437652:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1790773320.437683:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:1.0:1790773320.437702:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:1.0:1790773320.437715:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:1.0:1790773320.437727:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:1.0:1790773320.437739:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:1.0:1790773320.437750:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:1.0:1790773320.437761:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:1.0:1790773320.437772:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:1.0:1790773320.437785:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:1.0:1790773320.437795:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:1.0:1790773320.437806:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:1.0:1790773320.437818:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:1.0:1790773320.437832:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:1.0:1790773320.437846:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:1.0:1790773320.437862:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:1.0:1790773320.437876:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:1.0:1790773320.437891:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:1.0:1790773320.437904:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:1.0:1790773320.438132:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:1.0:1790773320.438148:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:1.0:1790773320.438162:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:1.0:1790773320.438349:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:1.0:1790773320.438441:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:1.0:1790773320.438462:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:1.0:1790773320.438477:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:1.0:1790773320.438503:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:1.0:1790773320.438516:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:1.0:1790773320.438529:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:1.0:1790773320.438544:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:1.0:1790773320.438573:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:1.0:1790773320.438587:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:1.0:1790773320.438600:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:1.0:1790773320.438613:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:1.0:1790773320.438628:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:1.0:1790773320.438644:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:1.0:1790773320.438660:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:1.0:1790773320.438676:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:1.0:1790773320.438695:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:1.0:1790773320.438711:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:1.0:1790773320.438727:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:1.0:1790773320.438743:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:1.0:1790773320.438759:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:1.0:1790773320.438776:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:1.0:1790773320.438817:0:17854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526ce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17854:1877761496093952:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790773320.438887:0:17854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773320.439024:0:17854:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d243f8f900 going to sleep for 11 seconds 00000100:00100000:2.0:1790773320.442532:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496093952 00000100:00100000:2.0:1790773320.442548:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496093952 00000100:00100000:2.0:1790773320.442620:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790773320.442631:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+15:17854:x1877761496093952:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790773320.442817:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+15:17854:x1877761496093952:12345-0@lo:502:mount.lustre.0 Request processed in 188us (3930us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773320.442831:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790773320.444364:0:17854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526ce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17854:1877761496093952:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790773320.444493:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:3.0:1790773320.444509:0:17854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1790773320.448580:0:17858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790773320.448597:0:17858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773320.448600:0:17858:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1790773320.448608:0:17858:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1790773320.448611:0:17858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790773320.448630:0:17858:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff93d141d83380) 00000020:00000080:0.0:1790773320.448653:0:17858:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1790773320.448659:0:17858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1790773320.448738:0:17858:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:0.0:1790773320.448745:0:17858:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xabf1cc0bc7842b79 00000020:00000080:0.0:1790773320.450406:0:17858:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1790773320.450417:0:17858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790773320.450424:0:17858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773320.450426:0:17858:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1790773320.450430:0:17858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790773320.450436:0:17858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773320.450437:0:17858:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1790773320.450441:0:17858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790773320.450456:0:17858:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff93d279ea3380) 00000020:00000080:0.0:1790773320.450476:0:17858:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:0.0:1790773320.451687:0:17858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1790773320.451690:0:17858:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1790773320.451694:0:17858:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1790773320.451702:0:17858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1790773320.451828:0:17858:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93d27f91f800 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1790773320.451847:0:17858:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff93d279ea0000) 00000020:00000080:0.0:1790773320.451858:0:17858:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1790773320.453080:0:17858:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1790773320.453094:0:17858:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xabf1cc0bc7842b8e 00000020:00000080:0.0:1790773320.454093:0:17858:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1790773320.454104:0:17858:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1790773320.454125:0:17858:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xabf1cc0bc7842b95 00080000:01000000:0.0:1790773320.454135:0:17858:0:(osd_handler.c:8931:osd_obd_connect()) connect #2 00000020:00000080:0.0:1790773320.454140:0:17858:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xabf1cc0bc7842b9c 00010000:00010000:2.0:1790773320.543501:0:17858:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1790773320.545515:0:17858:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:2.0:1790773320.545977:0:17858:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1790773320.552073:0:17858:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1790773320.552089:0:17858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790773320.552096:0:17858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773320.552098:0:17858:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1790773320.552102:0:17858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790773320.552109:0:17858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773320.552111:0:17858:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1790773320.552114:0:17858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790773320.552120:0:17858:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.119@tcp to nid 0x20000c0a8ca77 (192.168.202.119@tcp) 00000020:00000080:2.0:1790773320.552148:0:17858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790773320.552167:0:17858:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff93d1427399c0) 00000020:00000080:2.0:1790773320.554008:0:17858:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1790773320.554026:0:17858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790773320.554116:0:17858:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1790773320.554124:0:17858:0:(osd_handler.c:8931:osd_obd_connect()) connect #3 00000020:00000080:2.0:1790773320.554132:0:17858:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xabf1cc0bc7842baa 00010000:00080000:2.0:1790773320.554167:0:17858:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d281bd5000@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.119@tcp at head 00010000:00010000:2.0:1790773320.557747:0:17858:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1790773320.559028:0:17858:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1790773320.559046:0:17858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1790773320.559089:0:17858:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1790773320.559112:0:17858:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xabf1cc0bc7842bb1 00000100:00080000:0.0:1790773320.559123:0:17858:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790773320.559137:0:17858:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d281bd5000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:0.0:1790773320.559196:0:17858:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d143cc7b80 x1877761496094080/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790773320.559251:0:17858:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1790773320.559625:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761496094080:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790773320.559704:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773320.559808:0:17128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496094080 00000100:00100000:3.0:1790773320.559815:0:17128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496094080 00000100:00100000:3.0:1790773320.559847:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790773320.559856:0:17128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144546a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3603:x1877761496094080:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1790773320.559897:0:17128:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 463 last 0 00000020:00000080:3.0:1790773320.559942:0:17128:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xabf1cc0bc7842bb8 00000004:00100000:3.0:1790773320.559958:0:17128:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1790773320.559964:0:17128:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1790773320.567043:0:17128:0:(import.c:65:import_set_state_nolock()) ffff93d281bd4000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790773320.567156:0:17128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144546a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3603:x1877761496094080:12345-0@lo:38:llog_process_th.0 Request processed in 7297us (7450us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773320.567395:0:3603:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790773320.567406:0:3603:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1790773320.567417:0:3603:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1790773320.567423:0:3603:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1790773320.567427:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d281bd5000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1790773320.567443:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761496094080:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790773320.567589:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000000:0.0:1790773320.567826:0:17858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790773320.567835:0:17858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773320.567838:0:17858:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1790773320.567842:0:17858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1790773320.567845:0:17858:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1790773320.567847:0:17858:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790773320.567849:0:17858:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790773320.567850:0:17858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1790773320.567853:0:17858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773320.567854:0:17858:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1790773320.567857:0:17858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790773320.567863:0:17858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773320.567864:0:17858:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1790773320.567869:0:17858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1790773320.568042:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790773320.568056:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144545f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496094208:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790773320.568103:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:01000000:0.0:1790773320.568436:0:17858:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1790773320.568460:0:17858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790773320.568464:0:17858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773320.568466:0:17858:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1790773320.568469:0:17858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1790773320.568471:0:17858:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:0.0:1790773320.568497:0:17858:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790773320.568500:0:17858:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790773320.568502:0:17858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1790773320.568505:0:17858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773320.568506:0:17858:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:0.0:1790773320.568509:0:17858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790773320.568512:0:17858:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1790773320.568517:0:17858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773320.568518:0:17858:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1790773320.568521:0:17858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1790773320.568525:0:17858:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.119@tcp to nid 0x20000c0a8ca77 (192.168.202.119@tcp) 00000020:01000000:0.0:1790773320.568548:0:17858:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1790773320.568551:0:17858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790773320.568567:0:17858:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff93d279ea4d40) 00000020:00000080:0.0:1790773320.568586:0:17858:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1790773320.568592:0:17858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1790773320.568677:0:17858:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1790773320.568684:0:17858:0:(osd_handler.c:8931:osd_obd_connect()) connect #4 00000020:00000080:0.0:1790773320.568693:0:17858:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xabf1cc0bc7842bc6 00010000:00080000:0.0:1790773320.568727:0:17858:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d27c378800@lustre-OST0000-osc-MDT0001: add connection 192.168.202.119@tcp at head 00000100:00100000:2.0:1790773320.569045:0:17127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496094208 00000100:00100000:2.0:1790773320.569055:0:17127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496094208 00000100:00100000:2.0:1790773320.569096:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790773320.569116:0:17127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144544700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3607:x1877761496094208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790773320.569150:0:17127:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1790773320.569438:0:17127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144544700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3607:x1877761496094208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 324us (1334us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773320.569446:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790773320.569610:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144545f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496094208:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1790773320.569751:0:17858:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:1.0:1790773320.570025:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1790773320.570031:0:15123:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1790773320.570036:0:15123:0:(import.c:65:import_set_state_nolock()) ffff93d251285800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790773320.570041:0:15123:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 459 00000100:00080000:1.0:1790773320.570046:0:15123:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1790773320.570055:0:15123:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff93d251285800 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:1.0:1790773320.570096:0:15123:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d2526cfb80 x1877761496094336/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790773320.570160:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496094336:0@lo:38:kworker.0 00000100:00100000:3.0:1790773320.570241:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790773320.570350:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790773320.570354:0:15123:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790773320.570358:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790773320.570380:0:15123:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790773320.570425:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3607:1877761496094464:0@lo:400:kworker.0 00000100:00100000:1.0:1790773320.570464:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773320.570515:0:17122:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496094464 00000100:00100000:1.0:1790773320.570522:0:17122:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496094464 00000100:00100000:1.0:1790773320.570560:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790773320.570569:0:17122:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1877761496094464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773320.570611:0:17122:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1877761496094464:12345-0@lo:400:kworker.0 Request processed in 43us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773320.570617:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1790773320.570647:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93d2526cf100 x1877761496094464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773320.570659:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3607:1877761496094464:0@lo:400:kworker.0 00000100:00100000:2.0:1790773320.571648:0:17128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496094336 00000100:00100000:2.0:1790773320.571657:0:17128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496094336 00000100:00100000:2.0:1790773320.571685:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790773320.571692:0:17128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144545f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3603:x1877761496094336:12345-0@lo:38:kworker.0 00000040:01000000:0.0:1790773320.574028:0:17858:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1790773320.574418:0:17858:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1790773320.576139:0:17858:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790773320.576643:0:17858:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1790773320.576797:0:17858:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000100:00100000:2.0:1790773320.577828:0:17128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144545f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3603:x1877761496094336:12345-0@lo:38:kworker.0 Request processed in 6129us (7581us total) trans 0 rc -11/-11 00000100:00100000:2.0:1790773320.577843:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000040:00080000:1.0:1790773320.578127:0:17863:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1790773320.578132:0:17863:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1790773320.579019:0:17858:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1790773320.579032:0:17858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1790773320.579072:0:17858:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1790773320.579094:0:17858:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xabf1cc0bc7842bcd 00000100:00080000:1.0:1790773320.579104:0:17858:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790773320.579115:0:17858:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff93d27c378800 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:1.0:1790773320.579151:0:17858:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d2526cf100 x1877761496094592/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790773320.579524:0:17858:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1790773320.579628:0:17858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790773320.579642:0:17858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790773320.579644:0:17858:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1790773320.579648:0:17858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1790773320.579652:0:17858:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1790773320.579653:0:17858:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790773320.579655:0:17858:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790773320.579656:0:17858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1790773320.579659:0:17858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790773320.579660:0:17858:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1790773320.579663:0:17858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790773320.579667:0:17858:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1790773320.579671:0:17858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790773320.579672:0:17858:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1790773320.579675:0:17858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1790773320.579679:0:17858:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.119@tcp to nid 0x20000c0a8ca77 (192.168.202.119@tcp) 00000020:01000000:1.0:1790773320.579703:0:17858:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1790773320.579705:0:17858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790773320.579719:0:17858:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff93d1435ecd40) 00000020:00000080:1.0:1790773320.579734:0:17858:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1790773320.579740:0:17858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1790773320.579817:0:17858:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1790773320.579826:0:17858:0:(osd_handler.c:8931:osd_obd_connect()) connect #5 00000020:00000080:1.0:1790773320.579832:0:17858:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xabf1cc0bc7842bdb 00010000:00080000:1.0:1790773320.579861:0:17858:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d281bb7800@lustre-OST0001-osc-MDT0001: add connection 192.168.202.119@tcp at head 00010000:00010000:1.0:1790773320.580093:0:17858:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1790773320.580165:0:17858:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1790773320.580200:0:17858:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:0.0:1790773320.580402:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790773320.580408:0:15123:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790773320.580411:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790773320.580413:0:15123:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790773320.581835:0:3603:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790773320.581846:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d251285800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790773320.581853:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1790773320.581858:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496094336:0@lo:38:kworker.0 00000100:00100000:3.0:1790773320.581889:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761496094592:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1790773320.582343:0:3603:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877761496094592 offset 0 length 520: 4 00000040:00080000:1.0:1790773320.582760:0:17858:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790773320.583627:0:17858:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1790773320.583781:0:17858:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1790773320.584281:0:17865:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1790773320.584287:0:17865:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1790773320.585778:0:17858:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1790773320.585791:0:17858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1790773320.585831:0:17858:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1790773320.585853:0:17858:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xabf1cc0bc7842be2 00000100:00080000:0.0:1790773320.585866:0:17858:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790773320.585876:0:17858:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff93d281bb7800 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:0.0:1790773320.585982:0:17858:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d143cc5180 x1877761496094720/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790773320.586047:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761496094720:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1790773320.586100:0:3603:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877761496094720 offset 0 length 520: 4 00000100:00080000:0.0:1790773320.586153:0:17858:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1790773320.586249:0:17858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790773320.586254:0:17858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773320.586257:0:17858:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1790773320.586260:0:17858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790773320.586264:0:17858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773320.586266:0:17858:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790773320.586269:0:17858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790773320.586271:0:17858:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1790773320.586273:0:17858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790773320.586276:0:17858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773320.586278:0:17858:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:0.0:1790773320.586280:0:17858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790773320.586282:0:17858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773320.586284:0:17858:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1790773320.586287:0:17858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1790773320.586316:0:17858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790773320.586319:0:17858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773320.586320:0:17858:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1790773320.586324:0:17858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000100:00080000:1.0:1790773320.586474:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790773320.586490:0:15123:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790773320.586493:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790773320.586508:0:15123:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:1.0:1790773320.586895:0:17854:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:1.0:1790773320.586993:0:17854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1790773320.587052:0:17854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d1434ac200/0xabf1cc0bc7842b64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842b6b expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773320.587065:0:17854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d1434ac200/0xabf1cc0bc7842b64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842b6b expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790773320.587075:0:17854:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93d27f91f800 from 1 10000000:01000000:1.0:1790773320.587077:0:17854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790773320.587103:0:17854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12a400/0xabf1cc0bc7842be9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773320.587111:0:17854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d27b12a400/0xabf1cc0bc7842be9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773320.587122:0:17854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d27b12a400/0xabf1cc0bc7842be9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773320.587141:0:17854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17854:1877761496094848:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790773320.587524:0:17854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773320.587631:0:17116:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496094848 00000100:00100000:0.0:1790773320.587639:0:17116:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496094848 00000100:00100000:0.0:1790773320.587727:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790773320.587737:0:17116:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+15:17854:x1877761496094848:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790773320.587752:0:17116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773320.587767:0:17116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d25074a600/0xabf1cc0bc7842bf0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7842be9 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773320.587788:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d25074a600/0xabf1cc0bc7842bf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7842be9 expref: 16 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773320.587798:0:17116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d25074a600/0xabf1cc0bc7842bf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7842be9 expref: 16 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773320.587807:0:17116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074a600, rc 0) 00000100:00100000:0.0:1790773320.587845:0:17116:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+16:17854:x1877761496094848:12345-0@lo:101:mount.lustre.0 Request processed in 110us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773320.587851:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790773320.588012:0:17854:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ef8c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790773320.588034:0:17854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17854:1877761496094848:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790773320.588050:0:17854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d27b12a400/0xabf1cc0bc7842be9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842bf0 expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773320.588059:0:17854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d27b12a400/0xabf1cc0bc7842be9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7842bf0 expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773320.589855:0:17854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17854:1877761496094976:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1790773320.589937:0:17854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773320.589982:0:17854:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2626803c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790773320.590163:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496094976 00000100:00100000:1.0:1790773320.590185:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496094976 00000100:00100000:1.0:1790773320.590777:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790773320.590788:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+16:17854:x1877761496094976:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1790773320.590813:0:17117:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1790773320.590832:0:17117:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1790773320.590841:0:17117:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1790773320.591101:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+16:17854:x1877761496094976:12345-0@lo:256:mount.lustre.0 Request processed in 314us (1163us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773320.591110:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790773320.591245:0:17854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17854:1877761496094976:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1790773320.592538:0:17854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790773320.592559:0:17854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12a400/0xabf1cc0bc7842be9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842bf0 expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773320.592572:0:17854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d27b12a400/0xabf1cc0bc7842be9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842bf0 expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790773320.592581:0:17854:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d27f91f800 from 1 10000000:01000000:0.0:1790773320.592584:0:17854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790773320.592618:0:17854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d25074bc00/0xabf1cc0bc7842bf7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773320.592625:0:17854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d25074bc00/0xabf1cc0bc7842bf7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773320.592634:0:17854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d25074bc00/0xabf1cc0bc7842bf7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773320.592653:0:17854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17854:1877761496095104:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790773320.592701:0:17854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773320.592813:0:17854:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2626803c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790773320.593021:0:17116:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496095104 00000100:00100000:1.0:1790773320.593029:0:17116:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496095104 00000100:00100000:1.0:1790773320.593103:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790773320.593111:0:17116:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+16:17854:x1877761496095104:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790773320.593123:0:17116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773320.593134:0:17116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d27b12b000/0xabf1cc0bc7842bfe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7842bf7 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773320.593154:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d27b12b000/0xabf1cc0bc7842bfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7842bf7 expref: 17 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773320.593164:0:17116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d27b12b000/0xabf1cc0bc7842bfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7842bf7 expref: 17 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773320.593190:0:17116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12b000, rc 0) 00000100:00100000:1.0:1790773320.593261:0:17116:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+17:17854:x1877761496095104:12345-0@lo:101:mount.lustre.0 Request processed in 151us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773320.593268:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790773320.593346:0:17854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17854:1877761496095104:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790773320.593360:0:17854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d25074bc00/0xabf1cc0bc7842bf7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842bfe expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773320.593379:0:17854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d25074bc00/0xabf1cc0bc7842bf7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7842bfe expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790773320.593521:0:17854:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790773320.593548:0:17854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144546300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17854:1877761496095232:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790773320.593575:0:17854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773320.594092:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496095232 00000100:00100000:0.0:1790773320.594098:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496095232 00000100:00100000:1.0:1790773320.594143:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790773320.594152:0:17116:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+17:17854:x1877761496095232:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790773320.594263:0:17116:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+17:17854:x1877761496095232:12345-0@lo:501:mount.lustre.0 Request processed in 112us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773320.594270:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790773320.594548:0:17854:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2527ed540 going to sleep for 11 seconds 00000100:00100000:2.0:1790773320.594567:0:17854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144546300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17854:1877761496095232:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790773320.594621:0:17854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17854:1877761496095360:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790773320.594669:0:17854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773320.594694:0:17854:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26bec6240 going to sleep for 11 seconds 00000100:00100000:3.0:1790773320.594764:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496095360 00000100:00100000:3.0:1790773320.594769:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496095360 00000100:00100000:3.0:1790773320.594794:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790773320.594800:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+17:17854:x1877761496095360:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790773320.594887:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+17:17854:x1877761496095360:12345-0@lo:503:mount.lustre.0 Request processed in 86us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773320.594894:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790773320.595009:0:17854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17854:1877761496095360:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790773320.595891:0:17854:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790773320.596041:0:17854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17854:1877761496095488:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790773320.596090:0:17854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773320.596159:0:17854:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d243301180 going to sleep for 11 seconds 00000100:00100000:0.0:1790773320.596551:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496095488 00000100:00100000:0.0:1790773320.596559:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496095488 00000100:00100000:0.0:1790773320.596634:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790773320.596643:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+17:17854:x1877761496095488:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790773320.596786:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+17:17854:x1877761496095488:12345-0@lo:502:mount.lustre.0 Request processed in 144us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773320.596803:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790773320.596891:0:17854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17854:1877761496095488:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790773320.600025:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1790773320.600102:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:2.0:1790773320.600129:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:2.0:1790773320.600140:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:2.0:1790773320.600451:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:2.0:1790773320.600472:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:2.0:1790773320.600501:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:2.0:1790773320.600517:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:2.0:1790773320.600550:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1790773320.600565:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:2.0:1790773320.600577:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:2.0:1790773320.600625:0:17854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17854:1877761496095616:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790773320.600708:0:17854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773320.600801:0:17854:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d243301180 going to sleep for 11 seconds 00000100:00100000:0.0:1790773320.601072:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496095616 00000100:00100000:0.0:1790773320.601081:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496095616 00000100:00100000:0.0:1790773320.601125:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790773320.601134:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+17:17854:x1877761496095616:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790773320.601440:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+17:17854:x1877761496095616:12345-0@lo:502:mount.lustre.0 Request processed in 306us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773320.601449:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790773320.601672:0:17854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17854:1877761496095616:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790773320.601731:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:2.0:1790773320.601741:0:17854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1790773320.602590:0:17867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790773320.602600:0:17867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773320.602602:0:17867:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1790773320.602610:0:17867:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93d27f91f800 00000020:00000080:2.0:1790773320.602613:0:17867:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790773320.602621:0:17867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790773320.602624:0:17867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773320.602625:0:17867:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1790773320.602628:0:17867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790773320.602630:0:17867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773320.602632:0:17867:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1790773320.602635:0:17867:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93d27f91f800 00000020:00000080:2.0:1790773320.602637:0:17867:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790773320.602729:0:17867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790773320.602733:0:17867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773320.602735:0:17867:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1790773320.602737:0:17867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790773320.602748:0:17867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773320.602750:0:17867:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790773320.602754:0:17867:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93d27f91f800 00000020:00000080:2.0:1790773320.602756:0:17867:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790773320.606524:0:17867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790773320.606541:0:17867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773320.606543:0:17867:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790773320.606548:0:17867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790773320.606553:0:17867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773320.606554:0:17867:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1790773320.606560:0:17867:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93d27f91f800 00000020:00000080:2.0:1790773320.606562:0:17867:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790773320.606631:0:17867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790773320.606635:0:17867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773320.606636:0:17867:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1790773320.606639:0:17867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:0.0:1790773320.613513:0:17854:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1790773320.613567:0:17854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790773320.613582:0:17854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d25074bc00/0xabf1cc0bc7842bf7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842bfe expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773320.613595:0:17854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d25074bc00/0xabf1cc0bc7842bf7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842bfe expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790773320.613689:0:17854:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1790773320.613692:0:17854:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93d27f91f800 10000000:01000000:0.0:1790773320.613695:0:17854:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93d27f91f800 10000000:01000000:0.0:1790773320.613699:0:17854:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790773320.613705:0:17854:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93d27f91f800 from 1 10000000:01000000:0.0:1790773320.613708:0:17854:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790773320.613749:0:17854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d25074be00/0xabf1cc0bc7842c05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773320.613758:0:17854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d25074be00/0xabf1cc0bc7842c05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773320.613772:0:17854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d25074be00/0xabf1cc0bc7842c05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773320.613807:0:17854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17854:1877761496095744:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790773320.613889:0:17854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773320.616387:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496095744 00000100:00100000:0.0:1790773320.616404:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496095744 00000100:00100000:0.0:1790773320.616475:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790773320.616496:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+17:17854:x1877761496095744:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790773320.616516:0:17117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773320.616536:0:17117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d25074a200/0xabf1cc0bc7842c0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7842c05 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773320.616566:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d25074a200/0xabf1cc0bc7842c0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7842c05 expref: 18 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773320.616578:0:17117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d25074a200/0xabf1cc0bc7842c0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7842c05 expref: 18 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773320.616587:0:17117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074a200, rc 0) 00000100:00100000:0.0:1790773320.616649:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+18:17854:x1877761496095744:12345-0@lo:101:mount.lustre.0 Request processed in 155us (2759us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773320.616656:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790773320.616709:0:17854:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279e48540 going to sleep for 11 seconds 00000100:00100000:0.0:1790773320.616732:0:17854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17854:1877761496095744:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790773320.616751:0:17854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d25074be00/0xabf1cc0bc7842c05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842c0c expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773320.616760:0:17854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d25074be00/0xabf1cc0bc7842c05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7842c0c expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790773320.621243:0:17854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1790773320.621786:0:17854:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790773320.622559:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1790773320.622595:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:2.0:1790773320.622611:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:2.0:1790773320.622625:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:2.0:1790773320.622638:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:2.0:1790773320.622651:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:2.0:1790773320.622688:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:2.0:1790773320.622705:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:2.0:1790773320.622716:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:2.0:1790773320.622729:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:2.0:1790773320.622741:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:2.0:1790773320.622754:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:2.0:1790773320.622766:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:2.0:1790773320.622780:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:2.0:1790773320.622797:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:2.0:1790773320.622823:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:2.0:1790773320.622836:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:2.0:1790773320.622850:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:2.0:1790773320.622862:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:2.0:1790773320.622874:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:2.0:1790773320.622887:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:2.0:1790773320.622901:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:1.0:1790773320.632587:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:1.0:1790773320.632636:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:1.0:1790773320.632653:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:1.0:1790773320.632666:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:1.0:1790773320.632678:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:1.0:1790773320.632688:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:1.0:1790773320.632715:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:1.0:1790773320.632721:0:17854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1790773320.632851:0:17854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17854:1877761496095872:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790773320.634531:0:17854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773320.635045:0:17854:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ef8c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790773320.641105:0:17116:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496095872 00000100:00100000:2.0:1790773320.641119:0:17116:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496095872 00000100:00100000:2.0:1790773320.641345:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790773320.641357:0:17116:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+18:17854:x1877761496095872:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790773320.641570:0:17116:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+18:17854:x1877761496095872:12345-0@lo:501:mount.lustre.0 Request processed in 214us (7042us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773320.641579:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790773320.641663:0:17854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17854:1877761496095872:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790773320.641717:0:17854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144544e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17854:1877761496096000:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790773320.641766:0:17854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773320.648121:0:17854:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2527ed000 going to sleep for 11 seconds 00000100:00100000:0.0:1790773320.648317:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496096000 00000100:00100000:0.0:1790773320.648327:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496096000 00000100:00100000:0.0:1790773320.648377:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790773320.648387:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+18:17854:x1877761496096000:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790773320.648548:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+18:17854:x1877761496096000:12345-0@lo:503:mount.lustre.0 Request processed in 162us (6781us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773320.648557:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790773320.652000:0:17854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144544e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17854:1877761496096000:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1790773320.652917:0:17854:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790773320.653012:0:17854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17854:1877761496096128:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790773320.653088:0:17854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773320.653175:0:17854:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ef8ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790773320.653408:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496096128 00000100:00100000:2.0:1790773320.653416:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496096128 00000100:00100000:2.0:1790773320.653697:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790773320.653707:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+18:17854:x1877761496096128:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790773320.653830:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+18:17854:x1877761496096128:12345-0@lo:502:mount.lustre.0 Request processed in 125us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773320.653838:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790773320.653936:0:17854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17854:1877761496096128:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790773320.654169:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1790773320.654233:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:3.0:1790773320.654251:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:3.0:1790773320.654264:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:3.0:1790773320.654276:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:3.0:1790773320.654290:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:3.0:1790773320.654303:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:3.0:1790773320.654315:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:3.0:1790773320.654325:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:3.0:1790773320.654335:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:3.0:1790773320.654346:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:3.0:1790773320.654358:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:3.0:1790773320.654388:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:3.0:1790773320.654404:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:3.0:1790773320.654416:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:3.0:1790773320.654427:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:3.0:1790773320.654439:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:3.0:1790773320.654452:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:3.0:1790773320.654466:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:3.0:1790773320.654490:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:3.0:1790773320.654506:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:3.0:1790773320.654520:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:3.0:1790773320.654534:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:3.0:1790773320.654548:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:3.0:1790773320.654561:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:3.0:1790773320.654575:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:3.0:1790773320.654590:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:3.0:1790773320.654604:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:3.0:1790773320.654632:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:3.0:1790773320.654647:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:3.0:1790773320.654661:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:3.0:1790773320.654675:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:3.0:1790773320.654702:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:3.0:1790773320.654715:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:3.0:1790773320.654730:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:3.0:1790773320.654743:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:3.0:1790773320.654756:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:3.0:1790773320.654770:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:3.0:1790773320.654785:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:3.0:1790773320.654800:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:3.0:1790773320.654815:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:3.0:1790773320.654829:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:3.0:1790773320.654841:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:3.0:1790773320.654855:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:3.0:1790773320.654884:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:3.0:1790773320.654902:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:3.0:1790773320.654917:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:3.0:1790773320.654930:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:3.0:1790773320.654975:0:17854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144544e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17854:1877761496096256:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790773320.655032:0:17854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773320.657768:0:17854:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2527ed000 going to sleep for 11 seconds 00000100:00100000:1.0:1790773320.657919:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496096256 00000100:00100000:1.0:1790773320.657929:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496096256 00000100:00100000:1.0:1790773320.657974:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790773320.657984:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+18:17854:x1877761496096256:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790773320.658189:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+18:17854:x1877761496096256:12345-0@lo:502:mount.lustre.0 Request processed in 198us (3148us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773320.658197:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790773320.660527:0:17854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144544e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17854:1877761496096256:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790773320.660764:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:3.0:1790773320.660793:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:3.0:1790773320.660831:0:17854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144544e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17854:1877761496096384:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790773320.660903:0:17854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773320.660944:0:17854:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2527ed000 going to sleep for 11 seconds 00000100:00100000:1.0:1790773320.661037:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496096384 00000100:00100000:1.0:1790773320.661044:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496096384 00000100:00100000:1.0:1790773320.661091:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790773320.661101:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d243ed8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+18:17854:x1877761496096384:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790773320.661356:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d243ed8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+18:17854:x1877761496096384:12345-0@lo:502:mount.lustre.0 Request processed in 256us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773320.661365:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790773320.661533:0:17854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144544e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17854:1877761496096384:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790773320.661579:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:3.0:1790773320.661588:0:17854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1790773320.665000:0:17874:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1790773320.665028:0:17874:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff93d27b2c0000) 00000020:00000080:3.0:1790773320.665054:0:17874:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1790773320.665151:0:17874:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93d27f91f800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1790773320.665155:0:17874:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93d27f91f800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1790773320.665158:0:17874:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93d27f91f800 3 00010000:00080000:3.0:1790773320.665197:0:17874:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d26eed7000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.119@tcp at head 00010000:00010000:3.0:1790773320.666847:0:17874:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1790773320.667053:0:17874:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1790773320.667097:0:17874:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790773320.667110:0:17874:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xabf1cc0bc7842c1a 00000100:00080000:3.0:1790773320.667119:0:17874:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790773320.667130:0:17874:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d26eed7000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:3.0:1790773320.667166:0:17874:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d144544e00 x1877761496096512/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790773320.667194:0:17874:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1790773320.667423:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144544e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3603:1877761496096512:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790773320.667518:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773320.670713:0:17124:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496096512 00000100:00100000:3.0:1790773320.670726:0:17124:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496096512 00000100:00100000:3.0:1790773320.670813:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790773320.670821:0:17124:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3603:x1877761496096512:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1790773320.670851:0:17124:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 463 last 0 00000020:00000080:3.0:1790773320.670903:0:17124:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xabf1cc0bc7842c21 00000004:00100000:3.0:1790773320.670921:0:17124:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1790773320.670959:0:17124:0:(import.c:65:import_set_state_nolock()) ffff93d26eed2800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790773320.671058:0:17124:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3603:x1877761496096512:12345-0@lo:38:llog_process_th.0 Request processed in 236us (3540us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773320.671065:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1790773320.671142:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790773320.671147:0:15123:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790773320.671150:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790773320.671153:0:15123:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1790773320.674568:0:17874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:2.0:1790773320.674686:0:17854:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1790773320.674717:0:17854:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790773320.674740:0:17854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d25074be00/0xabf1cc0bc7842c05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842c0c expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773320.674765:0:17854:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d25074be00/0xabf1cc0bc7842c05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842c0c expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790773320.674811:0:17854:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790773320.674814:0:17854:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1790773320.674815:0:17854:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790773320.674816:0:17854:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790773320.674818:0:17854:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790773320.674819:0:17854:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790773320.674821:0:17854:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790773320.674823:0:17854:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790773320.674824:0:17854:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790773320.674829:0:17854:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1790773320.674831:0:17854:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790773320.674833:0:17854:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1790773320.674834:0:17854:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790773320.674835:0:17854:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790773320.674836:0:17854:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790773320.674838:0:17854:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790773320.674839:0:17854:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790773320.674840:0:17854:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790773320.674841:0:17854:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790773320.674868:0:17854:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1790773320.674886:0:17854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17854:1877761496096640:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790773320.674956:0:17854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773320.674995:0:17854:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2433016c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790773320.675018:0:17116:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496096640 00000100:00100000:2.0:1790773320.675025:0:17116:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496096640 00000100:00100000:2.0:1790773320.675070:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790773320.675078:0:17116:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d243edb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+18:17854:x1877761496096640:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1790773320.675103:0:17116:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1790773320.675115:0:17116:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:1.0:1790773320.679106:0:3603:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93d144544e00 x1877761496096512/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790773330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773320.679123:0:3603:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790773320.679136:0:3603:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1790773320.679145:0:3603:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1790773320.679150:0:3603:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1790773320.679154:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d26eed7000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790773320.679163:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144544e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3603:1877761496096512:0@lo:38:llog_process_th.0 00000001:00100000:3.0:1790773320.681831:0:17102:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1790773320.681926:0:17116:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1790773320.681945:0:17116:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1790773320.682070:0:17138:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1790773320.682076:0:17138:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1790773320.682100:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93d27b12b400/0xabf1cc0bc7842c28 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773320.682120:0:17138:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d25074b800/0xabf1cc0bc7842b2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7842b25 expref: 18 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773320.682128:0:17138:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d25074a600/0xabf1cc0bc7842bf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7842be9 expref: 18 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773320.682136:0:17138:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93d27b12b400/0xabf1cc0bc7842c28 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773320.682195:0:17138:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d25074a600/0xabf1cc0bc7842bf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc7842be9 expref: 18 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773320.682244:0:17138:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d25074a600/0xabf1cc0bc7842bf0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc7842be9 expref: 18 pid: 17116 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773320.682260:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cd180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17138:1877761496096768:0@lo:104: 00000100:00100000:1.0:1790773320.682328:0:17138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790773320.682378:0:17138:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d25074b800/0xabf1cc0bc7842b2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc7842b25 expref: 18 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773320.682387:0:17138:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d25074b800/0xabf1cc0bc7842b2c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc7842b25 expref: 18 pid: 17117 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773320.682397:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cc700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17138:1877761496096896:0@lo:104: 00000100:00100000:1.0:1790773320.682421:0:17138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773320.682440:0:17138:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ef8c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790773320.682461:0:17106:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496096768 00000100:00100000:1.0:1790773320.682470:0:17106:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496096768 00000100:00100000:1.0:1790773320.682522:0:17106:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496096896 00000100:00100000:1.0:1790773320.682525:0:17106:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496096896 00000100:00100000:1.0:1790773320.682539:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790773320.682547:0:17106:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+4:17138:x1877761496096768:12345-0@lo:104: 00010000:00010000:1.0:1790773320.682563:0:17106:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d27b12a400/0xabf1cc0bc7842be9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7842bf0 expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773320.682620:0:17106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790773320.682627:0:17106:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+4:17138:x1877761496096768:12345-0@lo:104: Request processed in 80us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773320.682634:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790773320.682653:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790773320.682666:0:17106:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+3:17138:x1877761496096896:12345-0@lo:104: 00010000:00010000:1.0:1790773320.682674:0:17106:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d27b12b800/0xabf1cc0bc7842b25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7842b2c expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773320.682708:0:17106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1790773320.682713:0:17106:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+3:17138:x1877761496096896:12345-0@lo:104: Request processed in 48us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773320.682719:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1790773320.682738:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790773320.682743:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d27b12a400/0xabf1cc0bc7842be9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7842bf0 expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773320.682749:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12a400 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:1.0:1790773320.682753:0:17110:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d27b12a400/0xabf1cc0bc7842be9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc7842bf0 expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773320.682761:0:17110:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d27b12a400/0xabf1cc0bc7842be9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc7842bf0 expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790773320.682767:0:17110:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d27b12a400/0xabf1cc0bc7842be9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc7842bf0 expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790773320.682772:0:17110:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790773320.682800:0:17110:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d27b12a400/0xabf1cc0bc7842be9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7842bf0 expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773320.682806:0:17110:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790773320.682824:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d27b12a400/0xabf1cc0bc7842be9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7842bf0 expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773320.682842:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d27b12a400/0xabf1cc0bc7842be9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7842bf0 expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773320.682852:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790773320.682854:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d27b12b800/0xabf1cc0bc7842b25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7842b2c expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773320.682859:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12b800 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:1.0:1790773320.682862:0:17110:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d27b12b800/0xabf1cc0bc7842b25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc7842b2c expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773320.682868:0:17110:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d27b12b800/0xabf1cc0bc7842b25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc7842b2c expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790773320.682874:0:17110:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d27b12b800/0xabf1cc0bc7842b25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc7842b2c expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790773320.682878:0:17110:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790773320.682891:0:17110:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d27b12b800/0xabf1cc0bc7842b25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7842b2c expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773320.682896:0:17110:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790773320.682902:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d27b12b800/0xabf1cc0bc7842b25 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7842b2c expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773320.682907:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d27b12b800/0xabf1cc0bc7842b25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7842b2c expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773320.682918:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773320.682927:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773320.682928:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773320.682940:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3605:1877761496097152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790773320.682968:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773320.682987:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790773320.682992:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3605:1877761496097024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790773320.683010:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773320.683032:0:17107:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496097152 00000100:00100000:1.0:1790773320.683035:0:17107:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496097152 00010000:00010000:1.0:1790773320.683052:0:17107:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d25074b800/0xabf1cc0bc7842b2c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7842b25 expref: 19 pid: 17117 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773320.683070:0:17107:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496097024 00000100:00100000:1.0:1790773320.683073:0:17107:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496097024 00010000:00010000:1.0:1790773320.683083:0:17107:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d25074a600/0xabf1cc0bc7842bf0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7842be9 expref: 20 pid: 17116 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773320.683093:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790773320.683098:0:17107:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+20:3605:x1877761496097152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790773320.683109:0:17107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790773320.683113:0:17107:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d25074b800/0xabf1cc0bc7842b2c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7842b25 expref: 20 pid: 17117 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773320.683122:0:17107:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d25074b800/0xabf1cc0bc7842b2c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc7842b25 expref: 20 pid: 17117 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773320.683134:0:17107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790773320.683901:0:17107:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+20:3605:x1877761496097152:12345-0@lo:103:ldlm_bl.0 Request processed in 799us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773320.683911:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790773320.683941:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790773320.683948:0:17107:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+19:3605:x1877761496097024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790773320.683960:0:17107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790773320.683965:0:17107:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d25074a600/0xabf1cc0bc7842bf0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7842be9 expref: 19 pid: 17116 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773320.683975:0:17107:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d25074a600/0xabf1cc0bc7842bf0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc7842be9 expref: 19 pid: 17116 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773320.683988:0:17107:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93d27b12b400/0xabf1cc0bc7842c28 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773320.683996:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d27b12b400/0xabf1cc0bc7842c28 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790773320.684009:0:17107:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003294386s 00010000:00010000:1.0:1790773320.684014:0:17107:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d27b12b400/0xabf1cc0bc7842c28 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773320.684021:0:17107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d27b12b400/0xabf1cc0bc7842c28 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773320.684029:0:17107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93d27b12b400/0xabf1cc0bc7842c28 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773320.684036:0:17107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93d27b12b400/0xabf1cc0bc7842c28 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773320.684042:0:17107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12b400 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:1.0:1790773320.684046:0:17107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93d27b12b400/0xabf1cc0bc7842c28 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773320.684064:0:17107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93d27b12b400/0xabf1cc0bc7842c28 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773320.684073:0:17107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93d27b12b400/0xabf1cc0bc7842c28 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773320.684082:0:17107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790773320.684112:0:17107:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+19:3605:x1877761496097024:12345-0@lo:103:ldlm_bl.0 Request processed in 165us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773320.684119:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1790773320.684353:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d25074a600/0xabf1cc0bc7842bf0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc7842be9 expref: 18 pid: 17116 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773320.684364:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cd180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17138:1877761496096768:0@lo:104: 00010000:00010000:0.0:1790773320.684376:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d25074b800/0xabf1cc0bc7842b2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc7842b25 expref: 17 pid: 17117 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773320.684383:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cc700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17138:1877761496096896:0@lo:104: 00010000:00010000:0.0:1790773320.684402:0:17138:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93d27b12b400/0xabf1cc0bc7842c28 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773320.684411:0:17138:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93d27b12b400/0xabf1cc0bc7842c28 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773320.684417:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93d27b12b400/0xabf1cc0bc7842c28 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773320.684424:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d27b12b400/0xabf1cc0bc7842c28 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773320.684448:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773320.684684:0:17116:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d243edb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+16:17854:x1877761496096640:12345-0@lo:253:mount.lustre.0 Request processed in 9606us (9726us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773320.684692:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790773320.684812:0:17854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17854:1877761496096640:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1790773320.684823:0:17854:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1790773320.684826:0:17854:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790773320.684828:0:17854:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1790773320.684829:0:17854:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790773320.684830:0:17854:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790773320.684831:0:17854:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790773320.684832:0:17854:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790773320.684833:0:17854:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790773320.684835:0:17854:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790773320.684836:0:17854:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1790773320.684850:0:17854:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1790773320.688642:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3605:1877761496097152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790773320.688673:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3605:1877761496097024:0@lo:103:ldlm_bl.0 00000040:01000000:0.0:1790773320.697979:0:17854:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:0.0:1790773320.698603:0:17880:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1790773320.698974:0:17854:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:3.0:1790773320.699462:0:17880:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:2.0:1790773320.702164:0:17879:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000100:00100000:0.0:1790773320.703086:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc6d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17881:1877761496097280:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1790773320.703445:0:17854:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1790773320.703502:0:17854:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1790773320.703921:0:17854:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1790773320.703928:0:17854:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1790773320.703962:0:17854:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790773320.704979:0:17854:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1790773320.705559:0:17854:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1790773320.705626:0:17854:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1790773320.705731:0:17854:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1790773320.706342:0:17854:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000040:00080000:3.0:1790773320.707091:0:17880:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1790773320.707172:0:17880:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:0.0:1790773320.709552:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773320.709708:0:17127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496097280 00000100:00100000:0.0:1790773320.709719:0:17127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496097280 00000100:00100000:0.0:1790773320.709770:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790773320.709780:0:17127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17881:x1877761496097280:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1790773320.709890:0:17127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17881:x1877761496097280:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 111us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773320.709897:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790773320.709924:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d255415900 going to sleep for 11 seconds 00000100:00100000:0.0:1790773320.709953:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc6d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17881:1877761496097280:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1790773320.709989:0:17881:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1790773320.710032:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc6d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17881:1877761496097408:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1790773320.710082:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773320.710099:0:17127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496097408 00000100:00100000:0.0:1790773320.710102:0:17127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496097408 00000100:00100000:0.0:1790773320.710121:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790773320.710126:0:17127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17881:x1877761496097408:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1790773320.710256:0:17127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17881:x1877761496097408:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 129us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773320.710262:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790773320.710278:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d255415900 going to sleep for 11 seconds 00000100:00100000:0.0:1790773320.710502:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc6d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17881:1877761496097408:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1790773320.710568:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc6d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17881:1877761496097536:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1790773320.710598:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773320.710619:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d255415840 going to sleep for 11 seconds 00000100:00100000:3.0:1790773320.710816:0:17133:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496097536 00000100:00100000:3.0:1790773320.710821:0:17133:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496097536 00000100:00100000:3.0:1790773320.710855:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790773320.710862:0:17133:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17881:x1877761496097536:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1790773320.710901:0:17133:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17881:x1877761496097536:12345-0@lo:900:lod0001_rec0000.0 Request processed in 40us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773320.710908:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:00080000:2.0:1790773320.711095:0:17879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00010000:00080000:0.0:1790773320.713854:0:17881:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93d143cc6d80 x1877761496097536/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790773336 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773320.713874:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc6d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17881:1877761496097536:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1790773320.713958:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc6d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17881:1877761496097664:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1790773320.714042:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773320.714079:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d255415900 going to sleep for 11 seconds 00000100:00100000:3.0:1790773320.714903:0:17127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496097664 00000100:00100000:3.0:1790773320.714913:0:17127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496097664 00000100:00100000:3.0:1790773320.714963:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790773320.714972:0:17127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17881:x1877761496097664:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1790773320.715097:0:17127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17881:x1877761496097664:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 125us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773320.715105:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790773320.715450:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc6d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17881:1877761496097664:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1790773320.715595:0:17881:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790773320.719707:0:17881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1790773320.719787:0:17881:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1790773320.719792:0:17881:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:1.0:1790773320.721644:0:17854:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1790773320.723521:0:17854:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1790773320.723558:0:17854:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb21f01a67988 00100000:10000000:1.0:1790773320.723565:0:17854:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1790773320.724297:0:17854:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1790773320.724328:0:17854:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.119@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1790773320.724356:0:17854:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1790773320.724372:0:17854:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1790773320.733451:0:17854:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790773320.733706:0:17854:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790773320.913004:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773321.358128:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2465e56c0 going to sleep for 0 seconds 00000040:00080000:0.0:1790773321.679423:0:17873:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790773321.933461:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1790773322.253333:0:17120:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790773322.253342:0:17120:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93d27f91f800 from 8 10000000:01000000:1.0:1790773322.253347:0:17120:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790773322.253400:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12aa00/0xabf1cc0bc7842c2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773322.253413:0:17120:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d27b12aa00/0xabf1cc0bc7842c2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773322.253425:0:17120:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d27b12aa00/0xabf1cc0bc7842c2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773322.253459:0:17120:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496097792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790773322.253543:0:17120:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773322.253594:0:17120:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c144a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790773322.253862:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496097792 00000100:00100000:3.0:1790773322.253879:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496097792 00000100:00100000:3.0:1790773322.253939:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790773322.253948:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d243ed8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+16:17120:x1877761496097792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790773322.253963:0:17115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773322.253989:0:17115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d1434adc00/0xabf1cc0bc7842c36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7842c2f expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773322.254013:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d1434adc00/0xabf1cc0bc7842c36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7842c2f expref: 17 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773322.254023:0:17115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d1434adc00/0xabf1cc0bc7842c36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7842c2f expref: 17 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773322.254033:0:17115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d1434adc00, rc 0) 00000100:00100000:3.0:1790773322.254083:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d243ed8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+17:17120:x1877761496097792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773322.254090:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790773322.254247:0:17120:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496097792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790773322.254264:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d27b12aa00/0xabf1cc0bc7842c2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842c36 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773322.254274:0:17120:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d27b12aa00/0xabf1cc0bc7842c2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7842c36 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773322.254430:0:17120:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496097920:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1790773322.254481:0:17120:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773322.254497:0:17120:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c144a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790773322.254554:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496097920 00000100:00100000:0.0:1790773322.254559:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496097920 00000100:00100000:0.0:1790773322.254601:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790773322.254615:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d243ed9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+17:17120:x1877761496097920:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1790773322.254631:0:17117:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790773322.254647:0:17117:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790773322.254650:0:17117:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1790773322.254749:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d243ed9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+17:17120:x1877761496097920:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 134us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773322.254756:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790773322.255604:0:17120:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496097920:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1790773322.255665:0:17120:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790773322.255678:0:17120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12aa00/0xabf1cc0bc7842c2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842c36 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773322.255688:0:17120:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d27b12aa00/0xabf1cc0bc7842c2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842c36 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790773322.255710:0:17120:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790773322.255713:0:17120:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93d14444c000 from 8 10000000:01000000:1.0:1790773322.255716:0:17120:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790773322.255740:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12ba00/0xabf1cc0bc7842c3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773322.255749:0:17120:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d27b12ba00/0xabf1cc0bc7842c3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773322.255758:0:17120:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d27b12ba00/0xabf1cc0bc7842c3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773322.255773:0:17120:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496098048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790773322.255809:0:17120:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773322.255835:0:17120:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c144a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790773322.257768:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496098048 00000100:00100000:0.0:1790773322.257783:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496098048 00000100:00100000:0.0:1790773322.257866:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790773322.257875:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d243edb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+17:17120:x1877761496098048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790773322.257895:0:17117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773322.257913:0:17117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d25074b200/0xabf1cc0bc7842c44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7842c3d expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773322.257943:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d25074b200/0xabf1cc0bc7842c44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7842c3d expref: 18 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773322.257955:0:17117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d25074b200/0xabf1cc0bc7842c44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7842c3d expref: 18 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773322.257963:0:17117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074b200, rc 0) 00000100:00100000:0.0:1790773322.258064:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d243edb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+18:17120:x1877761496098048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 189us (2253us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773322.258071:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790773322.260241:0:17120:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496098048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790773322.260277:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d27b12ba00/0xabf1cc0bc7842c3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842c44 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773322.260289:0:17120:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d27b12ba00/0xabf1cc0bc7842c3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7842c44 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773322.260369:0:17120:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496098176:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1790773322.260442:0:17120:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773322.260575:0:17120:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c144a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790773322.261361:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496098176 00000100:00100000:3.0:1790773322.261371:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496098176 00000100:00100000:3.0:1790773322.261430:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790773322.261440:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d280a70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+18:17120:x1877761496098176:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1790773322.261469:0:17115:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790773322.261487:0:17115:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790773322.261490:0:17115:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1790773322.261642:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d280a70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+18:17120:x1877761496098176:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 203us (1199us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773322.261649:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790773322.261798:0:17120:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496098176:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1790773322.261848:0:17120:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790773322.261856:0:17120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12ba00/0xabf1cc0bc7842c3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842c44 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773322.261865:0:17120:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d27b12ba00/0xabf1cc0bc7842c3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842c44 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773322.383329:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2465e56c0 going to sleep for 0 seconds 00000040:00080000:0.0:1790773322.701953:0:17873:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790773322.958680:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773323.405365:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2465e56c0 going to sleep for 0 seconds 00010000:00010000:0.0:1790773323.986553:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773324.431487:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2465e56c0 going to sleep for 0 seconds 00010000:00010000:3.0:1790773325.012299:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790773325.031040:0:18123:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg219-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1790773325.456500:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2465e56c0 going to sleep for 0 seconds 00000100:00100000:2.0:1790773325.648154:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496098304:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790773325.648386:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773325.648675:0:17127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496098304 00000100:00100000:0.0:1790773325.648689:0:17127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496098304 00000100:00100000:0.0:1790773325.648737:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790773325.648746:0:17127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496098304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790773325.648783:0:17127:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1790773325.648838:0:17127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496098304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773325.648845:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790773325.650378:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496098304:0@lo:41:osp-pre-0-1.0 00000020:00000004:0.0:1790773325.881708:0:18175:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790773325.881914:0:18175:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1790773326.036918:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790773326.157358:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1790773326.157365:0:15123:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1790773326.157369:0:15123:0:(import.c:65:import_set_state_nolock()) ffff93d251285800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790773326.157386:0:15123:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff93d251285800 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:1.0:1790773326.157410:0:15123:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d2526cea00 x1877761496098560/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790773326.157436:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790773326.157476:0:15123:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790773326.157480:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790773326.157483:0:15123:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790773326.157504:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790773326.157507:0:15123:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790773326.157516:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790773326.157529:0:15123:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790773326.157555:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790773326.157571:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3606:1877761496098432:0@lo:400:kworker.0 00000100:00100000:1.0:1790773326.157642:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773326.157717:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496098560:0@lo:38:kworker.0 00000100:00100000:1.0:1790773326.157754:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773326.157786:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3604:1877761496098688:0@lo:400:kworker.0 00000100:00100000:1.0:1790773326.157825:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773326.157843:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790773326.157848:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3604:1877761496098816:0@lo:400:kworker.0 00000100:00100000:1.0:1790773326.157869:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773326.157900:0:17116:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496098432 00000100:00100000:1.0:1790773326.157909:0:17116:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496098432 00000100:00100000:1.0:1790773326.157953:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790773326.157961:0:17116:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d280a70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+18:3606:x1877761496098432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773326.158022:0:17116:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d280a70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+18:3606:x1877761496098432:12345-0@lo:400:kworker.0 Request processed in 61us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773326.158030:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790773326.158062:0:17127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496098560 00000100:00100000:1.0:1790773326.158065:0:17127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496098560 00000100:00100000:1.0:1790773326.158096:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790773326.158101:0:17127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3603:x1877761496098560:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1790773326.158139:0:17127:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 468 last 0 00000020:00000080:1.0:1790773326.158177:0:17127:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xabf1cc0bc7842c4b 00000004:00100000:1.0:1790773326.158198:0:17127:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1790773326.158225:0:17127:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1790773326.158322:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3606:1877761496098432:0@lo:400:kworker.0 00000100:00100000:2.0:1790773326.158592:0:17123:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496098688 00000100:00100000:2.0:1790773326.158597:0:17123:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496098688 00000100:00100000:2.0:1790773326.158630:0:17123:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496098816 00000100:00100000:2.0:1790773326.158632:0:17123:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496098816 00000100:00100000:2.0:1790773326.158644:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790773326.158650:0:17123:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3604:x1877761496098688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773326.158697:0:17123:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3604:x1877761496098688:12345-0@lo:400:kworker.0 Request processed in 47us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773326.158703:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790773326.158714:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790773326.158719:0:17123:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3604:x1877761496098816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773326.158741:0:17123:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3604:x1877761496098816:12345-0@lo:400:kworker.0 Request processed in 22us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773326.158746:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1790773326.159227:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d2526cd880 x1877761496098816/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773326.159241:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3604:1877761496098816:0@lo:400:kworker.0 00010000:00080000:1.0:1790773326.159251:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d2526cdc00 x1877761496098688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773326.159320:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3604:1877761496098688:0@lo:400:kworker.0 00000100:00080000:0.0:1790773326.173537:0:17127:0:(import.c:65:import_set_state_nolock()) ffff93d280f76000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790773326.173644:0:17127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3603:x1877761496098560:12345-0@lo:38:kworker.0 Request processed in 15539us (15887us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773326.173655:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1790773326.173915:0:3603:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1790773326.173926:0:3603:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1790773326.173932:0:3603:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1790773326.173934:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d251285800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1790773326.173966:0:3603:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000008a3cfc7e): req@ffff93d2526cf800 x1877761496091520/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773326.173990:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496098560:0@lo:38:kworker.0 00000100:00100000:3.0:1790773326.174235:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144547b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496098944:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790773326.174349:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773326.174399:0:17128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496098944 00000100:00100000:3.0:1790773326.174406:0:17128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496098944 00000100:00100000:0.0:1790773326.174587:0:17164:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773326.174600:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2465e56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790773326.175346:0:17128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496091520 00000100:00100000:3.0:1790773326.175355:0:17128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496091520 00000100:00100000:3.0:1790773326.175382:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790773326.175390:0:17128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3606:x1877761496098944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790773326.175420:0:17128:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1790773326.175637:0:17128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3606:x1877761496098944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 246us (1288us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773326.175645:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790773326.175663:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790773326.175669:0:17128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17164:x1877761496091520:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1790773326.175733:0:17128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17164:x1877761496091520:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 64us (1146us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773326.175740:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790773326.175948:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144547b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496098944:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790773326.176022:0:17164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cf800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17164:1877761496091520:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1790773326.176106:0:17164:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1790773326.176144:0:17164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc6a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17164:1877761496099072:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1790773326.176181:0:17164:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773326.176708:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2465e5d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790773326.176765:0:17128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496099072 00000100:00100000:3.0:1790773326.176770:0:17128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496099072 00000100:00100000:3.0:1790773326.176809:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790773326.176816:0:17128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17164:x1877761496099072:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1790773326.176933:0:17128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17164:x1877761496099072:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 117us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773326.176939:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790773326.177009:0:17164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc6a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17164:1877761496099072:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1790773326.177081:0:17164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f5f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17164:1877761496099200:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1790773326.177108:0:17164:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773326.177127:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c144cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790773326.177362:0:17127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496099200 00000100:00100000:0.0:1790773326.177368:0:17127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496099200 00000100:00100000:0.0:1790773326.177389:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790773326.177394:0:17127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17164:x1877761496099200:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1790773326.177457:0:17127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17164:x1877761496099200:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 61us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773326.177473:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790773326.177818:0:17164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f5f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17164:1877761496099200:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1790773326.177863:0:17164:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790773326.185077:0:17164:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1790773326.185148:0:17164:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 20, retries 0 00000004:00080000:2.0:1790773326.185153:0:17164:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:2.0:1790773326.842262:0:18226:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790773326.843652:0:18226:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790773327.057907:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790773327.911690:0:18274:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff3d1cc360 20000000:00000080:2.0:1790773327.911715:0:18274:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93d280e58000 uarg=0000000000000000 20000000:01000000:2.0:1790773327.911760:0:18274:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1790773327.911767:0:18274:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1790773327.911772:0:18274:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1790773327.912537:0:18275:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1790773327.912721:0:18274:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1790773327.918903:0:18274:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1790773327.919031:0:18274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93d26efc4a00/0xabf1cc0bc7842c52 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773327.919051:0:18274:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d27b12a200/0xabf1cc0bc7842afb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7842af4 expref: 17 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773327.919720:0:18274:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d27b12b000/0xabf1cc0bc7842bfe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7842bf7 expref: 17 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773327.919742:0:18274:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93d26efc4a00/0xabf1cc0bc7842c52 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773327.919794:0:18274:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d27b12b000/0xabf1cc0bc7842bfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc7842bf7 expref: 17 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773327.919810:0:18274:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d27b12b000/0xabf1cc0bc7842bfe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc7842bf7 expref: 17 pid: 17116 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773327.919824:0:18274:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18274:1877761496099328:0@lo:104: 00000100:00100000:2.0:1790773327.919903:0:18274:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790773327.920004:0:18274:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d27b12a200/0xabf1cc0bc7842afb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc7842af4 expref: 17 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773327.920012:0:18274:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d27b12a200/0xabf1cc0bc7842afb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc7842af4 expref: 17 pid: 17117 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773327.920020:0:18274:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18274:1877761496099456:0@lo:104: 00000100:00100000:2.0:1790773327.920040:0:18274:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773327.920116:0:18274:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c144a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790773327.920268:0:17105:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496099328 00000100:00100000:3.0:1790773327.920277:0:17105:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496099328 00000100:00100000:3.0:1790773327.920313:0:17105:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496099456 00000100:00100000:3.0:1790773327.920315:0:17105:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496099456 00000100:00100000:3.0:1790773327.920330:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790773327.920338:0:17105:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+4:18274:x1877761496099328:12345-0@lo:104: 00010000:00010000:3.0:1790773327.920351:0:17105:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d25074bc00/0xabf1cc0bc7842bf7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7842bfe expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773327.920423:0:17105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790773327.920430:0:17105:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+4:18274:x1877761496099328:12345-0@lo:104: Request processed in 93us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773327.920438:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790773327.920455:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790773327.920461:0:17105:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+3:18274:x1877761496099456:12345-0@lo:104: 00010000:00010000:3.0:1790773327.920469:0:17105:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d26efc5000/0xabf1cc0bc7842af4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7842afb expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773327.920502:0:17105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790773327.920508:0:17105:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+3:18274:x1877761496099456:12345-0@lo:104: Request processed in 47us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773327.920513:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1790773327.920531:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790773327.920538:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d25074bc00/0xabf1cc0bc7842bf7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7842bfe expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773327.920545:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074bc00 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:3.0:1790773327.920550:0:17110:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d25074bc00/0xabf1cc0bc7842bf7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc7842bfe expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773327.920571:0:17110:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d25074bc00/0xabf1cc0bc7842bf7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc7842bfe expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790773327.920579:0:17110:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d25074bc00/0xabf1cc0bc7842bf7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc7842bfe expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773327.920585:0:17110:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790773327.920617:0:17110:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d25074bc00/0xabf1cc0bc7842bf7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7842bfe expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773327.920624:0:17110:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790773327.920644:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d25074bc00/0xabf1cc0bc7842bf7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7842bfe expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773327.920651:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d25074bc00/0xabf1cc0bc7842bf7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7842bfe expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773327.920662:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790773327.920665:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d26efc5000/0xabf1cc0bc7842af4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7842afb expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773327.920670:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc5000 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:3.0:1790773327.920673:0:17110:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d26efc5000/0xabf1cc0bc7842af4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc7842afb expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773327.920679:0:17110:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d26efc5000/0xabf1cc0bc7842af4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc7842afb expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790773327.920684:0:17110:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d26efc5000/0xabf1cc0bc7842af4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc7842afb expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773327.920695:0:17110:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790773327.920710:0:17110:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d26efc5000/0xabf1cc0bc7842af4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7842afb expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773327.920715:0:17110:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790773327.920731:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d26efc5000/0xabf1cc0bc7842af4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7842afb expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773327.920737:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d26efc5000/0xabf1cc0bc7842af4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7842afb expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773327.920750:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773327.920752:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773327.920754:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773327.920775:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144547100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3607:1877761496099584:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790773327.920807:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773327.920839:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144546d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3604:1877761496099712:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790773327.920861:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773327.920897:0:17109:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496099584 00000100:00100000:3.0:1790773327.920901:0:17109:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496099584 00010000:00010000:3.0:1790773327.920918:0:17109:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d27b12b000/0xabf1cc0bc7842bfe lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7842bf7 expref: 18 pid: 17116 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773327.920936:0:17109:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496099712 00000100:00100000:3.0:1790773327.920939:0:17109:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496099712 00010000:00010000:3.0:1790773327.920948:0:17109:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d27b12a200/0xabf1cc0bc7842afb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7842af4 expref: 19 pid: 17117 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773327.920960:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790773327.920972:0:17109:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144547b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+19:3607:x1877761496099584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790773327.920982:0:17109:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773327.920988:0:17109:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d27b12b000/0xabf1cc0bc7842bfe lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7842bf7 expref: 19 pid: 17116 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773327.920997:0:17109:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d27b12b000/0xabf1cc0bc7842bfe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc7842bf7 expref: 19 pid: 17116 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773327.921013:0:17109:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790773327.921040:0:17109:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144547b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+19:3607:x1877761496099584:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773327.921046:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790773327.921058:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790773327.921064:0:17109:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144544e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+18:3604:x1877761496099712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790773327.921071:0:17109:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773327.921074:0:17109:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d27b12a200/0xabf1cc0bc7842afb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7842af4 expref: 18 pid: 17117 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773327.921082:0:17109:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d27b12a200/0xabf1cc0bc7842afb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc7842af4 expref: 18 pid: 17117 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773327.921093:0:17109:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93d26efc4a00/0xabf1cc0bc7842c52 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773327.921112:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d26efc4a00/0xabf1cc0bc7842c52 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773327.921124:0:17109:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d26efc4a00/0xabf1cc0bc7842c52 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773327.921140:0:17109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d26efc4a00/0xabf1cc0bc7842c52 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773327.921148:0:17109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93d26efc4a00/0xabf1cc0bc7842c52 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773327.921154:0:17109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93d26efc4a00/0xabf1cc0bc7842c52 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773327.921160:0:17109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc4a00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:3.0:1790773327.921163:0:17109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93d26efc4a00/0xabf1cc0bc7842c52 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773327.921171:0:17109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93d26efc4a00/0xabf1cc0bc7842c52 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773327.921179:0:17109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93d26efc4a00/0xabf1cc0bc7842c52 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773327.921188:0:17109:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790773327.921239:0:17109:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144544e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+18:3604:x1877761496099712:12345-0@lo:103:ldlm_bl.0 Request processed in 175us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773327.921245:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790773327.921280:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144546d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3604:1877761496099712:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790773327.921307:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144547100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3607:1877761496099584:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790773327.921392:0:18274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d27b12b000/0xabf1cc0bc7842bfe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc7842bf7 expref: 17 pid: 17116 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773327.921402:0:18274:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18274:1877761496099328:0@lo:104: 00010000:00010000:2.0:1790773327.921424:0:18274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d27b12a200/0xabf1cc0bc7842afb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc7842af4 expref: 16 pid: 17117 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773327.921433:0:18274:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18274:1877761496099456:0@lo:104: 00010000:00010000:2.0:1790773327.921461:0:18274:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93d26efc4a00/0xabf1cc0bc7842c52 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773327.921469:0:18274:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93d26efc4a00/0xabf1cc0bc7842c52 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773327.921475:0:18274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93d26efc4a00/0xabf1cc0bc7842c52 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773327.921481:0:18274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d26efc4a00/0xabf1cc0bc7842c52 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773327.922487:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773328.077576:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773329.101855:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790773329.492828:0:17158:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1790773329.550857:0:17120:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790773329.550865:0:17120:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d27f91f800 from 13 10000000:01000000:3.0:1790773329.550877:0:17120:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790773329.550921:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d1434ac600/0xabf1cc0bc7842c59 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773329.550933:0:17120:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d1434ac600/0xabf1cc0bc7842c59 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773329.550945:0:17120:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d1434ac600/0xabf1cc0bc7842c59 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773329.550970:0:17120:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144547100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496099840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790773329.551037:0:17120:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773329.551077:0:17120:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d143e37480 going to sleep for 11 seconds 00000100:00100000:3.0:1790773329.551098:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496099840 00000100:00100000:3.0:1790773329.551104:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496099840 00000100:00100000:3.0:1790773329.551153:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790773329.551161:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d280a73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+16:17120:x1877761496099840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790773329.551175:0:17115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773329.551187:0:17115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d1434ac400/0xabf1cc0bc7842c60 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7842c59 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773329.551229:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d1434ac400/0xabf1cc0bc7842c60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7842c59 expref: 17 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773329.551240:0:17115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d1434ac400/0xabf1cc0bc7842c60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7842c59 expref: 17 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773329.551249:0:17115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d1434ac400, rc 0) 00000100:00100000:3.0:1790773329.551288:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d280a73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+17:17120:x1877761496099840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773329.551305:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790773329.551354:0:17120:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144547100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496099840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790773329.551369:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d1434ac600/0xabf1cc0bc7842c59 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842c60 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773329.551378:0:17120:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d1434ac600/0xabf1cc0bc7842c59 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7842c60 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773329.551534:0:17120:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144547100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496099968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790773329.551562:0:17120:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773329.551578:0:17120:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d143e37480 going to sleep for 11 seconds 00000100:00100000:3.0:1790773329.551593:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496099968 00000100:00100000:3.0:1790773329.551597:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496099968 00000100:00100000:3.0:1790773329.551620:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790773329.551627:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d280a72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+17:17120:x1877761496099968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790773329.551742:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d280a72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+17:17120:x1877761496099968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773329.551750:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790773329.551781:0:17120:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144547100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496099968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790773329.551811:0:17120:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144547100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496100096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790773329.551851:0:17120:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773329.551866:0:17120:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d143e37480 going to sleep for 11 seconds 00000100:00100000:3.0:1790773329.551878:0:17116:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496100096 00000100:00100000:3.0:1790773329.551882:0:17116:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496100096 00000100:00100000:3.0:1790773329.551905:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790773329.551917:0:17116:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d280a71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+17:17120:x1877761496100096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790773329.551992:0:17116:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d280a71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+17:17120:x1877761496100096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773329.551999:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790773329.552044:0:17120:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144547100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496100096:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790773329.555858:0:18342:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1790773329.558351:0:17120:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1790773329.558404:0:17120:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790773329.558418:0:17120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d1434ac600/0xabf1cc0bc7842c59 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842c60 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773329.558826:0:17120:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d1434ac600/0xabf1cc0bc7842c59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842c60 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790773329.558838:0:17120:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790773329.558841:0:17120:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d14444c000 from 13 10000000:01000000:0.0:1790773329.558844:0:17120:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790773329.558885:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d25074aa00/0xabf1cc0bc7842c67 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773329.558894:0:17120:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d25074aa00/0xabf1cc0bc7842c67 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773329.558906:0:17120:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d25074aa00/0xabf1cc0bc7842c67 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773329.558933:0:17120:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496100224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790773329.559011:0:17120:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773329.559736:0:17120:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279eaa0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790773329.559902:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496100224 00000100:00100000:3.0:1790773329.559911:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496100224 00000100:00100000:3.0:1790773329.559971:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790773329.559980:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d280a70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+17:17120:x1877761496100224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790773329.559995:0:17115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773329.560008:0:17115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d1434ac000/0xabf1cc0bc7842c6e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7842c67 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773329.560031:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d1434ac000/0xabf1cc0bc7842c6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7842c67 expref: 18 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773329.560043:0:17115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d1434ac000/0xabf1cc0bc7842c6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7842c67 expref: 18 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773329.560052:0:17115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d1434ac000, rc 0) 00000100:00100000:3.0:1790773329.560389:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d280a70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+18:17120:x1877761496100224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 409us (1378us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773329.560406:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790773329.560550:0:17120:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496100224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790773329.560567:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d25074aa00/0xabf1cc0bc7842c67 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842c6e expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773329.560592:0:17120:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d25074aa00/0xabf1cc0bc7842c67 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7842c6e expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773329.560662:0:17120:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496100352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790773329.560692:0:17120:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773329.560718:0:17120:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279eaa0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790773329.560770:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496100352 00000100:00100000:1.0:1790773329.560775:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496100352 00000100:00100000:1.0:1790773329.560810:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790773329.560818:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d280a72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+18:17120:x1877761496100352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790773329.560941:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d280a72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+18:17120:x1877761496100352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 124us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773329.560948:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790773329.560983:0:17120:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496100352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790773329.561013:0:17120:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496100480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790773329.561055:0:17120:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773329.561069:0:17120:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2550093c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790773329.561080:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496100480 00000100:00100000:1.0:1790773329.561382:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496100480 00000100:00100000:1.0:1790773329.561540:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790773329.561550:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d280a72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+18:17120:x1877761496100480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790773329.561636:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d280a72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+18:17120:x1877761496100480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773329.569333:0:17120:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496100480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790773329.569730:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000040:00080000:2.0:1790773329.581065:0:18344:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1790773329.582534:0:17120:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1790773329.582566:0:17120:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790773329.582580:0:17120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d25074aa00/0xabf1cc0bc7842c67 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842c6e expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773329.582613:0:17120:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d25074aa00/0xabf1cc0bc7842c67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842c6e expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773330.127900:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773330.256871:0:3603:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790773320/real 1790773320] req@ffff93d143cc5180 x1877761496094720/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790773330 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773330.256905:0:3603:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93d143cc5180 x1877761496094720/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790773330 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773330.256916:0:3603:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790773320/real 1790773320] req@ffff93d2526cf100 x1877761496094592/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790773330 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773330.256928:0:3603:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93d2526cf100 x1877761496094592/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790773330 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790773330.256975:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d281bb7800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790773330.256991:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790773330.256995:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761496094720:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1790773330.257001:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d27c378800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790773330.257006:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790773330.257021:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761496094592:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1790773330.257168:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790773330.257174:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790773330.257176:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790773330.257180:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790773330.257197:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790773330.257200:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1790773330.257225:0:38:0:(import.c:65:import_set_state_nolock()) ffff93d27c378800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790773330.257230:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 463 00000100:00080000:0.0:1790773330.257236:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790773330.257251:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff93d27c378800 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:0.0:1790773330.257274:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d143cc5880 x1877761496101120/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790773330.257287:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790773330.257290:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790773330.257292:0:38:0:(import.c:65:import_set_state_nolock()) ffff93d281bb7800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790773330.257301:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 463 00000100:00080000:0.0:1790773330.257304:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790773330.257310:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff93d281bb7800 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:0.0:1790773330.257324:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d143cc4380 x1877761496101248/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790773330.257356:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496100992:0@lo:400:kworker.0 00000100:00100000:0.0:1790773330.257461:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773330.257496:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1790773330.257502:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3604:1877761496100608:0@lo:400:kworker.0 00000100:00100000:0.0:1790773330.257533:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773330.257562:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3604:1877761496101376:0@lo:400:kworker.0 00000100:00100000:0.0:1790773330.257587:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773330.257612:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496100736:0@lo:400:kworker.0 00000100:00100000:0.0:1790773330.257637:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773330.257655:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790773330.257661:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3606:1877761496100864:0@lo:400:kworker.0 00000100:00100000:0.0:1790773330.257685:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773330.257716:0:17127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496100992 00000100:00100000:0.0:1790773330.257724:0:17127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496100992 00000100:00100000:0.0:1790773330.257761:0:17127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496100736 00000100:00100000:0.0:1790773330.257764:0:17127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496100736 00000100:00100000:0.0:1790773330.257781:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790773330.257790:0:17127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496100992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773330.257844:0:17127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496100992:12345-0@lo:400:kworker.0 Request processed in 55us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773330.257850:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790773330.257875:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790773330.257881:0:17127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3606:x1877761496100736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773330.257915:0:17127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3606:x1877761496100736:12345-0@lo:400:kworker.0 Request processed in 34us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773330.257921:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790773330.257938:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496100608 00000100:00100000:0.0:1790773330.257942:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496100608 00000100:00100000:0.0:1790773330.257964:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790773330.257970:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d280a70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+18:3604:x1877761496100608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773330.257999:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d280a70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+18:3604:x1877761496100608:12345-0@lo:400:kworker.0 Request processed in 29us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773330.258006:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790773330.258050:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496100736:0@lo:400:kworker.0 00000100:00100000:0.0:1790773330.258074:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3604:1877761496100608:0@lo:400:kworker.0 00000100:00100000:0.0:1790773330.258083:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496100992:0@lo:400:kworker.0 00000100:00100000:2.0:1790773330.258254:0:17123:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496101376 00000100:00100000:2.0:1790773330.258258:0:17123:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496101376 00000100:00100000:2.0:1790773330.258291:0:17123:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496100864 00000100:00100000:2.0:1790773330.258294:0:17123:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496100864 00000100:00100000:2.0:1790773330.258308:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790773330.258314:0:17123:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3604:x1877761496101376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773330.258356:0:17123:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3604:x1877761496101376:12345-0@lo:400:kworker.0 Request processed in 42us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773330.258361:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790773330.258373:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790773330.258380:0:17123:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1877761496100864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773330.258423:0:17123:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1877761496100864:12345-0@lo:400:kworker.0 Request processed in 44us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773330.258429:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1790773330.258458:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d143cc4700 x1877761496100864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773330.258468:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3606:1877761496100864:0@lo:400:kworker.0 00000100:00100000:2.0:1790773330.258489:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761496101120:0@lo:8:kworker.0 00000400:00000100:2.0:1790773330.258514:0:3603:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877761496101120 offset 0 length 520: 4 00000100:00100000:2.0:1790773330.258532:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761496101248:0@lo:8:kworker.0 00000400:00000100:2.0:1790773330.258548:0:3603:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877761496101248 offset 0 length 520: 4 00010000:00080000:2.0:1790773330.258573:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d143cc4a80 x1877761496101376/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773330.258582:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3604:1877761496101376:0@lo:400:kworker.0 00000100:00100000:3.0:1790773330.765395:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790773330.765464:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144547100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496101504:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790773330.765546:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773330.765610:0:17127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496101504 00000100:00100000:3.0:1790773330.765619:0:17127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496101504 00000100:00100000:3.0:1790773330.765675:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790773330.765684:0:17127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144546d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496101504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790773330.765721:0:17127:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1790773330.765770:0:17127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144546d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496101504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773330.765777:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790773330.765827:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144547100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496101504:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1790773331.149489:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773331.277303:0:3603:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790773316/real 1790773316] req@ffff93d144544380 x1877761496092544/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790773331 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773331.277336:0:3603:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93d144544380 x1877761496092544/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790773331 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773331.277346:0:3603:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790773316/real 1790773316] req@ffff93d144544a80 x1877761496092672/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790773331 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773331.277357:0:3603:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93d144544a80 x1877761496092672/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790773331 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790773331.277488:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d251282000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790773331.277508:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790773331.277513:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144544380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496092544:0@lo:8:kworker.0 00000100:00080000:2.0:1790773331.277519:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d143276000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790773331.277525:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790773331.277528:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144544a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496092672:0@lo:8:kworker.0 00000100:00080000:2.0:1790773331.277616:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790773331.277620:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1790773331.277623:0:38:0:(import.c:65:import_set_state_nolock()) ffff93d251282000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790773331.277628:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 459 00000100:00080000:2.0:1790773331.277634:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1790773331.277646:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93d251282000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:2.0:1790773331.277666:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d27f9f7480 x1877761496101888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790773331.277680:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790773331.277690:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790773331.277692:0:38:0:(import.c:65:import_set_state_nolock()) ffff93d143276000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790773331.277696:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 459 00000100:00080000:2.0:1790773331.277699:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1790773331.277703:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93d143276000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:2.0:1790773331.277716:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d27f9f5500 x1877761496102016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790773331.277738:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790773331.277741:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790773331.277744:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790773331.277747:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790773331.277775:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3607:1877761496101632:0@lo:400:kworker.0 00000100:00100000:2.0:1790773331.277840:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773331.277878:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877761496102400:0@lo:400:kworker.0 00000100:00100000:2.0:1790773331.277921:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773331.277944:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790773331.277949:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496102272:0@lo:400:kworker.0 00000100:00100000:2.0:1790773331.277974:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773331.278000:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496101760:0@lo:400:kworker.0 00000100:00100000:2.0:1790773331.278024:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773331.278043:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790773331.278048:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3604:1877761496102144:0@lo:400:kworker.0 00000100:00100000:2.0:1790773331.278069:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773331.278098:0:17123:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496102400 00000100:00100000:2.0:1790773331.278111:0:17123:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496102400 00000100:00100000:2.0:1790773331.278155:0:17123:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496102144 00000100:00100000:2.0:1790773331.278158:0:17123:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496102144 00000100:00100000:2.0:1790773331.278174:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790773331.278182:0:17123:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877761496102400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773331.278263:0:17123:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877761496102400:12345-0@lo:400:kworker.0 Request processed in 82us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773331.278272:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790773331.278288:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790773331.278294:0:17123:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3604:x1877761496102144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773331.278326:0:17123:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3604:x1877761496102144:12345-0@lo:400:kworker.0 Request processed in 31us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773331.278332:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790773331.278349:0:17127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496102272 00000100:00100000:2.0:1790773331.278353:0:17127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496102272 00000100:00100000:2.0:1790773331.278369:0:17127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496101760 00000100:00100000:2.0:1790773331.278372:0:17127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496101760 00000100:00100000:2.0:1790773331.278397:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790773331.278403:0:17127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496102272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773331.278536:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496101632 00000100:00100000:1.0:1790773331.278541:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496101632 00000100:00100000:1.0:1790773331.278571:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1790773331.278577:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d280a73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+18:3607:x1877761496101632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773331.278613:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d280a73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+18:3607:x1877761496101632:12345-0@lo:400:kworker.0 Request processed in 37us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773331.278619:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790773331.278702:0:17127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496102272:12345-0@lo:400:kworker.0 Request processed in 299us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773331.278709:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790773331.278722:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790773331.278727:0:17127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3604:x1877761496101760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773331.278754:0:17127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3604:x1877761496101760:12345-0@lo:400:kworker.0 Request processed in 28us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773331.278759:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1790773331.278810:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d27f9f4380 x1877761496102144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773331.278823:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3604:1877761496102144:0@lo:400:kworker.0 00000100:00100000:2.0:1790773331.278834:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496101760:0@lo:400:kworker.0 00000100:00100000:2.0:1790773331.278858:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496101888:0@lo:8:kworker.0 00000400:00000100:2.0:1790773331.278876:0:3603:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877761496101888 offset 0 length 520: 4 00000100:00100000:2.0:1790773331.278886:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496102016:0@lo:8:kworker.0 00000400:00000100:2.0:1790773331.278901:0:3603:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877761496102016 offset 0 length 520: 4 00000100:00100000:2.0:1790773331.278927:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496102272:0@lo:400:kworker.0 00000100:00100000:2.0:1790773331.278935:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3607:1877761496101632:0@lo:400:kworker.0 00010000:00080000:2.0:1790773331.278945:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d27f9f4000 x1877761496102400/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773331.278953:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877761496102400:0@lo:400:kworker.0 00000100:00100000:1.0:1790773331.279399:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790773331.284031:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144547100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496102528:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790773331.285360:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773331.285525:0:17127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496102528 00000100:00100000:3.0:1790773331.285534:0:17127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496102528 00000100:00100000:3.0:1790773331.285593:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790773331.285604:0:17127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3605:x1877761496102528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790773331.285645:0:17127:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1790773331.285698:0:17127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3605:x1877761496102528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773331.285705:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790773331.285793:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144547100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496102528:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1790773332.182233:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790773332.309141:0:17855:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000040:00080000:1.0:1790773332.943073:0:17873:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790773333.201744:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773334.222406:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790773334.531946:0:18623:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790773334.531951:0:18623:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1790773334.531952:0:18623:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1790773334.532085:0:18623:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93d26be90800 00000020:01000004:2.0:1790773334.532101:0:18623:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1790773334.532115:0:18623:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1790773334.532292:0:18623:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff93d262660000) 00000020:00000080:2.0:1790773334.532311:0:18623:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1790773334.593586:0:18623:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1790773334.597271:0:18623:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1790773334.597659:0:18623:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1790773334.598425:0:18623:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1790773334.598662:0:18623:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1790773334.599034:0:18623:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1790773334.599576:0:18623:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:1.0:1790773334.601103:0:18623:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1790773334.601470:0:18623:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1790773334.601484:0:18623:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:1.0:1790773334.601495:0:18623:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xabf1cc0bc7842c7c 00000020:01000004:1.0:1790773334.601502:0:18623:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1790773334.601524:0:18623:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.119@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1790773334.601527:0:18623:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.119@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1790773334.601533:0:18623:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1790773334.601538:0:18623:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1790773334.601550:0:18623:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff93d26bfc4d40) 00000020:00000080:1.0:1790773334.601562:0:18623:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:1.0:1790773334.604648:0:18623:0:(service.c:173:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790773334.604848:0:18623:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1790773334.604855:0:18623:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1790773334.617505:0:18623:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1790773334.617514:0:18623:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1790773334.617848:0:18623:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1790773334.617854:0:18623:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1790773334.620124:0:18623:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790773334.620532:0:18623:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1790773334.620537:0:18623:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1790773334.621180:0:18623:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1790773334.621185:0:18623:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1790773334.642159:0:18623:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790773334.642473:0:18623:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1790773334.642491:0:18623:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1790773334.645354:0:18623:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1790773334.645368:0:18623:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1790773334.646605:0:18623:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1790773334.646619:0:18623:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1790773334.651194:0:18623:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790773334.651651:0:18623:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1790773334.651665:0:18623:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1790773334.653508:0:18623:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1790773334.653519:0:18623:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1790773334.692410:0:18623:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790773334.692634:0:18623:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1790773334.692651:0:18623:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1790773334.694494:0:18623:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1790773334.694505:0:18623:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1790773334.695313:0:18623:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1790773334.695354:0:18623:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1790773334.695362:0:18623:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.119@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1790773334.708249:0:18623:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.119@tcp ctxt 0 is initialized 00000020:01000004:0.0:1790773334.708321:0:18623:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.119@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1790773334.708326:0:18623:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1790773334.708328:0:18623:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790773334.708329:0:18623:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790773334.708331:0:18623:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790773334.708332:0:18623:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790773334.708333:0:18623:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790773334.708335:0:18623:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790773334.708337:0:18623:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790773334.708338:0:18623:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790773334.708350:0:18623:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1790773334.708353:0:18623:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790773334.708354:0:18623:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790773334.708355:0:18623:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790773334.708356:0:18623:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790773334.708358:0:18623:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790773334.708359:0:18623:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790773334.708360:0:18623:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790773334.708361:0:18623:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790773334.708362:0:18623:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790773334.708397:0:18623:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1790773334.708420:0:18623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:18623:1877761496102656:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1790773334.708493:0:18623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773334.708542:0:18623:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26efccd80 going to sleep for 11 seconds 00000100:00100000:1.0:1790773334.708623:0:17116:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496102656 00000100:00100000:1.0:1790773334.708633:0:17116:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496102656 00000100:00100000:1.0:1790773334.708689:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790773334.708699:0:17116:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+18:18623:x1877761496102656:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790773334.708729:0:17116:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1790773334.708732:0:17116:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1790773334.708736:0:17116:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1790773334.709715:0:17116:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+18:18623:x1877761496102656:12345-0@lo:253:mount.lustre.0 Request processed in 1013us (1217us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773334.709725:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790773334.709817:0:18623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:18623:1877761496102656:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1790773334.709828:0:18623:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1790773334.709831:0:18623:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790773334.709832:0:18623:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790773334.709833:0:18623:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790773334.709835:0:18623:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790773334.709836:0:18623:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790773334.709837:0:18623:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790773334.709838:0:18623:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790773334.709840:0:18623:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790773334.709853:0:18623:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1790773334.709870:0:18623:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93d26be90800 from lustre-OST0000 10000000:01000000:0.0:1790773334.709896:0:18623:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1790773334.709910:0:18623:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1790773334.709918:0:18623:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93d281ba99c0 local copy 00010000:00010000:0.0:1790773334.709928:0:18623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12bc00/0xabf1cc0bc7842a37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842a3e expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773334.710018:0:18623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:18623:1877761496102784:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790773334.710066:0:18623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773334.710098:0:18623:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26efcc240 going to sleep for 11 seconds 00000100:00100000:1.0:1790773334.710378:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496102784 00000100:00100000:1.0:1790773334.710384:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496102784 00000100:00100000:1.0:1790773334.710417:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790773334.710425:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+18:18623:x1877761496102784:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790773334.710507:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+18:18623:x1877761496102784:12345-0@lo:501:mount.lustre.0 Request processed in 83us (441us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790773334.710525:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790773334.710595:0:18623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:18623:1877761496102784:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1790773334.710611:0:18623:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.119@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1790773334.710632:0:18623:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.119@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1790773334.710638:0:18623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12bc00/0xabf1cc0bc7842a37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842a3e expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773334.710648:0:18623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d27b12bc00/0xabf1cc0bc7842a37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842a3e expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773334.710673:0:18623:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93d26be90800 10000000:01000000:3.0:1790773334.710678:0:18623:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790773334.710685:0:18623:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1790773334.710687:0:18623:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790773334.710691:0:18623:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1790773334.710694:0:18623:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1790773334.710716:0:18623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d1434ad600/0xabf1cc0bc7842c8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773334.710724:0:18623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d1434ad600/0xabf1cc0bc7842c8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773334.710740:0:18623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d1434ad600/0xabf1cc0bc7842c8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773334.710754:0:18623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144546300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:18623:1877761496102912:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790773334.710782:0:18623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773334.710818:0:18623:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d252f7db40 going to sleep for 11 seconds 00000100:00100000:0.0:1790773334.711045:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496102912 00000100:00100000:0.0:1790773334.711051:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496102912 00000100:00100000:0.0:1790773334.711124:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790773334.711142:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+18:18623:x1877761496102912:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790773334.711152:0:17117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773334.711165:0:17117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d25074bc00/0xabf1cc0bc7842c91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7842c8a expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773334.711184:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d25074bc00/0xabf1cc0bc7842c91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7842c8a expref: 19 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773334.711194:0:17117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d25074bc00/0xabf1cc0bc7842c91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7842c8a expref: 19 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773334.711223:0:17117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074bc00, rc 0) 00000100:00100000:0.0:1790773334.711258:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+19:18623:x1877761496102912:12345-0@lo:101:mount.lustre.0 Request processed in 117us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773334.711264:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790773334.711596:0:18623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144546300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:18623:1877761496102912:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790773334.711609:0:18623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d1434ad600/0xabf1cc0bc7842c8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842c91 expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773334.711618:0:18623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d1434ad600/0xabf1cc0bc7842c8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7842c91 expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790773334.713425:0:18623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1790773334.714201:0:18623:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790773334.717417:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1790773334.717475:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1790773334.717493:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1790773334.717508:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1790773334.717524:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1790773334.717539:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1790773334.717566:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1790773334.717573:0:18623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1790773334.717675:0:18623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144546300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:18623:1877761496103040:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790773334.717742:0:18623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773334.717919:0:18623:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d252f7d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790773334.718023:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496103040 00000100:00100000:1.0:1790773334.718031:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496103040 00000100:00100000:1.0:1790773334.718374:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790773334.718384:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+19:18623:x1877761496103040:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790773334.718559:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+19:18623:x1877761496103040:12345-0@lo:501:mount.lustre.0 Request processed in 175us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773334.718568:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790773334.718656:0:18623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144546300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:18623:1877761496103040:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790773334.718712:0:18623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144546300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:18623:1877761496103168:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790773334.718760:0:18623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773334.718869:0:18623:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d252f7d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790773334.719198:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496103168 00000100:00100000:0.0:1790773334.719278:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496103168 00000100:00100000:0.0:1790773334.719306:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790773334.719313:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+19:18623:x1877761496103168:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790773334.722455:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+19:18623:x1877761496103168:12345-0@lo:503:mount.lustre.0 Request processed in 3131us (3683us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773334.722472:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790773334.722689:0:18623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144546300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:18623:1877761496103168:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790773334.723403:0:18623:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790773334.723496:0:18623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144546300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:18623:1877761496103296:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790773334.723560:0:18623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773334.723596:0:18623:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d252f7db40 going to sleep for 11 seconds 00000100:00100000:0.0:1790773334.723793:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496103296 00000100:00100000:0.0:1790773334.723811:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496103296 00000100:00100000:0.0:1790773334.723852:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1790773334.723861:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+19:18623:x1877761496103296:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790773334.724736:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+19:18623:x1877761496103296:12345-0@lo:502:mount.lustre.0 Request processed in 870us (1169us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773334.724749:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790773334.725001:0:18623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144546300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:18623:1877761496103296:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790773334.725429:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1790773334.725462:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1790773334.725476:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1790773334.725489:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1790773334.725519:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1790773334.725534:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1790773334.725546:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1790773334.725557:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1790773334.725568:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1790773334.725579:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1790773334.725591:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1790773334.725603:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1790773334.725638:0:18623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144546300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:18623:1877761496103424:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790773334.725693:0:18623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773334.725783:0:18623:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d252f7db40 going to sleep for 11 seconds 00000100:00100000:0.0:1790773334.726067:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496103424 00000100:00100000:0.0:1790773334.726075:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496103424 00000100:00100000:1.0:1790773334.726274:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790773334.726288:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143066850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+19:18623:x1877761496103424:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790773334.726418:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143066850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+19:18623:x1877761496103424:12345-0@lo:502:mount.lustre.0 Request processed in 134us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773334.726426:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790773334.726628:0:18623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144546300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:18623:1877761496103424:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790773334.726691:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1790773334.726709:0:18623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1790773334.727675:0:18640:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790773334.727683:0:18640:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1790773334.727691:0:18640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773334.727693:0:18640:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1790773334.727699:0:18640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790773334.727715:0:18640:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff93d27b2c4d40) 00000020:00000080:3.0:1790773334.727738:0:18640:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1790773334.727744:0:18640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1790773334.727975:0:18640:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93d26be90800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1790773334.727986:0:18640:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:3.0:1790773334.727993:0:18640:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xabf1cc0bc7842c9f 00010000:00010000:3.0:1790773334.735355:0:18640:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:3.0:1790773334.735765:0:18640:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:3.0:1790773334.738328:0:18640:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:3.0:1790773334.740991:0:18640:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1790773334.741006:0:18640:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790773334.741013:0:18640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773334.741015:0:18640:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1790773334.741019:0:18640:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1790773334.741022:0:18640:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:3.0:1790773334.741024:0:18640:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790773334.741026:0:18640:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790773334.741027:0:18640:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1790773334.741030:0:18640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773334.741031:0:18640:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:3.0:1790773334.741033:0:18640:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790773334.741104:0:18640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773334.741106:0:18640:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790773334.741110:0:18640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790773334.741113:0:18640:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1790773334.741116:0:18640:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790773334.741118:0:18640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773334.741196:0:18640:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:3.0:1790773334.741201:0:18640:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790773334.741231:0:18640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773334.741233:0:18640:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1790773334.741238:0:18640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1790773334.741269:0:18640:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790773334.741272:0:18640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773334.741273:0:18640:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1790773334.741276:0:18640:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1790773334.741502:0:18623:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1790773334.741541:0:18623:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1790773334.741561:0:18623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d1434ad600/0xabf1cc0bc7842c8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842c91 expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773334.741573:0:18623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d1434ad600/0xabf1cc0bc7842c8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842c91 expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790773334.741581:0:18623:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d26be90800 from 1 10000000:01000000:2.0:1790773334.741584:0:18623:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790773334.741624:0:18623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26efc5400/0xabf1cc0bc7842ca6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773334.741632:0:18623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d26efc5400/0xabf1cc0bc7842ca6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773334.741644:0:18623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d26efc5400/0xabf1cc0bc7842ca6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773334.741669:0:18623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:18623:1877761496103552:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790773334.741739:0:18623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773334.741787:0:17116:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496103552 00000100:00100000:2.0:1790773334.741868:0:17116:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496103552 00000100:00100000:2.0:1790773334.742003:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790773334.742012:0:17116:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143067050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+19:18623:x1877761496103552:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790773334.742027:0:17116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773334.742108:0:17116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d26efc4c00/0xabf1cc0bc7842cad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7842ca6 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773334.742294:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d26efc4c00/0xabf1cc0bc7842cad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7842ca6 expref: 20 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773334.742306:0:17116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d26efc4c00/0xabf1cc0bc7842cad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7842ca6 expref: 20 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773334.742315:0:17116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26efc4c00, rc 0) 00000100:00100000:2.0:1790773334.742369:0:17116:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143067050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+20:18623:x1877761496103552:12345-0@lo:101:mount.lustre.0 Request processed in 357us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773334.742376:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790773334.742424:0:18623:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d247f40480 going to sleep for 11 seconds 00000100:00100000:2.0:1790773334.742448:0:18623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:18623:1877761496103552:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790773334.742464:0:18623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d26efc5400/0xabf1cc0bc7842ca6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842cad expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773334.742474:0:18623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d26efc5400/0xabf1cc0bc7842ca6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7842cad expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790773334.744891:0:18623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1790773334.745591:0:18623:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790773334.747297:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1790773334.747351:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1790773334.747374:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1790773334.747379:0:18623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1790773334.747472:0:18623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:18623:1877761496103680:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790773334.747539:0:18623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773334.747579:0:18623:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26c742e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790773334.748034:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496103680 00000100:00100000:3.0:1790773334.748043:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496103680 00000100:00100000:3.0:1790773334.748091:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790773334.748100:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143067450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+20:18623:x1877761496103680:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790773334.748248:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143067450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+20:18623:x1877761496103680:12345-0@lo:501:mount.lustre.0 Request processed in 149us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773334.748256:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790773334.749116:0:18623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:18623:1877761496103680:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790773334.750365:0:18623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:18623:1877761496103808:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790773334.750435:0:18623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773334.750476:0:18623:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26c742e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790773334.750882:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496103808 00000100:00100000:0.0:1790773334.750890:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496103808 00000100:00100000:0.0:1790773334.750994:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790773334.751003:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143065450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+20:18623:x1877761496103808:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790773334.751411:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143065450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+20:18623:x1877761496103808:12345-0@lo:503:mount.lustre.0 Request processed in 408us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773334.751419:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790773334.751884:0:18623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:18623:1877761496103808:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790773334.752583:0:18623:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790773334.752685:0:18623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:18623:1877761496103936:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790773334.752744:0:18623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773334.752782:0:18623:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27b0d0300 going to sleep for 11 seconds 00000100:00100000:0.0:1790773334.753934:0:17116:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496103936 00000100:00100000:0.0:1790773334.753945:0:17116:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496103936 00000100:00100000:0.0:1790773334.753998:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1790773334.754008:0:17116:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143067850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+20:18623:x1877761496103936:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790773334.757542:0:17116:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143067850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+20:18623:x1877761496103936:12345-0@lo:502:mount.lustre.0 Request processed in 3527us (4790us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773334.757563:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790773334.757677:0:18623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:18623:1877761496103936:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790773334.757936:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1790773334.757970:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1790773334.757985:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1790773334.757998:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1790773334.758012:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1790773334.758025:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1790773334.758050:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1790773334.758066:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1790773334.758078:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1790773334.758092:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1790773334.758106:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1790773334.758399:0:18623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:18623:1877761496104064:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790773334.758465:0:18623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773334.758502:0:18623:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d247f40480 going to sleep for 11 seconds 00000100:00100000:0.0:1790773334.758653:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496104064 00000100:00100000:0.0:1790773334.758660:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496104064 00000100:00100000:0.0:1790773334.758710:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1790773334.758718:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143064850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+20:18623:x1877761496104064:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790773334.758834:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143064850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+20:18623:x1877761496104064:12345-0@lo:502:mount.lustre.0 Request processed in 116us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773334.758842:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790773334.759071:0:18623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:18623:1877761496104064:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790773334.759644:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1790773334.759667:0:18623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1790773334.761879:0:18644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790773334.761892:0:18644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790773334.761894:0:18644:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1790773334.761970:0:18644:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93d26be90800 00000020:00000080:1.0:1790773334.761974:0:18644:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790773334.761983:0:18644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790773334.761986:0:18644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790773334.761987:0:18644:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1790773334.761990:0:18644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790773334.761992:0:18644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790773334.761994:0:18644:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790773334.761996:0:18644:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93d26be90800 00000020:00000080:1.0:1790773334.761998:0:18644:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790773334.762150:0:18644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790773334.762154:0:18644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790773334.762162:0:18644:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1790773334.762165:0:18644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790773334.762168:0:18644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790773334.762169:0:18644:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790773334.762172:0:18644:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93d26be90800 00000020:00000080:1.0:1790773334.762174:0:18644:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790773334.767328:0:18644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790773334.767350:0:18644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790773334.767353:0:18644:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790773334.767357:0:18644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790773334.767361:0:18644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790773334.767363:0:18644:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1790773334.767368:0:18644:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93d26be90800 00000020:00000080:1.0:1790773334.767371:0:18644:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790773334.767433:0:18644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790773334.767437:0:18644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790773334.767439:0:18644:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1790773334.767442:0:18644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1790773334.774662:0:18623:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1790773334.774716:0:18623:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790773334.774746:0:18623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26efc5400/0xabf1cc0bc7842ca6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842cad expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773334.774759:0:18623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d26efc5400/0xabf1cc0bc7842ca6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842cad expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773334.774826:0:18623:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790773334.774830:0:18623:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93d26be90800 10000000:01000000:3.0:1790773334.774833:0:18623:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93d26be90800 10000000:01000000:3.0:1790773334.774837:0:18623:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790773334.774843:0:18623:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93d26be90800 from 1 10000000:01000000:3.0:1790773334.774846:0:18623:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790773334.774886:0:18623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d1434ac800/0xabf1cc0bc7842cb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773334.774919:0:18623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d1434ac800/0xabf1cc0bc7842cb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773334.774931:0:18623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d1434ac800/0xabf1cc0bc7842cb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773334.774956:0:18623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144546300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:18623:1877761496104192:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790773334.775029:0:18623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773334.777984:0:17116:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496104192 00000100:00100000:0.0:1790773334.778002:0:17116:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496104192 00000100:00100000:0.0:1790773334.778079:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1790773334.778090:0:17116:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143067c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+20:18623:x1877761496104192:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790773334.778108:0:17116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773334.778139:0:17116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d25074b000/0xabf1cc0bc7842cbb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7842cb4 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773334.778170:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d25074b000/0xabf1cc0bc7842cbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7842cb4 expref: 21 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773334.778180:0:17116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d25074b000/0xabf1cc0bc7842cbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7842cb4 expref: 21 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773334.778189:0:17116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074b000, rc 0) 00000100:00100000:0.0:1790773334.778282:0:17116:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143067c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+21:18623:x1877761496104192:12345-0@lo:101:mount.lustre.0 Request processed in 193us (3252us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773334.778289:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1790773334.781080:0:18623:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d246b25cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790773334.781124:0:18623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144546300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:18623:1877761496104192:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790773334.781164:0:18623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d1434ac800/0xabf1cc0bc7842cb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842cbb expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773334.781177:0:18623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d1434ac800/0xabf1cc0bc7842cb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7842cbb expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790773334.784430:0:18623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1790773334.784765:0:18623:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790773334.787532:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1790773334.787571:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1790773334.787588:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1790773334.787616:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1790773334.787629:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1790773334.787641:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1790773334.787652:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1790773334.787665:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1790773334.787679:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1790773334.787692:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1790773334.787716:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1790773334.787729:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1790773334.787742:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1790773334.787755:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1790773334.787769:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1790773334.787781:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1790773334.787793:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1790773334.797297:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1790773334.797370:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1790773334.797408:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1790773334.797426:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1790773334.797441:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1790773334.797456:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1790773334.797470:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1790773334.797483:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1790773334.797496:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1790773334.797510:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1790773334.797522:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1790773334.797535:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1790773334.797551:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1790773334.797566:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1790773334.797578:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1790773334.797591:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1790773334.797603:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1790773334.797615:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1790773334.797644:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1790773334.797660:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1790773334.797688:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1790773334.797693:0:18623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1790773334.797829:0:18623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144546300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:18623:1877761496104320:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790773334.797900:0:18623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773334.797946:0:18623:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d246b259c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790773334.800856:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496104320 00000100:00100000:1.0:1790773334.800874:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496104320 00000100:00100000:1.0:1790773334.800964:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790773334.800974:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143064050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+21:18623:x1877761496104320:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790773334.801183:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143064050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+21:18623:x1877761496104320:12345-0@lo:501:mount.lustre.0 Request processed in 210us (3283us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773334.801192:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1790773334.804734:0:18623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144546300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:18623:1877761496104320:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790773334.804824:0:18623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144546300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:18623:1877761496104448:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790773334.804910:0:18623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773334.804955:0:18623:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d246b259c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790773334.806460:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496104448 00000100:00100000:1.0:1790773334.806472:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496104448 00000100:00100000:1.0:1790773334.806542:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1790773334.806552:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143064450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+21:18623:x1877761496104448:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790773334.806697:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143064450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+21:18623:x1877761496104448:12345-0@lo:503:mount.lustre.0 Request processed in 147us (1799us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773334.806712:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790773334.806880:0:18623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144546300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:18623:1877761496104448:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790773334.807654:0:18623:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790773334.807741:0:18623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144546300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:18623:1877761496104576:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790773334.807855:0:18623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773334.807952:0:18623:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d246b25cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790773334.822061:0:17116:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496104576 00000100:00100000:1.0:1790773334.822077:0:17116:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496104576 00000100:00100000:1.0:1790773334.822142:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1790773334.822153:0:17116:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143065050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+21:18623:x1877761496104576:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790773334.822362:0:17116:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143065050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+21:18623:x1877761496104576:12345-0@lo:502:mount.lustre.0 Request processed in 211us (14507us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773334.822371:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790773334.825618:0:18623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144546300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:18623:1877761496104576:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790773334.826334:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1790773334.826381:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1790773334.826399:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1790773334.826412:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1790773334.826425:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1790773334.826439:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1790773334.826453:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1790773334.826466:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1790773334.826478:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1790773334.826491:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1790773334.826503:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1790773334.826534:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1790773334.826549:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1790773334.826561:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1790773334.826573:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1790773334.826584:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1790773334.826596:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1790773334.826608:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1790773334.826632:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1790773334.826644:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1790773334.826659:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1790773334.826672:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1790773334.826686:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1790773334.826700:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1790773334.826712:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1790773334.826725:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1790773334.826738:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1790773334.826766:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1790773334.826781:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1790773334.829011:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1790773334.830259:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1790773334.830292:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1790773334.830307:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1790773334.830320:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1790773334.830334:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1790773334.830360:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1790773334.830375:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1790773334.830388:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1790773334.830401:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1790773334.830414:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1790773334.830428:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1790773334.830441:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1790773334.830456:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1790773334.830490:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1790773334.830504:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1790773334.830515:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1790773334.830528:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1790773334.830541:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1790773334.830598:0:18623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144546300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:18623:1877761496104704:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790773334.830682:0:18623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773334.830743:0:18623:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d246b25cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790773334.831602:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496104704 00000100:00100000:0.0:1790773334.831618:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496104704 00000100:00100000:0.0:1790773334.831721:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1790773334.831731:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143065c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+21:18623:x1877761496104704:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790773334.831890:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143065c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+21:18623:x1877761496104704:12345-0@lo:502:mount.lustre.0 Request processed in 161us (1208us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773334.831908:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1790773334.833201:0:18623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144546300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:18623:1877761496104704:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790773334.833459:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1790773334.833487:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1790773334.833524:0:18623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:18623:1877761496104832:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790773334.833591:0:18623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773334.833631:0:18623:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d14323a300 going to sleep for 11 seconds 00000100:00100000:0.0:1790773334.834261:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496104832 00000100:00100000:0.0:1790773334.834271:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496104832 00000100:00100000:0.0:1790773334.834313:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1790773334.834321:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143066450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+21:18623:x1877761496104832:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790773334.834446:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143066450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+21:18623:x1877761496104832:12345-0@lo:502:mount.lustre.0 Request processed in 124us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773334.834454:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1790773334.834722:0:18623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:18623:1877761496104832:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790773334.834780:0:18623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1790773334.834791:0:18623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1790773334.843256:0:18650:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1790773334.843272:0:18650:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff93d26bfc3380) 00000020:00000080:1.0:1790773334.843292:0:18650:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1790773334.843387:0:18650:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93d26be90800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1790773334.843392:0:18650:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93d26be90800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1790773334.843394:0:18650:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93d26be90800 3 00010000:00080000:1.0:1790773334.843435:0:18650:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d143389000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.119@tcp at head 00010000:00010000:1.0:1790773334.844897:0:18650:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1790773334.845089:0:18650:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1790773334.845126:0:18650:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1790773334.845137:0:18650:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xabf1cc0bc7842cc9 00000100:00080000:1.0:1790773334.845146:0:18650:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790773334.845155:0:18650:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d143389000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:1.0:1790773334.845189:0:18650:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d2526cdf80 x1877761496104960/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790773334.845232:0:18650:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1790773334.845295:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790773334.845300:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790773334.845303:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790773334.845305:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790773334.845340:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790773334.845362:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790773334.845365:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790773334.845367:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790773334.845417:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144545c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3604:1877761496105472:0@lo:400:kworker.0 00000100:00100000:2.0:1790773334.845495:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3603:1877761496104960:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790773334.845498:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773334.845536:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790773334.845543:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144547480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496105088:0@lo:400:kworker.0 00000100:00100000:2.0:1790773334.845724:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773334.846483:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773334.846522:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144547800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3606:1877761496105216:0@lo:400:kworker.0 00000100:00100000:3.0:1790773334.846550:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773334.846570:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790773334.846575:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144545180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496105344:0@lo:400:kworker.0 00000100:00100000:3.0:1790773334.846596:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773334.846650:0:17123:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496105472 00000100:00100000:1.0:1790773334.846650:0:17128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496105088 00000100:00100000:1.0:1790773334.846657:0:17128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496105088 00000100:00100000:3.0:1790773334.846658:0:17123:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496105472 00000100:00100000:3.0:1790773334.846686:0:17123:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496104960 00000100:00100000:3.0:1790773334.846689:0:17123:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496104960 00000100:00100000:1.0:1790773334.846689:0:17128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496105344 00000100:00100000:3.0:1790773334.846697:0:17123:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496105216 00000100:00100000:1.0:1790773334.846697:0:17128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496105344 00000100:00100000:3.0:1790773334.846699:0:17123:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496105216 00000100:00100000:1.0:1790773334.846715:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790773334.846717:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790773334.846723:0:17123:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144546300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3604:x1877761496105472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773334.846723:0:17128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144547100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496105088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773334.846783:0:17123:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144546300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3604:x1877761496105472:12345-0@lo:400:kworker.0 Request processed in 61us (1285us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773334.846783:0:17128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144547100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496105088:12345-0@lo:400:kworker.0 Request processed in 60us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773334.846791:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790773334.846792:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790773334.846806:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790773334.846811:0:17123:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144544a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1877761496105216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773334.846844:0:17123:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144544a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1877761496105216:12345-0@lo:400:kworker.0 Request processed in 33us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773334.846851:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790773334.846862:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790773334.846865:0:17123:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3603:x1877761496104960:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1790773334.846886:0:17123:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 477 last 0 00000100:00100000:1.0:1790773334.846929:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790773334.846935:0:17128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144544380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496105344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773334.846965:0:17128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144544380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496105344:12345-0@lo:400:kworker.0 Request processed in 31us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773334.846971:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000020:00000080:3.0:1790773334.846993:0:17123:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xabf1cc0bc7842cd0 00000004:00100000:3.0:1790773334.847009:0:17123:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1790773334.847106:0:17123:0:(import.c:65:import_set_state_nolock()) ffff93d14328c000 : changing import state from RECOVER to FULL 00000020:01000004:0.0:1790773334.847113:0:18650:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1790773334.847127:0:18650:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff93d279ea19c0) 00000020:00000080:0.0:1790773334.847145:0:18650:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000100:00100000:3.0:1790773334.847280:0:17123:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3603:x1877761496104960:12345-0@lo:38:llog_process_th.0 Request processed in 412us (1556us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773334.847288:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:0.0:1790773334.847384:0:18650:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93d26be90800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1790773334.847390:0:18650:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93d26be90800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1790773334.847393:0:18650:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93d26be90800 3 00010000:00080000:0.0:1790773334.847428:0:18650:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d1431fa800@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.119@tcp at head 00000100:00100000:3.0:1790773334.847498:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144545180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496105344:0@lo:400:kworker.0 00010000:00080000:3.0:1790773334.847512:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d144547800 x1877761496105216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773334.847522:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144547800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3606:1877761496105216:0@lo:400:kworker.0 00000100:00100000:3.0:1790773334.847553:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144547480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496105088:0@lo:400:kworker.0 00010000:00080000:3.0:1790773334.847574:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d144545c00 x1877761496105472/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773334.847583:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144545c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3604:1877761496105472:0@lo:400:kworker.0 00010000:00080000:2.0:1790773334.847765:0:3603:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d2526cdf80 x1877761496104960/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790773344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773334.847773:0:3603:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790773334.847779:0:3603:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1790773334.847787:0:3603:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1790773334.847791:0:3603:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790773334.847793:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d143389000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790773334.847809:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3603:1877761496104960:0@lo:38:llog_process_th.0 00010000:00010000:0.0:1790773334.851491:0:18650:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:0.0:1790773334.851766:0:18650:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1790773334.851819:0:18650:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790773334.851831:0:18650:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xabf1cc0bc7842cde 00000100:00080000:0.0:1790773334.851841:0:18650:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790773334.851852:0:18650:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff93d1431fa800 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:0.0:1790773334.851887:0:18650:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d143cc7b80 x1877761496105600/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790773334.851922:0:18650:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1790773334.851971:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3603:1877761496105600:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790773334.852226:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790773334.852288:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790773334.852293:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790773334.852296:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790773334.852299:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790773334.852303:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790773334.852306:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790773334.852308:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790773334.852311:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790773334.852452:0:17122:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496105600 00000100:00100000:0.0:1790773334.852460:0:17122:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496105600 00000100:00100000:0.0:1790773334.852490:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790773334.852498:0:17122:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3603:x1877761496105600:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1790773334.852525:0:17122:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 477 last 0 00000020:00000080:0.0:1790773334.852559:0:17122:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xabf1cc0bc7842ce5 00000004:00100000:0.0:1790773334.852574:0:17122:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790773334.852606:0:17122:0:(import.c:65:import_set_state_nolock()) ffff93d1431fd800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790773334.852660:0:17122:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3603:x1877761496105600:12345-0@lo:38:llog_process_th.0 Request processed in 160us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773334.852857:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1790773334.852907:0:3603:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d143cc7b80 x1877761496105600/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790773344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773334.852918:0:3603:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790773334.852926:0:3603:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1790773334.852933:0:3603:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1790773334.852937:0:3603:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1790773334.852939:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d1431fa800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790773334.852945:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3603:1877761496105600:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1790773334.853268:0:18650:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:3.0:1790773334.854023:0:18623:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1790773334.854065:0:18623:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790773334.854091:0:18623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d1434ac800/0xabf1cc0bc7842cb4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842cbb expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773334.854103:0:18623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d1434ac800/0xabf1cc0bc7842cb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842cbb expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1790773334.854282:0:18623:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1790773334.854284:0:18623:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790773334.854286:0:18623:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790773334.854287:0:18623:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790773334.854288:0:18623:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790773334.854289:0:18623:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790773334.854291:0:18623:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790773334.854293:0:18623:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790773334.854294:0:18623:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790773334.854297:0:18623:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1790773334.854300:0:18623:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790773334.854301:0:18623:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790773334.854302:0:18623:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790773334.854303:0:18623:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790773334.854304:0:18623:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790773334.854305:0:18623:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790773334.854306:0:18623:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790773334.854307:0:18623:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790773334.854308:0:18623:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790773334.854340:0:18623:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1790773334.854496:0:18623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144545c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:18623:1877761496105728:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790773334.854558:0:18623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773334.854603:0:18623:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d246b25240 going to sleep for 11 seconds 00000100:00100000:1.0:1790773334.855279:0:17116:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496105728 00000100:00100000:1.0:1790773334.855288:0:17116:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496105728 00000100:00100000:1.0:1790773334.855350:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1790773334.855360:0:17116:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143065850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+21:18623:x1877761496105728:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790773334.855388:0:17116:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1790773334.855403:0:17116:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1790773334.860803:0:17116:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1790773334.860826:0:17116:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1790773334.860964:0:17138:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790773334.860970:0:17138:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790773334.860994:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93d1434acc00/0xabf1cc0bc7842cec lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773334.861013:0:17138:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d1434adc00/0xabf1cc0bc7842c36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7842c2f expref: 21 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773334.861021:0:17138:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d25074b200/0xabf1cc0bc7842c44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7842c3d expref: 21 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773334.861029:0:17138:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93d1434acc00/0xabf1cc0bc7842cec lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773334.861149:0:17138:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d25074b200/0xabf1cc0bc7842c44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc7842c3d expref: 21 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773334.861165:0:17138:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d25074b200/0xabf1cc0bc7842c44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc7842c3d expref: 21 pid: 17117 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773334.861180:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144547480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17138:1877761496105856:0@lo:104: 00000100:00100000:3.0:1790773334.861260:0:17138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790773334.861307:0:17138:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d1434adc00/0xabf1cc0bc7842c36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc7842c2f expref: 21 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773334.861315:0:17138:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d1434adc00/0xabf1cc0bc7842c36 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc7842c2f expref: 21 pid: 17115 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773334.861324:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144545180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17138:1877761496105984:0@lo:104: 00000100:00100000:3.0:1790773334.861789:0:17138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773334.862952:0:17116:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143065850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+21:18623:x1877761496105728:12345-0@lo:253:mount.lustre.0 Request processed in 7589us (8389us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773334.862965:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1790773334.863879:0:17105:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1790773334.863908:0:17105:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496105856 00000100:00100000:2.0:1790773334.863918:0:17105:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496105856 00000100:00100000:2.0:1790773334.863954:0:17105:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496105984 00000100:00100000:2.0:1790773334.863965:0:17105:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496105984 00000100:00100000:2.0:1790773334.863987:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790773334.863997:0:17105:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144547800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+4:17138:x1877761496105856:12345-0@lo:104: 00010000:00010000:2.0:1790773334.864016:0:17105:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d27b12ba00/0xabf1cc0bc7842c3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7842c44 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773334.864705:0:17105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790773334.864715:0:17105:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144547800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+4:17138:x1877761496105856:12345-0@lo:104: Request processed in 719us (3454us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773334.864723:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790773334.864746:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790773334.864753:0:17105:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c47c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+3:17138:x1877761496105984:12345-0@lo:104: 00010000:00010000:2.0:1790773334.864763:0:17105:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d27b12aa00/0xabf1cc0bc7842c2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7842c36 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773334.864939:0:17105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790773334.864945:0:17105:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c47c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+3:17138:x1877761496105984:12345-0@lo:104: Request processed in 193us (3157us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773334.864952:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1790773334.865060:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790773334.865067:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d27b12ba00/0xabf1cc0bc7842c3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7842c44 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773334.865076:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12ba00 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:2.0:1790773334.865081:0:17110:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d27b12ba00/0xabf1cc0bc7842c3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc7842c44 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773334.865091:0:17110:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d27b12ba00/0xabf1cc0bc7842c3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc7842c44 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790773334.865113:0:17110:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d27b12ba00/0xabf1cc0bc7842c3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc7842c44 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790773334.865119:0:17110:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790773334.865159:0:17110:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d27b12ba00/0xabf1cc0bc7842c3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7842c44 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773334.865167:0:17110:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790773334.865195:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d27b12ba00/0xabf1cc0bc7842c3d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7842c44 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773334.865224:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d27b12ba00/0xabf1cc0bc7842c3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7842c44 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773334.865236:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790773334.865240:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d27b12aa00/0xabf1cc0bc7842c2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7842c36 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773334.865246:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12aa00 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:2.0:1790773334.865249:0:17110:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d27b12aa00/0xabf1cc0bc7842c2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc7842c36 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773334.865256:0:17110:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d27b12aa00/0xabf1cc0bc7842c2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc7842c36 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790773334.865263:0:17110:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d27b12aa00/0xabf1cc0bc7842c2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc7842c36 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790773334.865268:0:17110:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790773334.865288:0:17110:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d27b12aa00/0xabf1cc0bc7842c2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7842c36 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773334.865294:0:17110:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790773334.865308:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d27b12aa00/0xabf1cc0bc7842c2f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7842c36 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773334.865315:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d27b12aa00/0xabf1cc0bc7842c2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7842c36 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773334.865328:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773334.865329:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773334.865331:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773334.865357:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3605:1877761496106112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790773334.865401:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790773334.865604:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773334.866369:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3606:1877761496106240:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790773334.866423:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773334.866564:0:18623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144545c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:18623:1877761496105728:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790773334.866578:0:18623:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1790773334.866581:0:18623:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790773334.866583:0:18623:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790773334.866584:0:18623:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790773334.866585:0:18623:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790773334.866587:0:18623:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790773334.866588:0:18623:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790773334.866589:0:18623:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790773334.866592:0:18623:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790773334.866593:0:18623:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790773334.866620:0:18623:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1790773334.866667:0:17138:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d246b25cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790773334.866682:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144547480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17138:1877761496105856:0@lo:104: 00000100:00100000:3.0:1790773334.866691:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144545180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17138:1877761496105984:0@lo:104: 00010000:00010000:3.0:1790773334.866707:0:17138:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93d1434acc00/0xabf1cc0bc7842cec lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773334.868631:0:17107:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496106112 00000100:00100000:1.0:1790773334.868645:0:17107:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496106112 00010000:00010000:1.0:1790773334.869083:0:17107:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d25074b200/0xabf1cc0bc7842c44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7842c3d expref: 21 pid: 17117 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773334.869155:0:17107:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496106240 00000100:00100000:1.0:1790773334.869160:0:17107:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496106240 00010000:00010000:1.0:1790773334.869173:0:17107:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d1434adc00/0xabf1cc0bc7842c36 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7842c2f expref: 22 pid: 17115 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773334.869201:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790773334.869228:0:17107:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+22:3605:x1877761496106112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790773334.869242:0:17107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790773334.869248:0:17107:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d25074b200/0xabf1cc0bc7842c44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7842c3d expref: 22 pid: 17117 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773334.869260:0:17107:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d25074b200/0xabf1cc0bc7842c44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc7842c3d expref: 22 pid: 17117 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773334.869277:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d25074b200/0xabf1cc0bc7842c44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc7842c3d expref: 22 pid: 17117 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773334.869292:0:17107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790773334.869383:0:17107:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+21:3605:x1877761496106112:12345-0@lo:103:ldlm_bl.0 Request processed in 156us (3981us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773334.869390:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790773334.869409:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790773334.869415:0:17107:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d280a71050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+20:3606:x1877761496106240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790773334.869424:0:17107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790773334.869429:0:17107:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d1434adc00/0xabf1cc0bc7842c36 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7842c2f expref: 20 pid: 17115 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773334.869438:0:17107:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d1434adc00/0xabf1cc0bc7842c36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc7842c2f expref: 20 pid: 17115 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773334.869448:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d1434adc00/0xabf1cc0bc7842c36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc7842c2f expref: 20 pid: 17115 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773334.869472:0:17107:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93d1434acc00/0xabf1cc0bc7842cec lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773334.869480:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d1434acc00/0xabf1cc0bc7842cec lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790773334.869497:0:17107:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008527124s 00010000:00010000:1.0:1790773334.869502:0:17107:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d1434acc00/0xabf1cc0bc7842cec lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773334.869508:0:17107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d1434acc00/0xabf1cc0bc7842cec lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773334.869514:0:17107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93d1434acc00/0xabf1cc0bc7842cec lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773334.869521:0:17107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93d1434acc00/0xabf1cc0bc7842cec lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773334.869528:0:17107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434acc00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:1.0:1790773334.869532:0:17107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93d1434acc00/0xabf1cc0bc7842cec lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773334.869540:0:17107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93d1434acc00/0xabf1cc0bc7842cec lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773334.869555:0:17107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93d1434acc00/0xabf1cc0bc7842cec lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773334.869564:0:17107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790773334.869598:0:17107:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d280a71050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+19:3606:x1877761496106240:12345-0@lo:103:ldlm_bl.0 Request processed in 184us (3175us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773334.869605:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790773334.869696:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3605:1877761496106112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790773334.869727:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3606:1877761496106240:0@lo:103:ldlm_bl.0 00000001:00000004:0.0:1790773334.869947:0:18623:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:3.0:1790773334.870064:0:17138:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93d1434acc00/0xabf1cc0bc7842cec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773334.870074:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93d1434acc00/0xabf1cc0bc7842cec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773334.870080:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d1434acc00/0xabf1cc0bc7842cec lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1790773334.874474:0:18623:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1790773334.874488:0:18623:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1790773334.874530:0:18623:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1790773334.874576:0:18623:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.119@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1790773334.874593:0:18623:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1790773334.874622:0:18623:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1790773334.875990:0:18623:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790773334.876400:0:18623:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1790773335.245368:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1790773335.769935:0:18702:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790773335.770962:0:18702:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1790773335.886632:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790773335.886655:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496106368:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790773335.886732:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773335.886781:0:17128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496106368 00000100:00100000:0.0:1790773335.886788:0:17128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496106368 00000100:00100000:0.0:1790773335.886834:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790773335.886842:0:17128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496106368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790773335.886875:0:17128:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1790773335.886920:0:17128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496106368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773335.886928:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790773335.886971:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496106368:0@lo:41:osp-pre-0-1.0 10000000:01000000:2.0:1790773336.077326:0:17120:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790773336.077362:0:17120:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93d27f91f800 from 9 10000000:01000000:2.0:1790773336.077369:0:17120:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790773336.077417:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26efc5e00/0xabf1cc0bc7842cf3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773336.077429:0:17120:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d26efc5e00/0xabf1cc0bc7842cf3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773336.077441:0:17120:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d26efc5e00/0xabf1cc0bc7842cf3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773336.077465:0:17120:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496106496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790773336.077537:0:17120:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773336.077637:0:17120:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d246b25f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790773336.077748:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496106496 00000100:00100000:0.0:1790773336.077757:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496106496 00000100:00100000:0.0:1790773336.077974:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1790773336.077984:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143066c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+19:17120:x1877761496106496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790773336.078000:0:17115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773336.078011:0:17115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d25074b800/0xabf1cc0bc7842cfa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7842cf3 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773336.078033:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d25074b800/0xabf1cc0bc7842cfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7842cf3 expref: 20 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773336.078042:0:17115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d25074b800/0xabf1cc0bc7842cfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7842cf3 expref: 20 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773336.078051:0:17115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074b800, rc 0) 00000100:00100000:0.0:1790773336.078120:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143066c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+20:17120:x1877761496106496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773336.078128:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1790773336.078253:0:17120:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496106496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790773336.078271:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d26efc5e00/0xabf1cc0bc7842cf3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842cfa expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773336.078279:0:17120:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d26efc5e00/0xabf1cc0bc7842cf3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7842cfa expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773336.078322:0:17120:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496106624:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1790773336.078365:0:17120:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773336.085533:0:17120:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d250376840 going to sleep for 11 seconds 00000100:00100000:2.0:1790773336.085711:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496106624 00000100:00100000:2.0:1790773336.085722:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496106624 00000100:00100000:2.0:1790773336.085772:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1790773336.085782:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d255216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+20:17120:x1877761496106624:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1790773336.085809:0:17117:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790773336.085854:0:17117:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790773336.085857:0:17117:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1790773336.085995:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d255216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+20:17120:x1877761496106624:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 214us (7629us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773336.086003:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1790773336.086166:0:17120:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496106624:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1790773336.086266:0:17120:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790773336.086277:0:17120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26efc5e00/0xabf1cc0bc7842cf3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842cfa expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773336.086297:0:17120:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d26efc5e00/0xabf1cc0bc7842cf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842cfa expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790773336.086307:0:17120:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790773336.086310:0:17120:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93d14444c000 from 9 10000000:01000000:1.0:1790773336.086312:0:17120:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790773336.086349:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12b000/0xabf1cc0bc7842d01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773336.086357:0:17120:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d27b12b000/0xabf1cc0bc7842d01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773336.086365:0:17120:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d27b12b000/0xabf1cc0bc7842d01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773336.086386:0:17120:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496106752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790773336.086419:0:17120:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773336.086437:0:17120:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d250376840 going to sleep for 11 seconds 00000100:00100000:2.0:1790773336.086678:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496106752 00000100:00100000:2.0:1790773336.086683:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496106752 00000100:00100000:2.0:1790773336.086720:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790773336.086729:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d255214850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+20:17120:x1877761496106752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790773336.086741:0:17117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773336.086761:0:17117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d26efc4200/0xabf1cc0bc7842d08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7842d01 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773336.086787:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d26efc4200/0xabf1cc0bc7842d08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7842d01 expref: 21 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773336.086799:0:17117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d26efc4200/0xabf1cc0bc7842d08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7842d01 expref: 21 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773336.086811:0:17117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26efc4200, rc 0) 00000100:00100000:2.0:1790773336.087008:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d255214850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+21:17120:x1877761496106752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 279us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773336.087016:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1790773336.087103:0:17120:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496106752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790773336.087119:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d27b12b000/0xabf1cc0bc7842d01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842d08 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773336.087129:0:17120:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d27b12b000/0xabf1cc0bc7842d01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7842d08 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773336.087175:0:17120:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496106880:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1790773336.087249:0:17120:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773336.087275:0:17120:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d250376840 going to sleep for 11 seconds 00000100:00100000:2.0:1790773336.087391:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496106880 00000100:00100000:2.0:1790773336.087396:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496106880 00000100:00100000:2.0:1790773336.087414:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1790773336.087420:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+21:17120:x1877761496106880:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1790773336.087432:0:17117:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790773336.087445:0:17117:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790773336.087447:0:17117:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1790773336.087519:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+21:17120:x1877761496106880:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 99us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773336.087526:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1790773336.087697:0:17120:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496106880:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1790773336.087740:0:17120:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790773336.087748:0:17120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12b000/0xabf1cc0bc7842d01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842d08 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773336.087756:0:17120:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d27b12b000/0xabf1cc0bc7842d01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842d08 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773336.274298:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773336.397514:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790773336.397765:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144545180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496107008:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790773336.398363:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773336.400047:0:17128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496107008 00000100:00100000:0.0:1790773336.400059:0:17128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496107008 00000100:00100000:0.0:1790773336.400166:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790773336.400182:0:17128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496107008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790773336.400235:0:17128:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1790773336.400302:0:17128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496107008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 121us (1941us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773336.400308:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790773336.400392:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144545180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496107008:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1790773337.293380:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773338.327227:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773339.341510:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790773339.726321:0:17158:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:1.0:1790773339.984823:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790773339.984830:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790773339.984832:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790773339.984834:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790773339.984842:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790773339.984844:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790773339.984846:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790773339.984848:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790773339.984879:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3605:1877761496107136:0@lo:400:kworker.0 00000100:00100000:1.0:1790773339.984952:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773339.984995:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3605:1877761496107648:0@lo:400:kworker.0 00000100:00100000:1.0:1790773339.985015:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773339.985032:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790773339.985035:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496107520:0@lo:400:kworker.0 00000100:00100000:1.0:1790773339.985054:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773339.985070:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496107264:0@lo:400:kworker.0 00000100:00100000:1.0:1790773339.985083:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773339.985092:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3606:1877761496107776:0@lo:400:kworker.0 00000100:00100000:1.0:1790773339.985104:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773339.985113:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790773339.985116:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3606:1877761496107392:0@lo:400:kworker.0 00000100:00100000:1.0:1790773339.985126:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773339.985134:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3606:1877761496107904:0@lo:400:kworker.0 00000100:00100000:1.0:1790773339.985147:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773339.985163:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496107136 00000100:00100000:1.0:1790773339.985168:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496107136 00000100:00100000:1.0:1790773339.985202:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1790773339.985222:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+21:3605:x1877761496107136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773339.985259:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+21:3605:x1877761496107136:12345-0@lo:400:kworker.0 Request processed in 38us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773339.985264:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1790773339.985311:0:17124:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496107648 00000100:00100000:1.0:1790773339.985315:0:17124:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496107648 00000100:00100000:1.0:1790773339.985332:0:17124:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496107776 00000100:00100000:1.0:1790773339.985334:0:17124:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496107776 00000100:00100000:1.0:1790773339.985375:0:17124:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496107392 00000100:00100000:1.0:1790773339.985378:0:17124:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496107392 00000100:00100000:1.0:1790773339.985387:0:17124:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496107904 00000100:00100000:1.0:1790773339.985390:0:17124:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496107904 00000100:00100000:1.0:1790773339.985401:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790773339.985404:0:17124:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3605:x1877761496107648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773339.985428:0:17124:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3605:x1877761496107648:12345-0@lo:400:kworker.0 Request processed in 24us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773339.985433:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790773339.985440:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790773339.985444:0:17124:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1877761496107776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773339.985461:0:17124:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1877761496107776:12345-0@lo:400:kworker.0 Request processed in 17us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773339.985464:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790773339.985471:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790773339.985474:0:17124:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1877761496107392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773339.985487:0:17124:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1877761496107392:12345-0@lo:400:kworker.0 Request processed in 13us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773339.985491:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790773339.985497:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790773339.985500:0:17124:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1877761496107904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773339.985512:0:17124:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1877761496107904:12345-0@lo:400:kworker.0 Request processed in 12us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773339.985515:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790773339.985530:0:17127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496107520 00000100:00100000:1.0:1790773339.985531:0:17127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496107520 00000100:00100000:1.0:1790773339.985540:0:17127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496107264 00000100:00100000:1.0:1790773339.985546:0:17127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496107264 00000100:00100000:1.0:1790773339.985556:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790773339.985559:0:17127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496107520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773339.985580:0:17127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496107520:12345-0@lo:400:kworker.0 Request processed in 20us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773339.985583:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790773339.985590:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790773339.985593:0:17127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496107264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773339.985606:0:17127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496107264:12345-0@lo:400:kworker.0 Request processed in 13us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773339.985609:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1790773339.985644:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d2526cc700 x1877761496107392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773339.985654:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3606:1877761496107392:0@lo:400:kworker.0 00010000:00080000:1.0:1790773339.985664:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d2526cfb80 x1877761496107904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773339.985673:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3606:1877761496107904:0@lo:400:kworker.0 00000100:00100000:1.0:1790773339.985682:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496107264:0@lo:400:kworker.0 00010000:00080000:1.0:1790773339.985690:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d2526cca80 x1877761496107776/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773339.985697:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3606:1877761496107776:0@lo:400:kworker.0 00000100:00100000:1.0:1790773339.985726:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496107520:0@lo:400:kworker.0 00000100:00100000:1.0:1790773339.985731:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3605:1877761496107136:0@lo:400:kworker.0 00010000:00080000:1.0:1790773339.985744:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d2526ce300 x1877761496107648/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773339.985749:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3605:1877761496107648:0@lo:400:kworker.0 00000100:00080000:1.0:1790773339.985784:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790773339.985787:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1790773340.365503:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790773340.940674:0:18991:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg219-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1790773341.007120:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790773341.007147:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496108032:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790773341.007244:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773341.007340:0:17127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496108032 00000100:00100000:0.0:1790773341.007350:0:17127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496108032 00000100:00100000:0.0:1790773341.007402:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790773341.007411:0:17127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496108032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790773341.007461:0:17127:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1790773341.007505:0:17127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496108032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773341.007512:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790773341.007560:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496108032:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1790773341.391420:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773341.518186:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496108160:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790773341.518295:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773341.518393:0:17127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496108160 00000100:00100000:1.0:1790773341.518402:0:17127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496108160 00000100:00100000:1.0:1790773341.518453:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790773341.518461:0:17127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144547480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496108160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790773341.518495:0:17127:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1790773341.518541:0:17127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144547480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496108160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773341.518549:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790773341.524450:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496108160:0@lo:41:osp-pre-1-0.0 00000020:00000004:3.0:1790773341.914585:0:19044:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790773341.914799:0:19044:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:2.0:1790773342.160611:0:17873:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790773342.413393:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1790773342.752666:0:19094:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790773342.753066:0:19094:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1790773343.437498:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773344.461452:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790773345.102155:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790773345.102163:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790773345.102166:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790773345.102169:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790773345.102192:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790773345.102196:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790773345.102198:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790773345.102201:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790773345.102292:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3606:1877761496108288:0@lo:400:kworker.0 00000100:00100000:1.0:1790773345.102384:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773345.102446:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3606:1877761496108800:0@lo:400:kworker.0 00000100:00100000:1.0:1790773345.102474:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773345.102503:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790773345.102520:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496108416:0@lo:400:kworker.0 00000100:00100000:1.0:1790773345.102547:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773345.102565:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3606:1877761496108928:0@lo:400:kworker.0 00000100:00100000:1.0:1790773345.102586:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773345.102615:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3604:1877761496108544:0@lo:400:kworker.0 00000100:00100000:1.0:1790773345.102638:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773345.102655:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3604:1877761496109056:0@lo:400:kworker.0 00000100:00100000:1.0:1790773345.102674:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773345.102685:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790773345.102689:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496108672:0@lo:400:kworker.0 00000100:00100000:1.0:1790773345.102707:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773345.102737:0:17116:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496108288 00000100:00100000:1.0:1790773345.102745:0:17116:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496108288 00000100:00100000:1.0:1790773345.102790:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1790773345.102800:0:17116:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+21:3606:x1877761496108288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773345.102851:0:17116:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+21:3606:x1877761496108288:12345-0@lo:400:kworker.0 Request processed in 53us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773345.102858:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1790773345.102887:0:17124:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496108800 00000100:00100000:1.0:1790773345.102890:0:17124:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496108800 00000100:00100000:1.0:1790773345.102906:0:17124:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496108928 00000100:00100000:1.0:1790773345.102908:0:17124:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496108928 00000100:00100000:1.0:1790773345.102935:0:17124:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496108544 00000100:00100000:1.0:1790773345.102938:0:17124:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496108544 00000100:00100000:1.0:1790773345.102948:0:17124:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496109056 00000100:00100000:1.0:1790773345.102951:0:17124:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496109056 00000100:00100000:1.0:1790773345.102965:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790773345.102970:0:17124:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1877761496108800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773345.103004:0:17124:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1877761496108800:12345-0@lo:400:kworker.0 Request processed in 34us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773345.103010:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790773345.103023:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790773345.103029:0:17124:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1877761496108928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773345.103056:0:17124:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1877761496108928:12345-0@lo:400:kworker.0 Request processed in 28us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773345.103062:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790773345.103074:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790773345.103080:0:17124:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3604:x1877761496108544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773345.103110:0:17124:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3604:x1877761496108544:12345-0@lo:400:kworker.0 Request processed in 31us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773345.103117:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790773345.103128:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790773345.103134:0:17124:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3604:x1877761496109056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773345.103161:0:17124:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3604:x1877761496109056:12345-0@lo:400:kworker.0 Request processed in 28us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773345.103167:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790773345.103186:0:17127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496108416 00000100:00100000:1.0:1790773345.103189:0:17127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496108416 00000100:00100000:1.0:1790773345.103225:0:17127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496108672 00000100:00100000:1.0:1790773345.103234:0:17127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496108672 00000100:00100000:1.0:1790773345.103266:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790773345.103274:0:17127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496108416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773345.103308:0:17127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496108416:12345-0@lo:400:kworker.0 Request processed in 35us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773345.103314:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790773345.103326:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790773345.103332:0:17127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496108672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773345.103359:0:17127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496108672:12345-0@lo:400:kworker.0 Request processed in 27us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773345.103364:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1790773345.103394:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790773345.103398:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790773345.103424:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496108672:0@lo:400:kworker.0 00010000:00080000:1.0:1790773345.103437:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d143ce1880 x1877761496108544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773345.103447:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3604:1877761496108544:0@lo:400:kworker.0 00010000:00080000:1.0:1790773345.103456:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d143ce1c00 x1877761496109056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773345.103463:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3604:1877761496109056:0@lo:400:kworker.0 00000100:00100000:1.0:1790773345.103491:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496108416:0@lo:400:kworker.0 00010000:00080000:1.0:1790773345.103501:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d143ce3b80 x1877761496108928/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773345.103510:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3606:1877761496108928:0@lo:400:kworker.0 00000100:00100000:1.0:1790773345.103527:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3606:1877761496108288:0@lo:400:kworker.0 00010000:00080000:1.0:1790773345.103536:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d143ce3800 x1877761496108800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773345.103544:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3606:1877761496108800:0@lo:400:kworker.0 00000100:00100000:2.0:1790773345.106865:0:3603:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790773330/real 1790773330] req@ffff93d143cc5880 x1877761496101120/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790773345 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773345.106910:0:3603:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93d143cc5880 x1877761496101120/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790773345 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773345.106921:0:3603:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790773330/real 1790773330] req@ffff93d143cc4380 x1877761496101248/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790773345 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773345.106933:0:3603:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93d143cc4380 x1877761496101248/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790773345 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790773345.106955:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d27c378800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790773345.106969:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790773345.106973:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761496101120:0@lo:8:kworker.0 00000100:00080000:2.0:1790773345.106979:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d281bb7800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790773345.106984:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790773345.106987:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761496101248:0@lo:8:kworker.0 00000100:00080000:2.0:1790773345.107338:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790773345.107344:0:15123:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790773345.107346:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790773345.107350:0:15123:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790773345.107354:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790773345.107358:0:15123:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1790773345.107361:0:15123:0:(import.c:65:import_set_state_nolock()) ffff93d27c378800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790773345.107367:0:15123:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 473 00000100:00080000:2.0:1790773345.107373:0:15123:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1790773345.107396:0:15123:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff93d27c378800 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:2.0:1790773345.107443:0:15123:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d27f9f5f80 x1877761496109184/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790773345.107463:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790773345.107466:0:15123:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790773345.107467:0:15123:0:(import.c:65:import_set_state_nolock()) ffff93d281bb7800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790773345.107471:0:15123:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 473 00000100:00080000:2.0:1790773345.107473:0:15123:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1790773345.107478:0:15123:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff93d281bb7800 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:2.0:1790773345.107489:0:15123:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d27f9f4380 x1877761496109312/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790773345.107530:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761496109184:0@lo:8:kworker.0 00000100:00100000:2.0:1790773345.107596:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773345.107636:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761496109312:0@lo:8:kworker.0 00000100:00100000:2.0:1790773345.107658:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773345.108918:0:18628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496109184 00000100:00100000:3.0:1790773345.108929:0:18628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496109184 00000100:00100000:3.0:1790773345.108966:0:18628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496109312 00000100:00100000:3.0:1790773345.108969:0:18628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496109312 00000100:00100000:3.0:1790773345.108985:0:18628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790773345.108993:0:18628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3603:x1877761496109184:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1790773345.109033:0:18628:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 487 last 0 00000020:00000080:3.0:1790773345.109059:0:18628:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xabf1cc0bc7842d0f 00002000:00100000:3.0:1790773345.109074:0:18628:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff93d143289800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b04 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1790773345.109078:0:18628:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1790773345.109080:0:18628:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1790773345.109286:0:18628:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1790773345.109312:0:18628:0:(import.c:65:import_set_state_nolock()) ffff93d14328f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790773345.109390:0:18628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3603:x1877761496109184:12345-0@lo:8:kworker.0 Request processed in 397us (1793us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773345.109398:0:18628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790773345.109415:0:18628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790773345.109419:0:18628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3603:x1877761496109312:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1790773345.109443:0:18628:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:2.0:1790773345.122633:0:3603:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d27f9f5f80 x1877761496109184/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790773365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773345.122650:0:3603:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790773345.122665:0:3603:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1790773345.122676:0:3603:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1790773345.122683:0:3603:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1790773345.122686:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d27c378800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1790773345.122711:0:3603:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1790773345.122717:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761496109184:0@lo:8:kworker.0 00000004:00080000:0.0:1790773345.122985:0:17864:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1790773345.123010:0:17864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17864:1877761496109568:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1790773345.123081:0:17864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773345.123107:0:17864:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c159e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790773345.123120:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790773345.123132:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496109440:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790773345.123158:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1790773345.123256:0:17863:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1790773345.123356:0:17863:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 487925150912ns, next at 0ns, rc = 0 00080000:00080000:1.0:1790773345.123364:0:17863:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1790773345.123826:0:18630:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1790773345.123839:0:18630:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1790773345.132954:0:18631:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496109440 00000100:00100000:3.0:1790773345.132972:0:18631:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496109440 00000100:00100000:3.0:1790773345.133057:0:18631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790773345.133074:0:18631:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3604:x1877761496109440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790773345.133106:0:18631:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1790773345.133194:0:18631:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3604:x1877761496109440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 128us (10035us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773345.133201:0:18631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1790773345.135473:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790773345.135738:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d143cc7b80 x1877761496109440/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773361 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773345.135764:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496109440:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790773345.135896:0:18628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3603:x1877761496109312:12345-0@lo:8:kworker.0 Request processed in 26473us (28235us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790773345.135926:0:18628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790773345.135956:0:18628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496109568 00000100:00100000:3.0:1790773345.135963:0:18628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496109568 00000100:00100000:3.0:1790773345.136041:0:18629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790773345.136051:0:18629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17864:x1877761496109568:12345-0@lo:7:osp-pre-0-1.0 00000100:00080000:0.0:1790773345.136183:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d281bb7800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790773345.136189:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790773345.136192:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761496109312:0@lo:8:kworker.0 00000004:00080000:0.0:1790773345.137857:0:17855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:2.0:1790773345.159263:0:18629:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1790773345.159274:0:18629:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1790773345.159373:0:18629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17864:x1877761496109568:12345-0@lo:7:osp-pre-0-1.0 Request processed in 23320us (36287us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773345.159383:0:18629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1790773345.159494:0:17864:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d143cc4700 x1877761496109568/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790773361 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773345.159694:0:17864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17864:1877761496109568:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1790773345.159710:0:17864:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:3.0:1790773345.159752:0:17864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144545180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17864:1877761496109696:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1790773345.159787:0:17864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773345.159820:0:17864:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2517af900 going to sleep for 11 seconds 00000100:00100000:2.0:1790773345.159868:0:18628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496109696 00000100:00100000:2.0:1790773345.159875:0:18628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496109696 00000100:00100000:2.0:1790773345.159919:0:18628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790773345.159928:0:18628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17864:x1877761496109696:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1790773345.159953:0:18628:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1790773345.159981:0:18628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17864:x1877761496109696:12345-0@lo:5:osp-pre-0-1.0 Request processed in 55us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773345.159988:0:18628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1790773345.160085:0:17864:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d144545180 x1877761496109696/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790773361 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773345.160095:0:17864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144545180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17864:1877761496109696:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1790773345.160104:0:17864:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:3.0:1790773345.160129:0:17864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144545180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17864:1877761496109824:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1790773345.160152:0:17864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773345.160175:0:17864:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2517af900 going to sleep for 11 seconds 00000100:00100000:3.0:1790773345.160188:0:18630:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496109824 00000100:00100000:3.0:1790773345.160192:0:18630:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496109824 00000100:00100000:3.0:1790773345.160255:0:18630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790773345.160263:0:18630:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144544e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17864:x1877761496109824:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1790773345.160291:0:18630:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:1.0:1790773345.233555:0:18624:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1790773345.233571:0:18624:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1790773345.233891:0:18630:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144544e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:17864:x1877761496109824:12345-0@lo:5:osp-pre-0-1.0 Request processed in 73624us (73733us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1790773345.233903:0:18630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1790773345.233997:0:17864:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d144545180 x1877761496109824/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790773361 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773345.234009:0:17864:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1790773345.234016:0:17864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144545180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17864:1877761496109824:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1790773345.234033:0:17864:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:1.0:1790773345.234090:0:17864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17864:1877761496109952:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1790773345.234128:0:17864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773345.234159:0:17864:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26c741b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790773345.234242:0:17134:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496109952 00000100:00100000:3.0:1790773345.234259:0:17134:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496109952 00000100:00100000:3.0:1790773345.234302:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790773345.234311:0:17134:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17864:x1877761496109952:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1790773345.234369:0:17134:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17864:x1877761496109952:12345-0@lo:900:osp-pre-0-1.0 Request processed in 59us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773345.234376:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1790773345.234622:0:17864:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d143ce3800 x1877761496109952/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790773361 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773345.234633:0:17864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17864:1877761496109952:0@lo:900:osp-pre-0-1.0 00010000:00010000:1.0:1790773345.487972:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773346.136190:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790773346.136255:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496110080:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790773346.136343:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773346.138305:0:17127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496110080 00000100:00100000:2.0:1790773346.138320:0:17127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496110080 00000100:00100000:2.0:1790773346.138387:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790773346.138397:0:17127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144545c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496110080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790773346.138440:0:17127:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1790773346.138524:0:17127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144545c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496110080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 129us (2181us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773346.138532:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790773346.138631:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496110080:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1790773346.510332:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773346.641025:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790773346.641055:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496110208:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790773346.641127:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773346.644844:0:17127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496110208 00000100:00100000:2.0:1790773346.644857:0:17127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496110208 00000100:00100000:2.0:1790773346.644922:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790773346.644932:0:17127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496110208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790773346.644968:0:17127:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790773346.645049:0:17127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496110208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 119us (3923us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773346.645066:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790773346.645120:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496110208:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1790773347.534292:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773348.558334:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773349.584087:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790773349.987548:0:17158:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1790773350.221859:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3604:1877761496110336:0@lo:400:kworker.0 00000100:00100000:2.0:1790773350.221948:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790773350.222188:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790773350.222193:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790773350.222220:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790773350.222223:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790773350.222364:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496110336 00000100:00100000:1.0:1790773350.222372:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496110336 00000100:00100000:1.0:1790773350.222419:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1790773350.222438:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+21:3604:x1877761496110336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773350.223648:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496110848:0@lo:400:kworker.0 00000100:00100000:2.0:1790773350.223873:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790773350.228867:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790773350.228874:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790773350.228878:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d281bb7800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790773350.228887:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 487 00000100:00080000:0.0:1790773350.228894:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1790773350.228905:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff93d281bb7800 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:0.0:1790773350.228947:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d27c3a9f80 x1877761496111104/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790773350.229019:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496110592:0@lo:400:kworker.0 00000100:00100000:0.0:1790773350.229106:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773350.229147:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3606:1877761496111232:0@lo:400:kworker.0 00000100:00100000:0.0:1790773350.229173:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773350.229232:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1790773350.229239:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3606:1877761496110720:0@lo:400:kworker.0 00000100:00100000:0.0:1790773350.229264:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773350.229280:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3606:1877761496111360:0@lo:400:kworker.0 00000100:00100000:1.0:1790773350.234615:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+21:3604:x1877761496110336:12345-0@lo:400:kworker.0 Request processed in 12163us (12652us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773350.235063:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1790773350.240070:0:17128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496110848 00000100:00100000:1.0:1790773350.240083:0:17128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496110848 00000100:00100000:2.0:1790773350.240097:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3604:1877761496110336:0@lo:400:kworker.0 00000100:00100000:1.0:1790773350.240125:0:17128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496110592 00000100:00100000:1.0:1790773350.240128:0:17128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496110592 00000100:00100000:2.0:1790773350.240130:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3604:1877761496111488:0@lo:400:kworker.0 00000100:00100000:1.0:1790773350.240144:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790773350.240152:0:17128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496110848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773350.240221:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773350.240237:0:17128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496110848:12345-0@lo:400:kworker.0 Request processed in 86us (16366us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773350.240245:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790773350.240259:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496110848:0@lo:400:kworker.0 00000100:00100000:1.0:1790773350.240264:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790773350.240270:0:17128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496110592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773350.240271:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1790773350.240278:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144547800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496110464:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790773350.240300:0:17128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496110592:12345-0@lo:400:kworker.0 Request processed in 31us (11195us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773350.240301:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773350.240305:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790773350.240319:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496110976:0@lo:400:kworker.0 00000100:00100000:1.0:1790773350.240328:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761496111104:0@lo:8:kworker.0 00000100:00100000:2.0:1790773350.240339:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773350.240355:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773350.240373:0:17123:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496111232 00000100:00100000:2.0:1790773350.240377:0:17123:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496111232 00000100:00100000:0.0:1790773350.241891:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773350.241950:0:17124:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496110720 00000100:00100000:0.0:1790773350.241959:0:17124:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496110720 00000100:00100000:0.0:1790773350.241994:0:17124:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496111488 00000100:00100000:0.0:1790773350.242009:0:17124:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496111488 00000100:00100000:0.0:1790773350.242036:0:17124:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496111360 00000100:00100000:0.0:1790773350.242039:0:17124:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496111360 00000100:00100000:0.0:1790773350.242055:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790773350.242063:0:17124:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1877761496110720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773350.242125:0:17124:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1877761496110720:12345-0@lo:400:kworker.0 Request processed in 63us (12860us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773350.242132:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790773350.242146:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790773350.242152:0:17124:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3604:x1877761496111488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773350.242182:0:17124:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3604:x1877761496111488:12345-0@lo:400:kworker.0 Request processed in 31us (1986us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773350.242188:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790773350.242224:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790773350.242232:0:17124:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1877761496111360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773350.242259:0:17124:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1877761496111360:12345-0@lo:400:kworker.0 Request processed in 29us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773350.242265:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1790773350.242285:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790773350.242289:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1790773350.242318:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d27c3ab800 x1877761496111488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773350.242332:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3604:1877761496111488:0@lo:400:kworker.0 00000100:00100000:2.0:1790773350.242488:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790773350.242496:0:17123:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1877761496111232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773350.242532:0:17123:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1877761496111232:12345-0@lo:400:kworker.0 Request processed in 37us (13358us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773350.242551:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790773350.242575:0:18631:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496110464 00000100:00100000:2.0:1790773350.242579:0:18631:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496110464 00000100:00100000:2.0:1790773350.242609:0:18631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790773350.242615:0:18631:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496110464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790773350.242638:0:18631:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1790773350.242671:0:18631:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496110464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (2368us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773350.242676:0:18631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790773350.242692:0:18628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496110976 00000100:00100000:2.0:1790773350.242695:0:18628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496110976 00000100:00100000:2.0:1790773350.242713:0:18628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496111104 00000100:00100000:2.0:1790773350.242716:0:18628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496111104 00000100:00100000:2.0:1790773350.242731:0:18628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790773350.242736:0:18628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496110976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773350.242763:0:18628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496110976:12345-0@lo:400:kworker.0 Request processed in 27us (2423us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773350.242768:0:18628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790773350.242777:0:18628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790773350.242781:0:18628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3603:x1877761496111104:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1790773350.242798:0:18628:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790773350.242828:0:18628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3603:x1877761496111104:12345-0@lo:8:kworker.0 Request processed in 45us (2472us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790773350.242835:0:18628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1790773350.242885:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d281bb7800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790773350.242890:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790773350.242903:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761496111104:0@lo:8:kworker.0 00010000:00080000:0.0:1790773350.244387:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d27c3a8a80 x1877761496111360/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773350.244410:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3606:1877761496111360:0@lo:400:kworker.0 00010000:00080000:0.0:1790773350.244458:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d144547800 x1877761496110464/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773366 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773350.244477:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144547800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496110464:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1790773350.244488:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d27c3aa680 x1877761496110976/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773350.244495:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496110976:0@lo:400:kworker.0 00000100:00100000:0.0:1790773350.244536:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496110592:0@lo:400:kworker.0 00010000:00080000:0.0:1790773350.244547:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d27c3a8700 x1877761496111232/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773350.244554:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3606:1877761496111232:0@lo:400:kworker.0 00010000:00080000:0.0:1790773350.244570:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d27c3a9c00 x1877761496110720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773350.244577:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3606:1877761496110720:0@lo:400:kworker.0 00000100:00080000:0.0:1790773350.244598:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000004:2.0:1790773350.270770:0:19440:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790773350.270775:0:19440:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1790773350.270776:0:19440:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1790773350.271557:0:19440:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93d14316e800 00000020:01000004:2.0:1790773350.271579:0:19440:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1790773350.271596:0:19440:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1790773350.271613:0:19440:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff93d2626619c0) 00000020:00000080:2.0:1790773350.271632:0:19440:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1790773350.404076:0:19440:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1790773350.405063:0:19440:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1790773350.405356:0:19440:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1790773350.405778:0:19440:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1790773350.406819:0:19440:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1790773350.408067:0:19440:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1790773350.408429:0:19440:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:3.0:1790773350.421934:0:19440:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1790773350.422358:0:19440:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1790773350.422376:0:19440:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:3.0:1790773350.422388:0:19440:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xabf1cc0bc7842d1d 00000020:01000004:3.0:1790773350.422394:0:19440:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1790773350.422424:0:19440:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.119@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1790773350.422428:0:19440:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.119@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1790773350.422434:0:19440:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1790773350.422465:0:19440:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1790773350.422469:0:19440:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.119@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1790773350.450799:0:19440:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.119@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790773350.450839:0:19440:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.119@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1790773350.450845:0:19440:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790773350.450847:0:19440:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790773350.450848:0:19440:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790773350.450850:0:19440:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790773350.450851:0:19440:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790773350.450853:0:19440:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790773350.450855:0:19440:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790773350.450857:0:19440:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790773350.450858:0:19440:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790773350.450862:0:19440:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1790773350.450865:0:19440:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790773350.450866:0:19440:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790773350.450867:0:19440:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790773350.450868:0:19440:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790773350.450870:0:19440:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790773350.450871:0:19440:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790773350.450872:0:19440:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790773350.450873:0:19440:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790773350.450874:0:19440:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790773350.450920:0:19440:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1790773350.450941:0:19440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:19440:1877761496111616:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790773350.451009:0:19440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773350.451052:0:19440:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2517af480 going to sleep for 11 seconds 00000100:00100000:1.0:1790773350.451106:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496111616 00000100:00100000:1.0:1790773350.451114:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496111616 00000100:00100000:1.0:1790773350.451171:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1790773350.451180:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+21:19440:x1877761496111616:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790773350.451272:0:17117:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1790773350.451276:0:17117:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1790773350.451284:0:17117:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1790773350.451724:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+21:19440:x1877761496111616:12345-0@lo:253:mount.lustre.0 Request processed in 543us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773350.451734:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1790773350.451823:0:19440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:19440:1877761496111616:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790773350.451841:0:19440:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1790773350.451844:0:19440:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790773350.451845:0:19440:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790773350.451846:0:19440:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790773350.451847:0:19440:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790773350.451848:0:19440:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790773350.451849:0:19440:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790773350.451850:0:19440:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790773350.451851:0:19440:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790773350.451853:0:19440:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790773350.451871:0:19440:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93d14316e800 from lustre-OST0001 10000000:01000000:2.0:1790773350.451909:0:19440:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1790773350.451913:0:19440:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1790773350.451922:0:19440:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93d281ba99c0 local copy 00010000:00010000:2.0:1790773350.451931:0:19440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12bc00/0xabf1cc0bc7842a37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842a3e expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773350.452030:0:19440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:19440:1877761496111744:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790773350.452061:0:19440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773350.452093:0:19440:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2517afcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790773350.452187:0:17116:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496111744 00000100:00100000:1.0:1790773350.452193:0:17116:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496111744 00000100:00100000:1.0:1790773350.452269:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1790773350.452277:0:17116:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+21:19440:x1877761496111744:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790773350.452509:0:17116:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+21:19440:x1877761496111744:12345-0@lo:501:mount.lustre.0 Request processed in 231us (445us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790773350.452517:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1790773350.459620:0:19440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:19440:1877761496111744:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1790773350.459649:0:19440:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.119@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1790773350.459701:0:19440:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.119@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1790773350.459711:0:19440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12bc00/0xabf1cc0bc7842a37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842a3e expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773350.459723:0:19440:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d27b12bc00/0xabf1cc0bc7842a37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842a3e expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773350.459754:0:19440:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93d14316e800 10000000:01000000:3.0:1790773350.459760:0:19440:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790773350.459766:0:19440:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1790773350.459769:0:19440:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790773350.459773:0:19440:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1790773350.459776:0:19440:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1790773350.459808:0:19440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d1434acc00/0xabf1cc0bc7842d24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773350.459816:0:19440:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d1434acc00/0xabf1cc0bc7842d24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773350.459827:0:19440:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d1434acc00/0xabf1cc0bc7842d24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773350.459846:0:19440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144547800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:19440:1877761496111872:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790773350.460112:0:19440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773350.460155:0:19440:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27d818c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790773350.460616:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496111872 00000100:00100000:1.0:1790773350.460624:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496111872 00000100:00100000:1.0:1790773350.460674:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1790773350.460682:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+21:19440:x1877761496111872:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790773350.460696:0:17117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773350.460708:0:17117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d27b12b400/0xabf1cc0bc7842d2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7842d24 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773350.460731:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d27b12b400/0xabf1cc0bc7842d2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7842d24 expref: 22 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773350.460742:0:17117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d27b12b400/0xabf1cc0bc7842d2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7842d24 expref: 22 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773350.460750:0:17117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12b400, rc 0) 00000100:00100000:1.0:1790773350.460800:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+22:19440:x1877761496111872:12345-0@lo:101:mount.lustre.0 Request processed in 119us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773350.460807:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1790773350.460900:0:19440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144547800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:19440:1877761496111872:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790773350.460915:0:19440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d1434acc00/0xabf1cc0bc7842d24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842d2b expref: -99 pid: 19440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773350.460924:0:19440:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d1434acc00/0xabf1cc0bc7842d24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7842d2b expref: -99 pid: 19440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790773350.463251:0:19440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1790773350.464466:0:19440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790773350.474587:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1790773350.474654:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1790773350.474673:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1790773350.474688:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1790773350.474703:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1790773350.474718:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1790773350.474747:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1790773350.474754:0:19440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1790773350.474873:0:19440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:19440:1877761496112000:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790773350.476049:0:19440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773350.476161:0:19440:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d25146b600 going to sleep for 11 seconds 00000100:00100000:1.0:1790773350.487171:0:17116:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496112000 00000100:00100000:1.0:1790773350.487219:0:17116:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496112000 00000100:00100000:1.0:1790773350.487301:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1790773350.487313:0:17116:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+22:19440:x1877761496112000:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790773350.487540:0:17116:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+22:19440:x1877761496112000:12345-0@lo:501:mount.lustre.0 Request processed in 229us (11496us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773350.487548:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1790773350.487830:0:19440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:19440:1877761496112000:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790773350.487902:0:19440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:19440:1877761496112128:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790773350.487962:0:19440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773350.488003:0:19440:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d25146b600 going to sleep for 11 seconds 00000100:00100000:1.0:1790773350.489828:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496112128 00000100:00100000:1.0:1790773350.489846:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496112128 00000100:00100000:1.0:1790773350.489925:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1790773350.489936:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+22:19440:x1877761496112128:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790773350.491165:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+22:19440:x1877761496112128:12345-0@lo:503:mount.lustre.0 Request processed in 1226us (3197us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773350.491177:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1790773350.491290:0:19440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:19440:1877761496112128:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790773350.491753:0:19440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790773350.491837:0:19440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144545180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:19440:1877761496112256:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790773350.491902:0:19440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773350.491939:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496112256 00000100:00100000:3.0:1790773350.491945:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496112256 00000100:00100000:3.0:1790773350.491979:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1790773350.491987:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+23:19440:x1877761496112256:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790773350.492116:0:19440:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27d818480 going to sleep for 11 seconds 00000100:00100000:3.0:1790773350.492519:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+23:19440:x1877761496112256:12345-0@lo:502:mount.lustre.0 Request processed in 530us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773350.492531:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1790773350.492595:0:19440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144545180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:19440:1877761496112256:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790773350.492809:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1790773350.492836:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1790773350.492849:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1790773350.492863:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1790773350.492882:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1790773350.493414:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1790773350.493437:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1790773350.493453:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1790773350.493471:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1790773350.493508:0:19440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144545180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:19440:1877761496112384:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790773350.493561:0:19440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773350.493602:0:19440:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27d818480 going to sleep for 11 seconds 00000100:00100000:0.0:1790773350.494075:0:17116:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496112384 00000100:00100000:0.0:1790773350.494084:0:17116:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496112384 00000100:00100000:0.0:1790773350.494132:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1790773350.494142:0:17116:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+22:19440:x1877761496112384:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790773350.494484:0:17116:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+22:19440:x1877761496112384:12345-0@lo:502:mount.lustre.0 Request processed in 343us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773350.494492:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1790773350.494598:0:19440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144545180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:19440:1877761496112384:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790773350.494669:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1790773350.494680:0:19440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1790773350.500771:0:19444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790773350.500784:0:19444:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1790773350.500798:0:19444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773350.500800:0:19444:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1790773350.500807:0:19444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790773350.500825:0:19444:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff93d262663380) 00000020:00000080:2.0:1790773350.500852:0:19444:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1790773350.500857:0:19444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1790773350.501010:0:19444:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93d14316e800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1790773350.501019:0:19444:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790773350.501027:0:19444:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xabf1cc0bc7842d39 00010000:00010000:2.0:1790773350.506809:0:19444:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1790773350.507499:0:19444:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:2.0:1790773350.509599:0:19444:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1790773350.510844:0:19444:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1790773350.510856:0:19444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790773350.510861:0:19444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773350.510864:0:19444:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1790773350.510867:0:19444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790773350.510872:0:19444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773350.510873:0:19444:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790773350.510877:0:19444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790773350.510879:0:19444:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1790773350.510881:0:19444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790773350.510897:0:19444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773350.510899:0:19444:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1790773350.510901:0:19444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790773350.510904:0:19444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773350.510906:0:19444:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1790773350.510909:0:19444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1790773350.510935:0:19444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790773350.510938:0:19444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773350.510940:0:19444:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1790773350.510943:0:19444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1790773350.517000:0:19440:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1790773350.517065:0:19440:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1790773350.517126:0:19440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d1434acc00/0xabf1cc0bc7842d24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842d2b expref: -99 pid: 19440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773350.517143:0:19440:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d1434acc00/0xabf1cc0bc7842d24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842d2b expref: -99 pid: 19440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773350.517175:0:19440:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d14316e800 from 1 10000000:01000000:3.0:1790773350.517179:0:19440:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790773350.517292:0:19440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d1434ace00/0xabf1cc0bc7842d40 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773350.517301:0:19440:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d1434ace00/0xabf1cc0bc7842d40 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773350.517314:0:19440:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d1434ace00/0xabf1cc0bc7842d40 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773350.517340:0:19440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144545180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:19440:1877761496112512:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790773350.517422:0:19440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773350.517471:0:19440:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27d818480 going to sleep for 11 seconds 00000100:00100000:1.0:1790773350.517670:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496112512 00000100:00100000:1.0:1790773350.517678:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496112512 00000100:00100000:1.0:1790773350.517730:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1790773350.517739:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+22:19440:x1877761496112512:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790773350.517752:0:17115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773350.517764:0:17115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d27b12a600/0xabf1cc0bc7842d47 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7842d40 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773350.517790:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d27b12a600/0xabf1cc0bc7842d47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7842d40 expref: 23 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773350.517801:0:17115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d27b12a600/0xabf1cc0bc7842d47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7842d40 expref: 23 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773350.517827:0:17115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12a600, rc 0) 00000100:00100000:1.0:1790773350.517872:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+23:19440:x1877761496112512:12345-0@lo:101:mount.lustre.0 Request processed in 134us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773350.517880:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1790773350.518502:0:19440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144545180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:19440:1877761496112512:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790773350.518529:0:19440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d1434ace00/0xabf1cc0bc7842d40 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842d47 expref: -99 pid: 19440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773350.518542:0:19440:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d1434ace00/0xabf1cc0bc7842d40 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7842d47 expref: -99 pid: 19440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790773350.519767:0:19440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1790773350.520056:0:19440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790773350.520769:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1790773350.520807:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1790773350.520826:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1790773350.520831:0:19440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1790773350.520924:0:19440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144545180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:19440:1877761496112640:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790773350.520987:0:19440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773350.521069:0:19440:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27d818240 going to sleep for 11 seconds 00000100:00100000:1.0:1790773350.523030:0:17116:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496112640 00000100:00100000:1.0:1790773350.523046:0:17116:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496112640 00000100:00100000:1.0:1790773350.524230:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1790773350.524245:0:17116:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+23:19440:x1877761496112640:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790773350.524441:0:17116:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+23:19440:x1877761496112640:12345-0@lo:501:mount.lustre.0 Request processed in 200us (3454us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773350.524450:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1790773350.524795:0:19440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144545180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:19440:1877761496112640:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790773350.524847:0:19440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3a8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:19440:1877761496112768:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790773350.524918:0:19440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773350.525937:0:19440:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d25146be40 going to sleep for 11 seconds 00000100:00100000:2.0:1790773350.526066:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496112768 00000100:00100000:2.0:1790773350.526094:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496112768 00000100:00100000:2.0:1790773350.526153:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1790773350.526163:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+23:19440:x1877761496112768:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790773350.526469:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+23:19440:x1877761496112768:12345-0@lo:503:mount.lustre.0 Request processed in 308us (1551us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773350.526477:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1790773350.526576:0:19440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3a8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:19440:1877761496112768:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1790773350.527087:0:19440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790773350.527177:0:19440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3a8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:19440:1877761496112896:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790773350.527278:0:19440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773350.527311:0:19440:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d25146be40 going to sleep for 11 seconds 00000100:00100000:2.0:1790773350.529626:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496112896 00000100:00100000:2.0:1790773350.529646:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496112896 00000100:00100000:2.0:1790773350.529706:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1790773350.529716:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+23:19440:x1877761496112896:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790773350.530017:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+23:19440:x1877761496112896:12345-0@lo:502:mount.lustre.0 Request processed in 301us (2738us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773350.530026:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1790773350.530468:0:19440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3a8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:19440:1877761496112896:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790773350.530777:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1790773350.530818:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1790773350.530832:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1790773350.530844:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1790773350.530857:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1790773350.530868:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1790773350.530879:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1790773350.530978:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1790773350.530996:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1790773350.531009:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1790773350.531022:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1790773350.531058:0:19440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3a8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:19440:1877761496113024:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790773350.531621:0:19440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773350.531694:0:19440:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d25146be40 going to sleep for 11 seconds 00000100:00100000:3.0:1790773350.531973:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496113024 00000100:00100000:3.0:1790773350.531985:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496113024 00000100:00100000:2.0:1790773350.532056:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1790773350.532068:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+23:19440:x1877761496113024:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790773350.536171:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+23:19440:x1877761496113024:12345-0@lo:502:mount.lustre.0 Request processed in 4095us (4542us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773350.536220:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1790773350.536548:0:19440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3a8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:19440:1877761496113024:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790773350.536665:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:0.0:1790773350.536680:0:19440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1790773350.537513:0:19448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790773350.537527:0:19448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773350.537530:0:19448:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1790773350.537537:0:19448:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93d14316e800 00000020:00000080:0.0:1790773350.537540:0:19448:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790773350.537549:0:19448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790773350.537552:0:19448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773350.537553:0:19448:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1790773350.537555:0:19448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790773350.537557:0:19448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773350.537559:0:19448:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1790773350.537562:0:19448:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93d14316e800 00000020:00000080:0.0:1790773350.537564:0:19448:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790773350.537629:0:19448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790773350.537633:0:19448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773350.537647:0:19448:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1790773350.537650:0:19448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790773350.537653:0:19448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773350.537654:0:19448:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790773350.537658:0:19448:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93d14316e800 00000020:00000080:0.0:1790773350.537660:0:19448:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790773350.537679:0:19448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790773350.537681:0:19448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773350.537683:0:19448:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790773350.537686:0:19448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790773350.537688:0:19448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773350.537690:0:19448:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1790773350.537694:0:19448:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93d14316e800 00000020:00000080:0.0:1790773350.537696:0:19448:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790773350.537717:0:19448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790773350.537720:0:19448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773350.537722:0:19448:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1790773350.537724:0:19448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1790773350.537863:0:19440:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1790773350.537905:0:19440:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790773350.537929:0:19440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d1434ace00/0xabf1cc0bc7842d40 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842d47 expref: -99 pid: 19440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773350.537942:0:19440:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d1434ace00/0xabf1cc0bc7842d40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842d47 expref: -99 pid: 19440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790773350.537994:0:19440:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1790773350.537997:0:19440:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93d14316e800 10000000:01000000:1.0:1790773350.538000:0:19440:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93d14316e800 10000000:01000000:1.0:1790773350.538005:0:19440:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790773350.538012:0:19440:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93d14316e800 from 1 10000000:01000000:1.0:1790773350.538015:0:19440:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790773350.538055:0:19440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12a000/0xabf1cc0bc7842d4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773350.538074:0:19440:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d27b12a000/0xabf1cc0bc7842d4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773350.538089:0:19440:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d27b12a000/0xabf1cc0bc7842d4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773350.538114:0:19440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:19440:1877761496113152:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790773350.538229:0:19440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773350.538273:0:17116:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496113152 00000100:00100000:1.0:1790773350.538281:0:17116:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496113152 00000100:00100000:1.0:1790773350.538331:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1790773350.538340:0:17116:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+23:19440:x1877761496113152:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790773350.538356:0:17116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773350.538371:0:17116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d27b12b800/0xabf1cc0bc7842d55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7842d4e expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773350.538399:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d27b12b800/0xabf1cc0bc7842d55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7842d4e expref: 24 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773350.538412:0:17116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d27b12b800/0xabf1cc0bc7842d55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7842d4e expref: 24 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773350.538421:0:17116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12b800, rc 0) 00000100:00100000:1.0:1790773350.538455:0:17116:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+24:19440:x1877761496113152:12345-0@lo:101:mount.lustre.0 Request processed in 115us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773350.538462:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1790773350.538508:0:19440:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d143e37780 going to sleep for 11 seconds 00000100:00100000:1.0:1790773350.538535:0:19440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:19440:1877761496113152:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790773350.538549:0:19440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d27b12a000/0xabf1cc0bc7842d4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842d55 expref: -99 pid: 19440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773350.538558:0:19440:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d27b12a000/0xabf1cc0bc7842d4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7842d55 expref: -99 pid: 19440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790773350.547773:0:19440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:0.0:1790773350.548125:0:19440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790773350.548364:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1790773350.548391:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1790773350.548406:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1790773350.548419:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1790773350.548433:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1790773350.548447:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1790773350.548458:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1790773350.548469:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1790773350.548483:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1790773350.548517:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1790773350.548533:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1790773350.548546:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1790773350.548559:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1790773350.548582:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1790773350.548594:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1790773350.548607:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1790773350.548618:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1790773350.548630:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1790773350.548642:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1790773350.548656:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1790773350.548669:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1790773350.548682:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1790773350.548696:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1790773350.548709:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1790773350.548720:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1790773350.548749:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1790773350.548763:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1790773350.548774:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1790773350.548788:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1790773350.548798:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1790773350.548809:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1790773350.548820:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1790773350.548831:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1790773350.548842:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1790773350.548853:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1790773350.548864:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1790773350.548875:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1790773350.548885:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1790773350.548896:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:0.0:1790773350.548906:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:0.0:1790773350.548916:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:0.0:1790773350.548938:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:0.0:1790773350.548950:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:0.0:1790773350.548961:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:0.0:1790773350.548972:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:0.0:1790773350.548982:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:0.0:1790773350.549006:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:0.0:1790773350.549010:0:19440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:0.0:1790773350.549097:0:19440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3a8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:19440:1877761496113280:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790773350.549169:0:19440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773350.549277:0:17116:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496113280 00000100:00100000:0.0:1790773350.549285:0:17116:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496113280 00000100:00100000:0.0:1790773350.549338:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1790773350.549349:0:17116:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+24:19440:x1877761496113280:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790773350.549468:0:17116:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+24:19440:x1877761496113280:12345-0@lo:501:mount.lustre.0 Request processed in 121us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773350.549476:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1790773350.549522:0:19440:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d25146b900 going to sleep for 11 seconds 00000100:00100000:0.0:1790773350.549542:0:19440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3a8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:19440:1877761496113280:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790773350.549568:0:19440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3a8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:19440:1877761496113408:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790773350.549599:0:19440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773350.549616:0:17116:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496113408 00000100:00100000:0.0:1790773350.549619:0:17116:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496113408 00000100:00100000:0.0:1790773350.549635:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1790773350.549640:0:17116:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+24:19440:x1877761496113408:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790773350.549698:0:17116:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+24:19440:x1877761496113408:12345-0@lo:503:mount.lustre.0 Request processed in 57us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773350.549704:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1790773350.549731:0:19440:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d25146b900 going to sleep for 11 seconds 00000100:00100000:0.0:1790773350.549741:0:19440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3a8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:19440:1877761496113408:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1790773350.550022:0:19440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790773350.550073:0:19440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3a8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:19440:1877761496113536:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790773350.550114:0:19440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773350.550136:0:17116:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496113536 00000100:00100000:0.0:1790773350.550140:0:17116:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496113536 00000100:00100000:0.0:1790773350.550162:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1790773350.550167:0:17116:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+24:19440:x1877761496113536:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790773350.550272:0:17116:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+24:19440:x1877761496113536:12345-0@lo:502:mount.lustre.0 Request processed in 104us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773350.550280:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1790773350.550312:0:19440:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d25146b900 going to sleep for 11 seconds 00000100:00100000:0.0:1790773350.550326:0:19440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3a8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:19440:1877761496113536:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790773350.550485:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1790773350.550512:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1790773350.550525:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1790773350.550540:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1790773350.550551:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1790773350.550562:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1790773350.550574:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1790773350.550588:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1790773350.550615:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1790773350.550630:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1790773350.550641:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1790773350.550653:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1790773350.550666:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1790773350.550676:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1790773350.550689:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1790773350.550700:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1790773350.550712:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1790773350.550724:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1790773350.550737:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1790773350.550762:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1790773350.550775:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1790773350.550787:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1790773350.550798:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1790773350.550811:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1790773350.550834:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1790773350.550849:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1790773350.550862:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1790773350.550874:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1790773350.550886:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1790773350.550898:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1790773350.550910:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1790773350.550923:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1790773350.550936:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1790773350.550949:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1790773350.550962:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1790773350.550976:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1790773350.550988:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1790773350.550999:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1790773350.551010:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1790773350.551024:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1790773350.551048:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1790773350.551064:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1790773350.551078:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1790773350.551091:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1790773350.551103:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1790773350.551115:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1790773350.551128:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1790773350.551142:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1790773350.551177:0:19440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3a8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:19440:1877761496113664:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790773350.556692:0:19440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773350.556746:0:19440:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d25146b900 going to sleep for 11 seconds 00000100:00100000:3.0:1790773350.557295:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496113664 00000100:00100000:3.0:1790773350.557310:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496113664 00000100:00100000:3.0:1790773350.557388:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1790773350.557400:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+24:19440:x1877761496113664:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790773350.557583:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+24:19440:x1877761496113664:12345-0@lo:502:mount.lustre.0 Request processed in 185us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773350.557592:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1790773350.559041:0:19440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3a8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:19440:1877761496113664:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790773350.560086:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1790773350.560123:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1790773350.560169:0:19440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3a8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:19440:1877761496113792:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790773350.561156:0:19440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773350.561281:0:19440:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d25146b900 going to sleep for 11 seconds 00000100:00100000:3.0:1790773350.567763:0:17116:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496113792 00000100:00100000:3.0:1790773350.567781:0:17116:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496113792 00000100:00100000:3.0:1790773350.567849:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1790773350.567858:0:17116:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+24:19440:x1877761496113792:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790773350.568109:0:17116:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+24:19440:x1877761496113792:12345-0@lo:502:mount.lustre.0 Request processed in 252us (6957us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773350.568118:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1790773350.569041:0:19440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3a8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:19440:1877761496113792:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790773350.569152:0:19440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1790773350.569167:0:19440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1790773350.575698:0:19453:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1790773350.575717:0:19453:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff93d26ec20000) 00000020:00000080:0.0:1790773350.575741:0:19453:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:0.0:1790773350.575835:0:19453:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93d14316e800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1790773350.575839:0:19453:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93d14316e800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1790773350.575842:0:19453:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93d14316e800 3 00010000:00080000:0.0:1790773350.575873:0:19453:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d280f72800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.119@tcp at head 00010000:00010000:0.0:1790773350.582166:0:19453:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:0.0:1790773350.582419:0:19453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1790773350.582465:0:19453:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790773350.582493:0:19453:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xabf1cc0bc7842d63 00000100:00080000:0.0:1790773350.582505:0:19453:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790773350.582518:0:19453:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93d280f72800 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:0.0:1790773350.582556:0:19453:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d27c3aaa00 x1877761496113920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790773350.582581:0:19453:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1790773350.582745:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3603:1877761496113920:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790773350.582819:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790773350.584630:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790773350.584640:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790773350.584644:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790773350.584648:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790773350.585008:0:17122:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496113920 00000100:00100000:0.0:1790773350.585018:0:17122:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496113920 00000100:00100000:0.0:1790773350.585067:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790773350.585075:0:17122:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3603:x1877761496113920:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1790773350.585105:0:17122:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 493 last 0 00000020:00000080:0.0:1790773350.585160:0:17122:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xabf1cc0bc7842d6a 00000004:00100000:0.0:1790773350.585177:0:17122:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790773350.585241:0:17122:0:(import.c:65:import_set_state_nolock()) ffff93d141c45800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790773350.585347:0:17122:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3603:x1877761496113920:12345-0@lo:38:llog_process_th.0 Request processed in 271us (2526us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773350.585354:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1790773350.585414:0:3603:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d27c3aaa00 x1877761496113920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790773360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773350.585427:0:3603:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790773350.585437:0:3603:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1790773350.585446:0:3603:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1790773350.585451:0:3603:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790773350.585453:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d280f72800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790773350.585460:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3603:1877761496113920:0@lo:38:llog_process_th.0 00000020:01000004:0.0:1790773350.585578:0:19453:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1790773350.585593:0:19453:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff93d26ec219c0) 00000020:00000080:0.0:1790773350.585613:0:19453:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1790773350.585681:0:19453:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93d14316e800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1790773350.585684:0:19453:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93d14316e800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1790773350.585687:0:19453:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93d14316e800 3 00010000:00080000:0.0:1790773350.585711:0:19453:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d141c46800@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.119@tcp at head 00010000:00010000:0.0:1790773350.589350:0:19453:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1790773350.589567:0:19453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1790773350.589615:0:19453:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790773350.589626:0:19453:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xabf1cc0bc7842d78 00000100:00080000:0.0:1790773350.589636:0:19453:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790773350.589646:0:19453:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff93d141c46800 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:0.0:1790773350.589698:0:19453:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d27c3aaa00 x1877761496114048/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790773350.589739:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3603:1877761496114048:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790773350.589807:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773350.591328:0:17124:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496114048 00000100:00100000:1.0:1790773350.591345:0:17124:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496114048 00000100:00100000:1.0:1790773350.591393:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790773350.591401:0:17124:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3603:x1877761496114048:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1790773350.591432:0:17124:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 493 last 0 00000020:00000080:1.0:1790773350.591480:0:17124:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xabf1cc0bc7842d7f 00000004:00100000:1.0:1790773350.591498:0:17124:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790773350.591535:0:17124:0:(import.c:65:import_set_state_nolock()) ffff93d14338c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790773350.591608:0:17124:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3603:x1877761496114048:12345-0@lo:38:llog_process_th.0 Request processed in 207us (1800us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773350.591615:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1790773350.591667:0:3603:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d27c3aaa00 x1877761496114048/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790773360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773350.591679:0:3603:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790773350.591694:0:3603:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1790773350.591704:0:3603:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1790773350.591709:0:3603:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1790773350.591712:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d141c46800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790773350.591718:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3603:1877761496114048:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1790773350.591842:0:19453:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000040:00080000:0.0:1790773350.592491:0:19453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1790773350.592586:0:19440:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1790773350.592619:0:19440:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790773350.592637:0:19440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12a000/0xabf1cc0bc7842d4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842d55 expref: -99 pid: 19440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773350.592650:0:19440:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d27b12a000/0xabf1cc0bc7842d4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842d55 expref: -99 pid: 19440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1790773350.592712:0:19440:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1790773350.592714:0:19440:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790773350.592715:0:19440:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790773350.592717:0:19440:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790773350.592718:0:19440:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790773350.592720:0:19440:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790773350.592721:0:19440:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790773350.592723:0:19440:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790773350.592725:0:19440:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790773350.592729:0:19440:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1790773350.592731:0:19440:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790773350.592733:0:19440:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790773350.592734:0:19440:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790773350.592736:0:19440:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790773350.592737:0:19440:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790773350.592738:0:19440:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790773350.592739:0:19440:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790773350.592741:0:19440:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790773350.592742:0:19440:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790773350.592767:0:19440:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1790773350.592783:0:19440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:19440:1877761496114176:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1790773350.592839:0:19440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773350.592871:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496114176 00000100:00100000:0.0:1790773350.592877:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496114176 00000100:00080000:1.0:1790773350.593104:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790773350.593110:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790773350.593113:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790773350.593116:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790773350.593184:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1790773350.593201:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+24:19440:x1877761496114176:12345-0@lo:253:mount.lustre.0 00000100:00100000:1.0:1790773350.593259:0:19440:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d25146b900 going to sleep for 11 seconds 20000000:01000000:0.0:1790773350.593365:0:17117:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1790773350.593381:0:17117:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:3.0:1790773350.607341:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:0.0:1790773350.607417:0:17117:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1790773350.607438:0:17117:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1790773350.607653:0:17138:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790773350.607659:0:17138:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790773350.607679:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93d1434aca00/0xabf1cc0bc7842d86 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773350.607699:0:17138:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d25074b800/0xabf1cc0bc7842cfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7842cf3 expref: 24 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773350.607707:0:17138:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d26efc4200/0xabf1cc0bc7842d08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7842d01 expref: 24 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773350.607716:0:17138:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93d1434aca00/0xabf1cc0bc7842d86 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773350.607753:0:17138:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d26efc4200/0xabf1cc0bc7842d08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc7842d01 expref: 24 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773350.607768:0:17138:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d26efc4200/0xabf1cc0bc7842d08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc7842d01 expref: 24 pid: 17117 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773350.607783:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144545180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17138:1877761496114304:0@lo:104: 00000100:00100000:3.0:1790773350.607851:0:17138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773350.607958:0:17106:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496114304 00000100:00100000:2.0:1790773350.607967:0:17106:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496114304 00000100:00100000:2.0:1790773350.608012:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790773350.608023:0:17106:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144547800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+3:17138:x1877761496114304:12345-0@lo:104: 00010000:00010000:2.0:1790773350.608035:0:17106:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d27b12b000/0xabf1cc0bc7842d01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7842d08 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773350.608101:0:17106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790773350.608107:0:17106:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144547800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+3:17138:x1877761496114304:12345-0@lo:104: Request processed in 87us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773350.608114:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1790773350.608133:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790773350.608138:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d27b12b000/0xabf1cc0bc7842d01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7842d08 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773350.608145:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12b000 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:2.0:1790773350.608150:0:17110:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d27b12b000/0xabf1cc0bc7842d01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc7842d08 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773350.608159:0:17110:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d27b12b000/0xabf1cc0bc7842d01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc7842d08 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790773350.608166:0:17110:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d27b12b000/0xabf1cc0bc7842d01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc7842d08 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790773350.608171:0:17110:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790773350.608317:0:17110:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d27b12b000/0xabf1cc0bc7842d01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7842d08 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773350.608325:0:17110:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790773350.608346:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d27b12b000/0xabf1cc0bc7842d01 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7842d08 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773350.608353:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d27b12b000/0xabf1cc0bc7842d01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7842d08 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773350.608377:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773350.608378:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773350.608380:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773350.608393:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3605:1877761496114432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790773350.608421:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773350.608459:0:17108:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496114432 00000100:00100000:2.0:1790773350.608463:0:17108:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496114432 00010000:00010000:2.0:1790773350.608480:0:17108:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d26efc4200/0xabf1cc0bc7842d08 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7842d01 expref: 25 pid: 17117 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773350.608500:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790773350.608506:0:17108:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+25:3605:x1877761496114432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790773350.608520:0:17108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790773350.608525:0:17108:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d26efc4200/0xabf1cc0bc7842d08 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7842d01 expref: 25 pid: 17117 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773350.608535:0:17108:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d26efc4200/0xabf1cc0bc7842d08 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc7842d01 expref: 25 pid: 17117 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773350.608550:0:17108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790773350.608574:0:17108:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+25:3605:x1877761496114432:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773350.608580:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1790773350.608677:0:17138:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d25074b800/0xabf1cc0bc7842cfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc7842cf3 expref: 24 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773350.608687:0:17138:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d25074b800/0xabf1cc0bc7842cfa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc7842cf3 expref: 24 pid: 17115 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773350.608707:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa8b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17138:1877761496114560:0@lo:104: 00000100:00100000:3.0:1790773350.608730:0:17138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773350.608826:0:17105:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496114560 00000100:00100000:0.0:1790773350.608830:0:17105:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496114560 00000100:00100000:0.0:1790773350.608848:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790773350.608853:0:17105:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+3:17138:x1877761496114560:12345-0@lo:104: 00010000:00010000:0.0:1790773350.608861:0:17105:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d26efc5e00/0xabf1cc0bc7842cf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7842cfa expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773350.608973:0:17105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790773350.608979:0:17105:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+3:17138:x1877761496114560:12345-0@lo:104: Request processed in 126us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773350.608986:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790773350.609059:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+24:19440:x1877761496114176:12345-0@lo:253:mount.lustre.0 Request processed in 15867us (16220us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773350.609068:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00010000:3.0:1790773350.609122:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790773350.609128:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d26efc5e00/0xabf1cc0bc7842cf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7842cfa expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773350.609136:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc5e00 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:3.0:1790773350.609139:0:17111:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d26efc5e00/0xabf1cc0bc7842cf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc7842cfa expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773350.609148:0:17111:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d26efc5e00/0xabf1cc0bc7842cf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc7842cfa expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790773350.609154:0:17111:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d26efc5e00/0xabf1cc0bc7842cf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc7842cfa expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773350.609160:0:17111:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790773350.609351:0:17111:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d26efc5e00/0xabf1cc0bc7842cf3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7842cfa expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773350.609359:0:17111:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790773350.609384:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d26efc5e00/0xabf1cc0bc7842cf3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7842cfa expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773350.609390:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d26efc5e00/0xabf1cc0bc7842cf3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7842cfa expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773350.609407:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773350.609409:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773350.609418:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773350.609454:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3606:1877761496114688:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790773350.609479:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773350.609574:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3605:1877761496114432:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790773350.609657:0:17138:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27d818f00 going to sleep for 11 seconds 00010000:00010000:0.0:1790773350.609676:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d26efc4200/0xabf1cc0bc7842d08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc7842d01 expref: 23 pid: 17117 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773350.609687:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144545180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17138:1877761496114304:0@lo:104: 00000100:00100000:0.0:1790773350.609694:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa8b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17138:1877761496114560:0@lo:104: 00010000:00010000:0.0:1790773350.609710:0:17138:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93d1434aca00/0xabf1cc0bc7842d86 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773350.609749:0:17107:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496114688 00000100:00100000:3.0:1790773350.609753:0:17107:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496114688 00010000:00010000:3.0:1790773350.609770:0:17107:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d25074b800/0xabf1cc0bc7842cfa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7842cf3 expref: 23 pid: 17115 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773350.609794:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790773350.609800:0:17107:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+23:3606:x1877761496114688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790773350.609809:0:17107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773350.609813:0:17107:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d25074b800/0xabf1cc0bc7842cfa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7842cf3 expref: 23 pid: 17115 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773350.609821:0:17107:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d25074b800/0xabf1cc0bc7842cfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc7842cf3 expref: 23 pid: 17115 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773350.609832:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d25074b800/0xabf1cc0bc7842cfa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc7842cf3 expref: 23 pid: 17115 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773350.609842:0:17107:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93d1434aca00/0xabf1cc0bc7842d86 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773350.609850:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d1434aca00/0xabf1cc0bc7842d86 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790773350.609864:0:17107:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008527124s 00010000:00010000:3.0:1790773350.609868:0:17107:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d1434aca00/0xabf1cc0bc7842d86 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773350.609874:0:17107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d1434aca00/0xabf1cc0bc7842d86 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773350.609881:0:17107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93d1434aca00/0xabf1cc0bc7842d86 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773350.609993:0:17107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93d1434aca00/0xabf1cc0bc7842d86 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773350.609998:0:17107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434aca00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:3.0:1790773350.610002:0:17107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93d1434aca00/0xabf1cc0bc7842d86 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773350.610009:0:17107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93d1434aca00/0xabf1cc0bc7842d86 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773350.610028:0:17107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93d1434aca00/0xabf1cc0bc7842d86 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773350.610037:0:17107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790773350.610109:0:17107:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+22:3606:x1877761496114688:12345-0@lo:103:ldlm_bl.0 Request processed in 308us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773350.610117:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1790773350.610164:0:17138:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93d1434aca00/0xabf1cc0bc7842d86 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773350.610172:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93d1434aca00/0xabf1cc0bc7842d86 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773350.610178:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d1434aca00/0xabf1cc0bc7842d86 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773350.610369:0:19440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdd0c180-4c21-4c72-90c1-0147a5902c2f:19440:1877761496114176:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1790773350.610381:0:19440:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1790773350.610384:0:19440:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790773350.610386:0:19440:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790773350.610387:0:19440:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790773350.610389:0:19440:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790773350.610390:0:19440:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790773350.610391:0:19440:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790773350.610393:0:19440:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790773350.610395:0:19440:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790773350.610396:0:19440:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1790773350.610409:0:19440:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1790773350.615069:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3606:1877761496114688:0@lo:103:ldlm_bl.0 00000001:00000004:3.0:1790773350.626655:0:19440:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1790773350.630059:0:19440:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1790773350.630078:0:19440:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1790773350.630113:0:19440:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790773350.630157:0:19440:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.119@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790773350.630172:0:19440:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1790773350.630507:0:19440:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1790773350.633657:0:19440:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790773350.633874:0:19440:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1790773351.245510:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790773351.245535:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496114816:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790773351.245609:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773351.246753:0:17128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496114816 00000100:00100000:1.0:1790773351.246766:0:17128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496114816 00000100:00100000:1.0:1790773351.246819:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790773351.246827:0:17128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496114816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790773351.246866:0:17128:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1790773351.247566:0:17128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496114816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 736us (1953us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773351.247576:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790773351.247699:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496114816:0@lo:41:osp-pre-0-1.0 00000020:00000004:1.0:1790773351.556698:0:19506:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790773351.557475:0:19506:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1790773351.631504:0:3603:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790773331/real 1790773331] req@ffff93d27f9f7480 x1877761496101888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790773351 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773351.631539:0:3603:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93d27f9f7480 x1877761496101888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790773351 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773351.631549:0:3603:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790773331/real 1790773331] req@ffff93d27f9f5500 x1877761496102016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790773351 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773351.631559:0:3603:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93d27f9f5500 x1877761496102016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790773351 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790773351.631577:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d251282000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790773351.631600:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1790773351.631604:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496101888:0@lo:8:kworker.0 00000100:00080000:3.0:1790773351.631610:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d143276000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790773351.631615:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1790773351.631617:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496102016:0@lo:8:kworker.0 00000100:00080000:1.0:1790773351.631735:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790773351.631739:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1790773351.631742:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d251282000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790773351.631748:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 474 00000100:00080000:1.0:1790773351.631754:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1790773351.631773:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93d251282000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:1.0:1790773351.631794:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d143ce1c00 x1877761496115200/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790773351.631807:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790773351.631810:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1790773351.631812:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d143276000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790773351.631815:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 474 00000100:00080000:1.0:1790773351.631817:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1790773351.631821:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93d143276000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:1.0:1790773351.631831:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d143ce1880 x1877761496115328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790773351.631856:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790773351.631859:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1790773351.631861:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d281bb7800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790773351.631864:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 493 00000100:00080000:1.0:1790773351.631867:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1790773351.631871:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff93d281bb7800 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:1.0:1790773351.631896:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d143ce0e00 x1877761496115712/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790773351.631945:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496115072:0@lo:400:kworker.0 00000100:00100000:1.0:1790773351.632019:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773351.632055:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3605:1877761496115968:0@lo:400:kworker.0 00000100:00100000:1.0:1790773351.632083:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773351.632104:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1790773351.632117:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3605:1877761496114944:0@lo:400:kworker.0 00000100:00100000:1.0:1790773351.632149:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773351.632173:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3605:1877761496115840:0@lo:400:kworker.0 00000100:00100000:3.0:1790773351.632396:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3606:1877761496115456:0@lo:400:kworker.0 00010000:00010000:0.0:1790773351.634992:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773351.635267:0:17128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496115072 00000100:00100000:0.0:1790773351.635278:0:17128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496115072 00000100:00100000:0.0:1790773351.635335:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790773351.635344:0:17128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496115072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773351.638510:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773351.638562:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3606:1877761496116096:0@lo:400:kworker.0 00000100:00100000:3.0:1790773351.638600:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773351.638630:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1790773351.638646:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496115584:0@lo:400:kworker.0 00000100:00100000:3.0:1790773351.638674:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773351.638696:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3606:1877761496116224:0@lo:400:kworker.0 00000100:00100000:3.0:1790773351.638720:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773351.638764:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496114944 00000100:00100000:3.0:1790773351.638773:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496114944 00000100:00100000:3.0:1790773351.638831:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1790773351.638841:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+22:3605:x1877761496114944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773351.638913:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+22:3605:x1877761496114944:12345-0@lo:400:kworker.0 Request processed in 73us (6762us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773351.638921:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1790773351.638972:0:17124:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496115968 00000100:00100000:3.0:1790773351.638976:0:17124:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496115968 00000100:00100000:3.0:1790773351.638999:0:17124:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496115456 00000100:00100000:3.0:1790773351.639002:0:17124:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496115456 00000100:00100000:3.0:1790773351.639014:0:17124:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496116096 00000100:00100000:3.0:1790773351.639017:0:17124:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496116096 00000100:00100000:3.0:1790773351.639026:0:17124:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496116224 00000100:00100000:3.0:1790773351.639029:0:17124:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496116224 00000100:00100000:3.0:1790773351.639056:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790773351.639063:0:17124:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3605:x1877761496115968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773351.639099:0:17124:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3605:x1877761496115968:12345-0@lo:400:kworker.0 Request processed in 37us (7016us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773351.639106:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790773351.639118:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790773351.639123:0:17124:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1877761496115456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773351.639156:0:17124:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1877761496115456:12345-0@lo:400:kworker.0 Request processed in 33us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773351.639173:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790773351.639200:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790773351.639372:0:17124:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1877761496116096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773351.639405:0:17124:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1877761496116096:12345-0@lo:400:kworker.0 Request processed in 38us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773351.639411:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790773351.639422:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790773351.639427:0:17124:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3606:x1877761496116224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773351.639456:0:17124:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3606:x1877761496116224:12345-0@lo:400:kworker.0 Request processed in 29us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773351.639462:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790773351.639485:0:18628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496115584 00000100:00100000:3.0:1790773351.639490:0:18628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496115584 00000100:00100000:3.0:1790773351.639517:0:18628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790773351.639524:0:18628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496115584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773351.639553:0:18628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496115584:12345-0@lo:400:kworker.0 Request processed in 30us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773351.639558:0:18628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1790773351.639577:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790773351.639594:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496115200:0@lo:8:kworker.0 00000100:00100000:3.0:1790773351.639624:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773351.639655:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496115328:0@lo:8:kworker.0 00000100:00100000:3.0:1790773351.639677:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773351.639694:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761496115712:0@lo:8:kworker.0 00000100:00100000:3.0:1790773351.639714:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773351.639751:0:18629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496115200 00000100:00100000:3.0:1790773351.639754:0:18629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496115200 00000100:00100000:3.0:1790773351.639772:0:18629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496115328 00000100:00100000:3.0:1790773351.639774:0:18629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496115328 00000100:00100000:3.0:1790773351.639780:0:18629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496115712 00000100:00100000:3.0:1790773351.639783:0:18629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496115712 00000100:00100000:3.0:1790773351.639790:0:18629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790773351.639794:0:18629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3603:x1877761496115200:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1790773351.639821:0:18629:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 494 last 0 00000020:00000080:3.0:1790773351.639853:0:18629:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xabf1cc0bc7842d8d 00002000:00100000:3.0:1790773351.639869:0:18629:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff93d143280000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b04 ocd_grant: 0 ocd_index: 0 ocd_group 0 00000100:00100000:1.0:1790773351.640006:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773351.640032:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3605:1877761496116352:0@lo:400:kworker.0 00000100:00100000:1.0:1790773351.640053:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773351.640072:0:17122:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496115840 00000100:00100000:1.0:1790773351.640075:0:17122:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496115840 00000100:00100000:1.0:1790773351.640099:0:17122:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496116352 00000100:00100000:1.0:1790773351.640101:0:17122:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496116352 00000100:00100000:1.0:1790773351.640120:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790773351.640126:0:17122:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3605:x1877761496115840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773351.640156:0:17122:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3605:x1877761496115840:12345-0@lo:400:kworker.0 Request processed in 30us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773351.640162:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790773351.640172:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790773351.640177:0:17122:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3605:x1877761496116352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773351.640239:0:17122:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3605:x1877761496116352:12345-0@lo:400:kworker.0 Request processed in 61us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773351.640245:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1790773351.640261:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1790773351.640287:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d2526cd180 x1877761496116352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773351.640301:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3605:1877761496116352:0@lo:400:kworker.0 00010000:00080000:1.0:1790773351.640315:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143ce0380 x1877761496115968/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773351.640336:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3605:1877761496115968:0@lo:400:kworker.0 00000100:00100000:1.0:1790773351.640360:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3605:1877761496114944:0@lo:400:kworker.0 00010000:00080000:1.0:1790773351.640369:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143ce1180 x1877761496115840/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773351.640376:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3605:1877761496115840:0@lo:400:kworker.0 00002000:00080000:3.0:1790773351.640496:0:18629:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1790773351.640500:0:18629:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1790773351.640578:0:18629:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1790773351.640602:0:18629:0:(import.c:65:import_set_state_nolock()) ffff93d14316f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790773351.640652:0:18629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3603:x1877761496115200:12345-0@lo:8:kworker.0 Request processed in 856us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773351.640658:0:18629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790773351.640672:0:18629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790773351.640676:0:18629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3603:x1877761496115328:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1790773351.640694:0:18629:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 494 last 0 00000020:00000080:3.0:1790773351.640711:0:18629:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xabf1cc0bc7842d94 00002000:00100000:3.0:1790773351.640719:0:18629:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff93d143cda800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b04 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1790773351.640723:0:18629:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1790773351.640725:0:18629:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1790773351.641162:0:18629:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1790773351.641192:0:18629:0:(import.c:65:import_set_state_nolock()) ffff93d143cd9800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790773351.641323:0:18629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3603:x1877761496115328:12345-0@lo:8:kworker.0 Request processed in 644us (1643us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773351.641330:0:18629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790773351.641346:0:18629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790773351.641351:0:18629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3603:x1877761496115712:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1790773351.641368:0:18629:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 494 last 0 00000020:00000080:3.0:1790773351.641384:0:18629:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xabf1cc0bc7842d9b 00002000:00100000:3.0:1790773351.641391:0:18629:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff93d143289000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b04 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1790773351.641394:0:18629:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1790773351.641396:0:18629:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1790773351.641424:0:18629:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1790773351.641436:0:18629:0:(import.c:65:import_set_state_nolock()) ffff93d14328e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790773351.641466:0:18629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3603:x1877761496115712:12345-0@lo:8:kworker.0 Request processed in 114us (1750us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773351.641472:0:18629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1790773351.641521:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143ce3100 x1877761496115584/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773351.641532:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496115584:0@lo:400:kworker.0 00010000:00080000:3.0:1790773351.641545:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d2526cce00 x1877761496116224/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773351.641553:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3606:1877761496116224:0@lo:400:kworker.0 00010000:00080000:3.0:1790773351.641564:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143ce1f80 x1877761496115456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773351.641572:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3606:1877761496115456:0@lo:400:kworker.0 00010000:00080000:3.0:1790773351.641596:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d2526ce300 x1877761496116096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773351.641605:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3606:1877761496116096:0@lo:400:kworker.0 00010000:00080000:1.0:1790773351.641748:0:3603:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143ce1c00 x1877761496115200/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790773376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773351.641757:0:3603:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790773351.641763:0:3603:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1790773351.641771:0:3603:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1790773351.641776:0:3603:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1790773351.641778:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d251282000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1790773351.641808:0:3603:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1790773351.641814:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496115200:0@lo:8:kworker.0 00010000:00080000:1.0:1790773351.641831:0:3603:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143ce1880 x1877761496115328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790773376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773351.641838:0:3603:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790773351.641842:0:3603:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1790773351.641847:0:3603:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1790773351.641850:0:3603:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1790773351.641852:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d143276000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1790773351.641864:0:3603:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1790773351.641868:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496115328:0@lo:8:kworker.0 00010000:00080000:1.0:1790773351.641903:0:3603:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143ce0e00 x1877761496115712/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790773376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773351.641910:0:3603:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790773351.641914:0:3603:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1790773351.641919:0:3603:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1790773351.641923:0:3603:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1790773351.641925:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d281bb7800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1790773351.641936:0:3603:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1790773351.641939:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761496115712:0@lo:8:kworker.0 00000100:00100000:0.0:1790773351.642107:0:17128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496115072:12345-0@lo:400:kworker.0 Request processed in 6761us (10085us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773351.642117:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000004:00080000:0.0:1790773351.642143:0:17148:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1790773351.642359:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496115072:0@lo:400:kworker.0 00000004:00080000:0.0:1790773351.642442:0:17148:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 494444236667ns, next at 0ns, rc = 0 00080000:00080000:0.0:1790773351.642449:0:17148:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1790773351.642508:0:17866:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1790773351.642535:0:17866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3abb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17866:1877761496116608:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1790773351.642567:0:17866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773351.642586:0:17866:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26c741cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790773351.642596:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790773351.642604:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496116480:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790773351.642628:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773351.642660:0:18631:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496116480 00000100:00100000:0.0:1790773351.642666:0:18631:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496116480 00000100:00100000:0.0:1790773351.642706:0:18631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790773351.642713:0:18631:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3604:x1877761496116480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790773351.642729:0:18631:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1790773351.642769:0:18631:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3604:x1877761496116480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773351.642775:0:18631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1790773351.642804:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27c3aad80 x1877761496116480/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773367 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773351.642819:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496116480:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790773351.642845:0:18629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496116608 00000100:00100000:0.0:1790773351.642848:0:18629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496116608 00000100:00100000:0.0:1790773351.642869:0:18629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000004:00080000:2.0:1790773351.642991:0:17146:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1790773351.643039:0:17146:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 494444833730ns, next at 0ns, rc = 0 00080000:00080000:2.0:1790773351.643043:0:17146:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1790773351.643082:0:17149:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:2.0:1790773351.643097:0:17149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9ca680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17149:1877761496116864:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1790773351.643127:0:17149:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773351.643143:0:17149:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d141fd2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790773351.643312:0:18629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17866:x1877761496116608:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1790773351.645726:0:18630:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496116864 00000100:00100000:0.0:1790773351.645741:0:18630:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496116864 00000100:00100000:0.0:1790773351.645801:0:18630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790773351.645811:0:18630:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17149:x1877761496116864:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1790773351.648056:0:17147:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:3.0:1790773351.648086:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa88700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17147:1877761496117120:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1790773351.648156:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773351.648181:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d24401f0c0 going to sleep for 11 seconds 00000004:00080000:3.0:1790773351.648246:0:17865:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1790773351.648337:0:17865:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 494450131978ns, next at 0ns, rc = 0 00080000:00080000:3.0:1790773351.648344:0:17865:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1790773351.648375:0:19203:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1790773351.648382:0:19203:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1790773351.648468:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496116992:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790773351.648498:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773351.648524:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790773351.648530:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496116736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790773351.648551:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773351.648573:0:18628:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1790773351.648580:0:18628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496117120 00000100:00100000:3.0:1790773351.648588:0:18628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496117120 00000100:00100000:3.0:1790773351.648736:0:19515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790773351.648745:0:19515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:17147:x1877761496117120:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1790773351.649479:0:18629:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1790773351.649495:0:18629:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1790773351.649572:0:18629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17866:x1877761496116608:12345-0@lo:7:osp-pre-1-1.0 Request processed in 6693us (7000us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773351.649581:0:18629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790773351.650623:0:18631:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496116992 00000100:00100000:0.0:1790773351.650634:0:18631:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496116992 00000100:00100000:0.0:1790773351.650667:0:18631:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496116736 00000100:00100000:0.0:1790773351.650670:0:18631:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496116736 00000100:00100000:0.0:1790773351.650687:0:18631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790773351.650695:0:18631:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3607:x1877761496116992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790773351.650717:0:18631:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1790773351.650782:0:18631:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3607:x1877761496116992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (2282us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773351.650789:0:18631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790773351.650803:0:18631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790773351.650809:0:18631:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3607:x1877761496116736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790773351.650818:0:18631:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1790773351.650844:0:18631:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3607:x1877761496116736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (2291us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773351.650849:0:18631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1790773351.651387:0:17866:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27c3abb80 x1877761496116608/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790773367 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773351.651402:0:17866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3abb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17866:1877761496116608:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1790773351.651428:0:17866:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1790773351.651466:0:17866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa88000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17866:1877761496117248:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1790773351.651505:0:17866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773351.651526:0:17866:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d24401f480 going to sleep for 11 seconds 00000100:00100000:3.0:1790773351.651552:0:18628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496117248 00000100:00100000:3.0:1790773351.651556:0:18628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496117248 00000100:00100000:3.0:1790773351.651584:0:18628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790773351.651590:0:18628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17866:x1877761496117248:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1790773351.651609:0:18628:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1790773351.651638:0:18628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17866:x1877761496117248:12345-0@lo:5:osp-pre-1-1.0 Request processed in 49us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773351.651644:0:18628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1790773351.651671:0:17866:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27fa88000 x1877761496117248/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790773367 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773351.651681:0:17866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa88000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17866:1877761496117248:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1790773351.651688:0:17866:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1790773351.651709:0:17866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa88000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17866:1877761496117376:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1790773351.651731:0:17866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773351.651745:0:17866:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d24401f480 going to sleep for 11 seconds 00002000:00080000:3.0:1790773351.653364:0:19515:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1790773351.653373:0:19515:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1790773351.653378:0:19515:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00010000:00080000:0.0:1790773351.654105:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f9cb100 x1877761496116736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773367 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773351.654131:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496116736:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1790773351.654145:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27fa8bb80 x1877761496116992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773367 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773351.654155:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496116992:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790773351.655061:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790773351.655069:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790773351.655984:0:18629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496117376 00000100:00100000:0.0:1790773351.655995:0:18629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496117376 00000100:00100000:0.0:1790773351.656049:0:18629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790773351.656060:0:18629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17866:x1877761496117376:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1790773351.656103:0:18629:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00080000:0.0:1790773351.658637:0:18630:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1790773351.658653:0:18630:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1790773351.658660:0:18630:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00000004:00080000:1.0:1790773351.658763:0:17102:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1790773351.658777:0:17102:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:3.0:1790773351.671017:0:19515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790773351.671030:0:19515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051b186ee/0xabf1cc0bc7842da2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.671061:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=494s v=(0 0) 00010000:00010000:3.0:1790773351.671066:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773351.671073:0:19515:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051b186ee/0xabf1cc0bc7842da2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.671090:0:19515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051b186ee/0xabf1cc0bc7842da2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.671102:0:19515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051b186ee/0xabf1cc0bc7842da2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.671111:0:19515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051b186ee/0xabf1cc0bc7842da2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.671131:0:19515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790773351.671145:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790773351.671151:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051b186ee/0xabf1cc0bc7842da2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.671159:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434aca00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:3.0:1790773351.671165:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051b186ee/0xabf1cc0bc7842da2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.671174:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051b186ee/0xabf1cc0bc7842da2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.671775:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051b186ee/0xabf1cc0bc7842da2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.671785:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051b186ee/0xabf1cc0bc7842da2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.671805:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773351.671807:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773351.671809:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790773351.673572:0:19515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790773351.673583:0:19515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f89911f/0xabf1cc0bc7842da9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.673598:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=494s v=(0 0) 00010000:00010000:3.0:1790773351.673601:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773351.673608:0:19515:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f89911f/0xabf1cc0bc7842da9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.673621:0:19515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f89911f/0xabf1cc0bc7842da9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.673630:0:19515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f89911f/0xabf1cc0bc7842da9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.673638:0:19515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f89911f/0xabf1cc0bc7842da9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.673677:0:19515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790773351.674337:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790773351.674348:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f89911f/0xabf1cc0bc7842da9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.674358:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434adc00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:2.0:1790773351.674363:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f89911f/0xabf1cc0bc7842da9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.674374:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f89911f/0xabf1cc0bc7842da9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.674395:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f89911f/0xabf1cc0bc7842da9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.674404:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f89911f/0xabf1cc0bc7842da9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.674439:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773351.674441:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773351.674443:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790773351.675379:0:19515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790773351.675389:0:19515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000240212df/0xabf1cc0bc7842db0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.675404:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=494s v=(0 0) 00010000:00010000:3.0:1790773351.675409:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773351.675414:0:19515:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000240212df/0xabf1cc0bc7842db0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.675427:0:19515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000240212df/0xabf1cc0bc7842db0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.675435:0:19515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000240212df/0xabf1cc0bc7842db0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.675443:0:19515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000240212df/0xabf1cc0bc7842db0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.675461:0:19515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790773351.675470:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790773351.675475:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000240212df/0xabf1cc0bc7842db0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.675483:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a3000 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:3.0:1790773351.675493:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000240212df/0xabf1cc0bc7842db0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.675501:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000240212df/0xabf1cc0bc7842db0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.675513:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000240212df/0xabf1cc0bc7842db0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.675519:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000240212df/0xabf1cc0bc7842db0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.675533:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773351.675535:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773351.675537:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790773351.679846:0:19515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790773351.679860:0:19515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051327c90/0xabf1cc0bc7842db7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.679889:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=494s v=(0 0) 00010000:00010000:2.0:1790773351.679894:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790773351.679900:0:19515:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051327c90/0xabf1cc0bc7842db7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.679916:0:19515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051327c90/0xabf1cc0bc7842db7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.679926:0:19515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051327c90/0xabf1cc0bc7842db7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.679934:0:19515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051327c90/0xabf1cc0bc7842db7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.679955:0:19515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790773351.679966:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790773351.679972:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051327c90/0xabf1cc0bc7842db7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.679998:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc4a00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:2.0:1790773351.680002:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051327c90/0xabf1cc0bc7842db7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.680011:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051327c90/0xabf1cc0bc7842db7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.680027:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051327c90/0xabf1cc0bc7842db7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.680034:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051327c90/0xabf1cc0bc7842db7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.680056:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773351.680058:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773351.680059:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790773351.680554:0:19515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790773351.680562:0:19515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000715485c4/0xabf1cc0bc7842dbe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.680573:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=494s v=(0 0) 00010000:00010000:2.0:1790773351.680576:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790773351.680580:0:19515:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000715485c4/0xabf1cc0bc7842dbe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.680591:0:19515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000715485c4/0xabf1cc0bc7842dbe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.680605:0:19515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000715485c4/0xabf1cc0bc7842dbe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.680613:0:19515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000715485c4/0xabf1cc0bc7842dbe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.680628:0:19515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790773351.681048:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790773351.681057:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000715485c4/0xabf1cc0bc7842dbe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.681066:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc5000 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:3.0:1790773351.681070:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000715485c4/0xabf1cc0bc7842dbe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.681079:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000715485c4/0xabf1cc0bc7842dbe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.681091:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000715485c4/0xabf1cc0bc7842dbe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.681106:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000715485c4/0xabf1cc0bc7842dbe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.681123:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773351.681125:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773351.681127:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790773351.684457:0:19515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790773351.684475:0:19515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2276468/0xabf1cc0bc7842dc5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.684497:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=494s v=(0 0) 00010000:00010000:2.0:1790773351.684502:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790773351.684511:0:19515:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2276468/0xabf1cc0bc7842dc5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.684529:0:19515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2276468/0xabf1cc0bc7842dc5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.684540:0:19515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2276468/0xabf1cc0bc7842dc5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.684549:0:19515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2276468/0xabf1cc0bc7842dc5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.684598:0:19515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790773351.684620:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790773351.684627:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2276468/0xabf1cc0bc7842dc5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.684635:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc4000 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:2.0:1790773351.684639:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2276468/0xabf1cc0bc7842dc5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.684649:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2276468/0xabf1cc0bc7842dc5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.684666:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2276468/0xabf1cc0bc7842dc5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.684673:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2276468/0xabf1cc0bc7842dc5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.684693:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773351.684694:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773351.684696:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790773351.693535:0:19515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790773351.693552:0:19515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034fac215/0xabf1cc0bc7842dcc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.693571:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=494s v=(0 0) 00010000:00010000:2.0:1790773351.693586:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790773351.693593:0:19515:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034fac215/0xabf1cc0bc7842dcc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.693609:0:19515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034fac215/0xabf1cc0bc7842dcc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.693621:0:19515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034fac215/0xabf1cc0bc7842dcc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.693630:0:19515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034fac215/0xabf1cc0bc7842dcc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.693647:0:19515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790773351.694172:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790773351.694181:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034fac215/0xabf1cc0bc7842dcc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.694218:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc5800 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:3.0:1790773351.694225:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034fac215/0xabf1cc0bc7842dcc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.694235:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034fac215/0xabf1cc0bc7842dcc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.694254:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034fac215/0xabf1cc0bc7842dcc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.694262:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034fac215/0xabf1cc0bc7842dcc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.694284:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773351.694286:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773351.694288:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790773351.695855:0:19515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790773351.695868:0:19515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012431c86/0xabf1cc0bc7842dd3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.695892:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=494s v=(0 0) 00010000:00010000:3.0:1790773351.695896:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773351.695903:0:19515:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012431c86/0xabf1cc0bc7842dd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.695917:0:19515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012431c86/0xabf1cc0bc7842dd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.695927:0:19515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012431c86/0xabf1cc0bc7842dd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.695937:0:19515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012431c86/0xabf1cc0bc7842dd3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.695963:0:19515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790773351.696522:0:19515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790773351.696528:0:19515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb30bf7b/0xabf1cc0bc7842dda lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.696538:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=494s v=(0 0) 00010000:00010000:3.0:1790773351.696541:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773351.696546:0:19515:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb30bf7b/0xabf1cc0bc7842dda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.696567:0:19515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb30bf7b/0xabf1cc0bc7842dda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.696576:0:19515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb30bf7b/0xabf1cc0bc7842dda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.696584:0:19515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb30bf7b/0xabf1cc0bc7842dda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.696599:0:19515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1790773351.696609:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790773351.696614:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012431c86/0xabf1cc0bc7842dd3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.696622:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a2200 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:3.0:1790773351.696626:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012431c86/0xabf1cc0bc7842dd3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.696634:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012431c86/0xabf1cc0bc7842dd3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.696650:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012431c86/0xabf1cc0bc7842dd3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.696657:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012431c86/0xabf1cc0bc7842dd3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.696681:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790773351.696685:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb30bf7b/0xabf1cc0bc7842dda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.696691:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a3600 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:3.0:1790773351.696695:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb30bf7b/0xabf1cc0bc7842dda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.696703:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb30bf7b/0xabf1cc0bc7842dda lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.696712:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb30bf7b/0xabf1cc0bc7842dda lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.696718:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb30bf7b/0xabf1cc0bc7842dda lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.696730:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773351.696732:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773351.696733:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773351.696874:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790773351.697731:0:19515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790773351.697740:0:19515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d29e9e6/0xabf1cc0bc7842de1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.697757:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=494s v=(0 0) 00010000:00010000:2.0:1790773351.697761:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790773351.697766:0:19515:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d29e9e6/0xabf1cc0bc7842de1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.697779:0:19515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d29e9e6/0xabf1cc0bc7842de1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.697789:0:19515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d29e9e6/0xabf1cc0bc7842de1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.697804:0:19515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d29e9e6/0xabf1cc0bc7842de1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.697821:0:19515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790773351.698233:0:19515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790773351.698239:0:19515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f8391af/0xabf1cc0bc7842de8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.698248:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=494s v=(0 0) 00010000:00010000:2.0:1790773351.698251:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790773351.698254:0:19515:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f8391af/0xabf1cc0bc7842de8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.698264:0:19515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f8391af/0xabf1cc0bc7842de8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.698270:0:19515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f8391af/0xabf1cc0bc7842de8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.698276:0:19515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f8391af/0xabf1cc0bc7842de8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.698290:0:19515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1790773351.698298:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790773351.698302:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d29e9e6/0xabf1cc0bc7842de1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.698316:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc5600 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:2.0:1790773351.698320:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d29e9e6/0xabf1cc0bc7842de1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.698328:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d29e9e6/0xabf1cc0bc7842de1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.698341:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d29e9e6/0xabf1cc0bc7842de1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.698348:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d29e9e6/0xabf1cc0bc7842de1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.698364:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790773351.698367:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f8391af/0xabf1cc0bc7842de8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.698374:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc4200 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:2.0:1790773351.698377:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f8391af/0xabf1cc0bc7842de8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.698384:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f8391af/0xabf1cc0bc7842de8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.698393:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f8391af/0xabf1cc0bc7842de8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.698407:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f8391af/0xabf1cc0bc7842de8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.698436:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773351.698438:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773351.698439:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773351.702813:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790773351.706683:0:19515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790773351.706699:0:19515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac34cf05/0xabf1cc0bc7842def lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.706720:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=494s v=(0 0) 00010000:00010000:3.0:1790773351.706732:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773351.706739:0:19515:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac34cf05/0xabf1cc0bc7842def lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.706757:0:19515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac34cf05/0xabf1cc0bc7842def lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.706768:0:19515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac34cf05/0xabf1cc0bc7842def lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.706777:0:19515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac34cf05/0xabf1cc0bc7842def lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.706804:0:19515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790773351.709548:0:19515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790773351.709562:0:19515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042c2b8c0/0xabf1cc0bc7842df6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.709581:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=494s v=(0 0) 00010000:00010000:3.0:1790773351.709586:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773351.709593:0:19515:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042c2b8c0/0xabf1cc0bc7842df6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.709608:0:19515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042c2b8c0/0xabf1cc0bc7842df6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.709620:0:19515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042c2b8c0/0xabf1cc0bc7842df6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.709636:0:19515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042c2b8c0/0xabf1cc0bc7842df6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.709655:0:19515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1790773351.709666:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790773351.709672:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac34cf05/0xabf1cc0bc7842def lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.709680:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a3e00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:3.0:1790773351.709685:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac34cf05/0xabf1cc0bc7842def lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.709694:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac34cf05/0xabf1cc0bc7842def lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.709709:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac34cf05/0xabf1cc0bc7842def lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.709716:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac34cf05/0xabf1cc0bc7842def lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.709734:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790773351.709738:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042c2b8c0/0xabf1cc0bc7842df6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.709757:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a2800 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:3.0:1790773351.709760:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042c2b8c0/0xabf1cc0bc7842df6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.709768:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042c2b8c0/0xabf1cc0bc7842df6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.709779:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042c2b8c0/0xabf1cc0bc7842df6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.709786:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042c2b8c0/0xabf1cc0bc7842df6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.709799:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773351.709801:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773351.709803:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790773351.710389:0:18630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790773351.710398:0:18630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006926c001/0xabf1cc0bc7842dfd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.710411:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=494s v=(0 0) 00010000:00010000:0.0:1790773351.710414:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790773351.710418:0:18630:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006926c001/0xabf1cc0bc7842dfd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.710433:0:18630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006926c001/0xabf1cc0bc7842dfd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.710440:0:18630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006926c001/0xabf1cc0bc7842dfd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.710447:0:18630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006926c001/0xabf1cc0bc7842dfd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.710463:0:18630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790773351.710612:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790773351.710617:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006926c001/0xabf1cc0bc7842dfd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.710625:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074a000 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:0.0:1790773351.710628:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006926c001/0xabf1cc0bc7842dfd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.710637:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006926c001/0xabf1cc0bc7842dfd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.710650:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006926c001/0xabf1cc0bc7842dfd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.710657:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006926c001/0xabf1cc0bc7842dfd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.710670:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773351.710672:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773351.710674:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790773351.714318:0:19515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790773351.714331:0:19515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000240212df/0xabf1cc0bc7842e04 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.714352:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=494s v=(0 0) 00010000:00010000:3.0:1790773351.714356:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773351.714363:0:19515:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000240212df/0xabf1cc0bc7842e04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.714379:0:19515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000240212df/0xabf1cc0bc7842e04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.714397:0:19515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000240212df/0xabf1cc0bc7842e04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.714405:0:19515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000240212df/0xabf1cc0bc7842e04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.714428:0:19515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790773351.714944:0:19515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790773351.714950:0:19515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031c9ebac/0xabf1cc0bc7842e0b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.714959:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=494s v=(0 0) 00010000:00010000:3.0:1790773351.714962:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773351.714966:0:19515:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031c9ebac/0xabf1cc0bc7842e0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.714976:0:19515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031c9ebac/0xabf1cc0bc7842e0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.714984:0:19515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031c9ebac/0xabf1cc0bc7842e0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.714991:0:19515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000031c9ebac/0xabf1cc0bc7842e0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.715009:0:19515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1790773351.715442:0:19515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790773351.715449:0:19515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000639c1d74/0xabf1cc0bc7842e12 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.715457:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=494s v=(0 0) 00010000:00010000:3.0:1790773351.715461:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773351.715464:0:19515:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000639c1d74/0xabf1cc0bc7842e12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.715473:0:19515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000639c1d74/0xabf1cc0bc7842e12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.715481:0:19515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000639c1d74/0xabf1cc0bc7842e12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.715488:0:19515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000639c1d74/0xabf1cc0bc7842e12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.715504:0:19515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1790773351.715878:0:19515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790773351.715885:0:19515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec89c7e8/0xabf1cc0bc7842e19 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.715894:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=494s v=(0 0) 00010000:00010000:3.0:1790773351.715903:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773351.715908:0:19515:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec89c7e8/0xabf1cc0bc7842e19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.715919:0:19515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec89c7e8/0xabf1cc0bc7842e19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.715926:0:19515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec89c7e8/0xabf1cc0bc7842e19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.715933:0:19515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec89c7e8/0xabf1cc0bc7842e19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.715942:0:19515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1790773351.716308:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1790773351.716318:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000240212df/0xabf1cc0bc7842e04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.716327:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a3000 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:2.0:1790773351.716331:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000240212df/0xabf1cc0bc7842e04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.716341:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000240212df/0xabf1cc0bc7842e04 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.716357:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000240212df/0xabf1cc0bc7842e04 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.716364:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000240212df/0xabf1cc0bc7842e04 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.716381:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790773351.716384:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000031c9ebac/0xabf1cc0bc7842e0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.716399:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a3200 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:2.0:1790773351.716402:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000031c9ebac/0xabf1cc0bc7842e0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.716410:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000031c9ebac/0xabf1cc0bc7842e0b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.716420:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000031c9ebac/0xabf1cc0bc7842e0b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.716425:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031c9ebac/0xabf1cc0bc7842e0b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.716436:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790773351.716439:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000639c1d74/0xabf1cc0bc7842e12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.716445:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a2e00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:2.0:1790773351.716449:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000639c1d74/0xabf1cc0bc7842e12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.716456:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000639c1d74/0xabf1cc0bc7842e12 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.716464:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000639c1d74/0xabf1cc0bc7842e12 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.716476:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000639c1d74/0xabf1cc0bc7842e12 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.716489:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790773351.716491:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec89c7e8/0xabf1cc0bc7842e19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.716497:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a3c00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:2.0:1790773351.716500:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec89c7e8/0xabf1cc0bc7842e19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.716507:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec89c7e8/0xabf1cc0bc7842e19 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.716515:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec89c7e8/0xabf1cc0bc7842e19 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.716522:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec89c7e8/0xabf1cc0bc7842e19 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.716531:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773351.716532:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773351.716534:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790773351.718671:0:19515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790773351.718685:0:19515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce3d9e0a/0xabf1cc0bc7842e20 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.718703:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=494s v=(0 0) 00010000:00010000:3.0:1790773351.718707:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773351.718713:0:19515:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce3d9e0a/0xabf1cc0bc7842e20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.718727:0:19515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce3d9e0a/0xabf1cc0bc7842e20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.718737:0:19515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce3d9e0a/0xabf1cc0bc7842e20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.718754:0:19515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce3d9e0a/0xabf1cc0bc7842e20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.718771:0:19515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790773351.719459:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790773351.719470:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce3d9e0a/0xabf1cc0bc7842e20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.719487:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a2000 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:2.0:1790773351.719492:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce3d9e0a/0xabf1cc0bc7842e20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.719502:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce3d9e0a/0xabf1cc0bc7842e20 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.719521:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce3d9e0a/0xabf1cc0bc7842e20 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.719528:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce3d9e0a/0xabf1cc0bc7842e20 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.719552:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773351.719554:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773351.719556:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773351.722310:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790773351.724110:0:18630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790773351.724123:0:18630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005dcf15f4/0xabf1cc0bc7842e27 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.724142:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=494s v=(0 0) 00010000:00010000:0.0:1790773351.724146:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790773351.724153:0:18630:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005dcf15f4/0xabf1cc0bc7842e27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.724200:0:18630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005dcf15f4/0xabf1cc0bc7842e27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.724401:0:18630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005dcf15f4/0xabf1cc0bc7842e27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.724411:0:18630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005dcf15f4/0xabf1cc0bc7842e27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.724433:0:18630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1790773351.724512:0:17855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00010000:00010000:0.0:1790773351.724548:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790773351.724554:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005dcf15f4/0xabf1cc0bc7842e27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.724562:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074a600 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:0.0:1790773351.724567:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005dcf15f4/0xabf1cc0bc7842e27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.724577:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005dcf15f4/0xabf1cc0bc7842e27 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.724593:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005dcf15f4/0xabf1cc0bc7842e27 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.724612:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005dcf15f4/0xabf1cc0bc7842e27 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.724628:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773351.724630:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773351.724631:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790773351.734064:0:19515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790773351.734079:0:19515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edbcaa1a/0xabf1cc0bc7842e2e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.734099:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1790773351.734104:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790773351.734110:0:19515:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000edbcaa1a/0xabf1cc0bc7842e2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.734130:0:19515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000edbcaa1a/0xabf1cc0bc7842e2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.734159:0:19515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edbcaa1a/0xabf1cc0bc7842e2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.734166:0:19515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000edbcaa1a/0xabf1cc0bc7842e2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.734198:0:19515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790773351.734231:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790773351.734238:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000edbcaa1a/0xabf1cc0bc7842e2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.734246:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12aa00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:1.0:1790773351.734251:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000edbcaa1a/0xabf1cc0bc7842e2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.734260:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000edbcaa1a/0xabf1cc0bc7842e2e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.734279:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000edbcaa1a/0xabf1cc0bc7842e2e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.734286:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000edbcaa1a/0xabf1cc0bc7842e2e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.734302:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773351.734309:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773351.734311:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790773351.739072:0:18630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790773351.739092:0:18630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006926c001/0xabf1cc0bc7842e35 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.739117:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=494s v=(0 0) 00010000:00010000:0.0:1790773351.739122:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790773351.739129:0:18630:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006926c001/0xabf1cc0bc7842e35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.739144:0:18630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006926c001/0xabf1cc0bc7842e35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.739154:0:18630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006926c001/0xabf1cc0bc7842e35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.739162:0:18630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006926c001/0xabf1cc0bc7842e35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.739190:0:18630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790773351.741115:0:19515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790773351.741130:0:19515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f49b4351/0xabf1cc0bc7842e3c lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.741148:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1790773351.741152:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790773351.741158:0:19515:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f49b4351/0xabf1cc0bc7842e3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.741173:0:19515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f49b4351/0xabf1cc0bc7842e3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790773351.741310:0:18630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790773351.741324:0:18630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006822e5a4/0xabf1cc0bc7842e43 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.741332:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=494s v=(0 0) 00010000:00010000:0.0:1790773351.741335:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790773351.741339:0:18630:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006822e5a4/0xabf1cc0bc7842e43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.741348:0:18630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006822e5a4/0xabf1cc0bc7842e43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.741357:0:18630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006822e5a4/0xabf1cc0bc7842e43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.741365:0:18630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006822e5a4/0xabf1cc0bc7842e43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.741385:0:18630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000001:00080000:2.0:1790773351.742317:0:19441:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1790773351.742337:0:19441:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1790773351.742340:0:19441:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:0.0:1790773351.743198:0:18630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790773351.743222:0:18630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082df13b6/0xabf1cc0bc7842e4a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.743237:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=494s v=(0 0) 00010000:00010000:0.0:1790773351.743241:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790773351.743246:0:18630:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082df13b6/0xabf1cc0bc7842e4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.743259:0:18630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082df13b6/0xabf1cc0bc7842e4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.743277:0:18630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082df13b6/0xabf1cc0bc7842e4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.743285:0:18630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000082df13b6/0xabf1cc0bc7842e4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.743296:0:18630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1790773351.743656:0:19515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f49b4351/0xabf1cc0bc7842e3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.743667:0:19515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f49b4351/0xabf1cc0bc7842e3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.743678:0:19515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1790773351.744104:0:19515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790773351.744110:0:19515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ff3bd0f/0xabf1cc0bc7842e51 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.744121:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1790773351.744124:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790773351.744129:0:19515:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ff3bd0f/0xabf1cc0bc7842e51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.744149:0:19515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ff3bd0f/0xabf1cc0bc7842e51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.744158:0:19515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ff3bd0f/0xabf1cc0bc7842e51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.744165:0:19515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ff3bd0f/0xabf1cc0bc7842e51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.744175:0:19515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1790773351.744981:0:19515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790773351.744989:0:19515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ad13755/0xabf1cc0bc7842e58 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.745000:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1790773351.745003:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790773351.745007:0:19515:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ad13755/0xabf1cc0bc7842e58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.745018:0:19515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ad13755/0xabf1cc0bc7842e58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.745027:0:19515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ad13755/0xabf1cc0bc7842e58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.745045:0:19515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ad13755/0xabf1cc0bc7842e58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.745054:0:19515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:0.0:1790773351.745989:0:18630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790773351.746001:0:18630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037d6d858/0xabf1cc0bc7842e5f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.746012:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=494s v=(0 0) 00010000:00010000:0.0:1790773351.746015:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790773351.746020:0:18630:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037d6d858/0xabf1cc0bc7842e5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.746031:0:18630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037d6d858/0xabf1cc0bc7842e5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.746038:0:18630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037d6d858/0xabf1cc0bc7842e5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.746046:0:18630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037d6d858/0xabf1cc0bc7842e5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.746065:0:18630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:0.0:1790773351.746201:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1790773351.746223:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006926c001/0xabf1cc0bc7842e35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.746232:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074a000 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:0.0:1790773351.746236:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006926c001/0xabf1cc0bc7842e35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.746246:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006926c001/0xabf1cc0bc7842e35 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.746264:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006926c001/0xabf1cc0bc7842e35 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.746271:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006926c001/0xabf1cc0bc7842e35 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.746290:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1790773351.746293:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006822e5a4/0xabf1cc0bc7842e43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.746300:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074b600 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:0.0:1790773351.746303:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006822e5a4/0xabf1cc0bc7842e43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.746322:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006822e5a4/0xabf1cc0bc7842e43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.746332:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006822e5a4/0xabf1cc0bc7842e43 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.746339:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006822e5a4/0xabf1cc0bc7842e43 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.746351:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1790773351.746354:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082df13b6/0xabf1cc0bc7842e4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.746361:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074ba00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:0.0:1790773351.746364:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082df13b6/0xabf1cc0bc7842e4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.746372:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082df13b6/0xabf1cc0bc7842e4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.746380:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082df13b6/0xabf1cc0bc7842e4a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.746387:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082df13b6/0xabf1cc0bc7842e4a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.746410:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1790773351.746415:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f49b4351/0xabf1cc0bc7842e3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.746422:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12b200 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:0.0:1790773351.746426:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f49b4351/0xabf1cc0bc7842e3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.746433:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f49b4351/0xabf1cc0bc7842e3c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.746446:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f49b4351/0xabf1cc0bc7842e3c lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.746453:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f49b4351/0xabf1cc0bc7842e3c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.746465:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790773351.746468:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ff3bd0f/0xabf1cc0bc7842e51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.746474:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12ba00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:0.0:1790773351.746477:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ff3bd0f/0xabf1cc0bc7842e51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.746495:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ff3bd0f/0xabf1cc0bc7842e51 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.746506:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ff3bd0f/0xabf1cc0bc7842e51 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.746513:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ff3bd0f/0xabf1cc0bc7842e51 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.746526:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790773351.746530:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ad13755/0xabf1cc0bc7842e58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.746536:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12ac00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:0.0:1790773351.746539:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ad13755/0xabf1cc0bc7842e58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.746547:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ad13755/0xabf1cc0bc7842e58 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.746556:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ad13755/0xabf1cc0bc7842e58 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.746563:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ad13755/0xabf1cc0bc7842e58 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.746586:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790773351.746590:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037d6d858/0xabf1cc0bc7842e5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.746597:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074b800 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:0.0:1790773351.746600:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037d6d858/0xabf1cc0bc7842e5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.746607:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037d6d858/0xabf1cc0bc7842e5f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.746617:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037d6d858/0xabf1cc0bc7842e5f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.746624:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037d6d858/0xabf1cc0bc7842e5f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.746635:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773351.746637:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773351.746639:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773351.746668:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790773351.746938:0:19515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790773351.746943:0:19515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4f57677/0xabf1cc0bc7842e66 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.746952:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1790773351.746956:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790773351.746960:0:19515:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4f57677/0xabf1cc0bc7842e66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.746969:0:19515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4f57677/0xabf1cc0bc7842e66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.746977:0:19515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4f57677/0xabf1cc0bc7842e66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.746984:0:19515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4f57677/0xabf1cc0bc7842e66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.747009:0:19515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790773351.749111:0:19515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790773351.749126:0:19515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bec46ce/0xabf1cc0bc7842e6d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.749150:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1790773351.749155:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790773351.749161:0:19515:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008bec46ce/0xabf1cc0bc7842e6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.749175:0:19515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008bec46ce/0xabf1cc0bc7842e6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.749196:0:19515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bec46ce/0xabf1cc0bc7842e6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.749221:0:19515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008bec46ce/0xabf1cc0bc7842e6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.749240:0:19515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1790773351.749981:0:18629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:17866:x1877761496117376:12345-0@lo:5:osp-pre-1-1.0 Request processed in 93917us (98243us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1790773351.749993:0:18629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790773351.750056:0:17866:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1790773351.750064:0:17866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa88000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17866:1877761496117376:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1790773351.750080:0:17866:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1790773351.750135:0:17866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa88000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17866:1877761496117504:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1790773351.750173:0:17866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773351.750235:0:17866:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d251cfd900 going to sleep for 11 seconds 00000100:00100000:3.0:1790773351.750259:0:17133:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496117504 00000100:00100000:3.0:1790773351.750266:0:17133:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496117504 00000100:00100000:3.0:1790773351.750307:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790773351.750315:0:17133:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17866:x1877761496117504:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1790773351.750361:0:17133:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17866:x1877761496117504:12345-0@lo:900:osp-pre-1-1.0 Request processed in 47us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773351.750368:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1790773351.750397:0:17866:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27fa88000 x1877761496117504/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790773367 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773351.750407:0:17866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa88000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17866:1877761496117504:0@lo:900:osp-pre-1-1.0 00010000:00010000:0.0:1790773351.753749:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790773351.753779:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4f57677/0xabf1cc0bc7842e66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.753796:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12ae00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:0.0:1790773351.753814:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4f57677/0xabf1cc0bc7842e66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.753828:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4f57677/0xabf1cc0bc7842e66 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.753853:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4f57677/0xabf1cc0bc7842e66 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.753861:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4f57677/0xabf1cc0bc7842e66 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.753894:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790773351.753899:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008bec46ce/0xabf1cc0bc7842e6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.753905:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12a200 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:0.0:1790773351.753907:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008bec46ce/0xabf1cc0bc7842e6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.753914:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008bec46ce/0xabf1cc0bc7842e6d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.753924:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008bec46ce/0xabf1cc0bc7842e6d lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.753930:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008bec46ce/0xabf1cc0bc7842e6d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.753949:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773351.753951:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773351.753952:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773351.753959:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790773351.755425:0:18630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790773351.755440:0:18630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edbcaa1a/0xabf1cc0bc7842e74 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.755461:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1790773351.755466:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790773351.755473:0:18630:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000edbcaa1a/0xabf1cc0bc7842e74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.755489:0:18630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000edbcaa1a/0xabf1cc0bc7842e74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.755513:0:18630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edbcaa1a/0xabf1cc0bc7842e74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.755522:0:18630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000edbcaa1a/0xabf1cc0bc7842e74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.755547:0:18630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790773351.755794:0:19515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790773351.755800:0:19515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b8f81d9/0xabf1cc0bc7842e7b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.755809:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1790773351.755812:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790773351.755816:0:19515:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b8f81d9/0xabf1cc0bc7842e7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.755825:0:19515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b8f81d9/0xabf1cc0bc7842e7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.755834:0:19515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b8f81d9/0xabf1cc0bc7842e7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.755840:0:19515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b8f81d9/0xabf1cc0bc7842e7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.755865:0:19515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1790773351.756031:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790773351.756039:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000edbcaa1a/0xabf1cc0bc7842e74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.756047:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12aa00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:0.0:1790773351.756051:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000edbcaa1a/0xabf1cc0bc7842e74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.756060:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000edbcaa1a/0xabf1cc0bc7842e74 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.756074:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000edbcaa1a/0xabf1cc0bc7842e74 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.756082:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000edbcaa1a/0xabf1cc0bc7842e74 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.756097:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790773351.756101:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b8f81d9/0xabf1cc0bc7842e7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.756107:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12be00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:0.0:1790773351.756116:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b8f81d9/0xabf1cc0bc7842e7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.756124:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b8f81d9/0xabf1cc0bc7842e7b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.756135:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b8f81d9/0xabf1cc0bc7842e7b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.756141:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b8f81d9/0xabf1cc0bc7842e7b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.756152:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773351.756154:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773351.756155:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773351.756160:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790773351.758453:0:18630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790773351.758467:0:18630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060df18b3/0xabf1cc0bc7842e82 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.758484:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1790773351.758488:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790773351.758493:0:18630:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060df18b3/0xabf1cc0bc7842e82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.758508:0:18630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060df18b3/0xabf1cc0bc7842e82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.758518:0:18630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060df18b3/0xabf1cc0bc7842e82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.758526:0:18630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060df18b3/0xabf1cc0bc7842e82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.758554:0:18630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790773351.762481:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790773351.762515:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496117632:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790773351.762597:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773351.762645:0:17127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496117632 00000100:00100000:1.0:1790773351.762653:0:17127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496117632 00000100:00100000:1.0:1790773351.762714:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790773351.762723:0:17127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496117632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790773351.762762:0:17127:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1790773351.762808:0:17127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496117632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773351.762815:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790773351.762862:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496117632:0@lo:41:osp-pre-1-0.0 00002000:00010000:1.0:1790773351.762976:0:19515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790773351.762987:0:19515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d352d4fd/0xabf1cc0bc7842e89 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.763007:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1790773351.763012:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790773351.763021:0:19515:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d352d4fd/0xabf1cc0bc7842e89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.763035:0:19515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d352d4fd/0xabf1cc0bc7842e89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.763046:0:19515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d352d4fd/0xabf1cc0bc7842e89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.763055:0:19515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d352d4fd/0xabf1cc0bc7842e89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.763073:0:19515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1790773351.763928:0:19515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790773351.763937:0:19515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f8391af/0xabf1cc0bc7842e90 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.763951:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=494s v=(0 0) 00010000:00010000:2.0:1790773351.763955:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790773351.763967:0:19515:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f8391af/0xabf1cc0bc7842e90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.763979:0:19515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f8391af/0xabf1cc0bc7842e90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.763989:0:19515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f8391af/0xabf1cc0bc7842e90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.763996:0:19515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f8391af/0xabf1cc0bc7842e90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.764007:0:19515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1790773351.764261:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790773351.764270:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060df18b3/0xabf1cc0bc7842e82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.764279:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12a800 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:0.0:1790773351.764284:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060df18b3/0xabf1cc0bc7842e82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.764295:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060df18b3/0xabf1cc0bc7842e82 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.764314:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060df18b3/0xabf1cc0bc7842e82 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.764329:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060df18b3/0xabf1cc0bc7842e82 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.764348:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790773351.764352:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d352d4fd/0xabf1cc0bc7842e89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.764359:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12a400 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:0.0:1790773351.764362:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d352d4fd/0xabf1cc0bc7842e89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.764369:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d352d4fd/0xabf1cc0bc7842e89 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.764381:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d352d4fd/0xabf1cc0bc7842e89 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.764389:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d352d4fd/0xabf1cc0bc7842e89 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.764400:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790773351.764404:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f8391af/0xabf1cc0bc7842e90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.764410:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc4200 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:0.0:1790773351.764420:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f8391af/0xabf1cc0bc7842e90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.764428:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f8391af/0xabf1cc0bc7842e90 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.764438:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f8391af/0xabf1cc0bc7842e90 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.764444:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f8391af/0xabf1cc0bc7842e90 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.764457:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773351.764459:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773351.764461:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773351.764480:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790773351.767506:0:18630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790773351.767520:0:18630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042c2b8c0/0xabf1cc0bc7842e97 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.767538:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=494s v=(0 0) 00010000:00010000:3.0:1790773351.767542:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773351.767547:0:18630:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042c2b8c0/0xabf1cc0bc7842e97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.767563:0:18630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042c2b8c0/0xabf1cc0bc7842e97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.767572:0:18630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042c2b8c0/0xabf1cc0bc7842e97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.767579:0:18630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042c2b8c0/0xabf1cc0bc7842e97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.767597:0:18630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790773351.767796:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790773351.767802:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042c2b8c0/0xabf1cc0bc7842e97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.767811:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a2800 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:3.0:1790773351.767815:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042c2b8c0/0xabf1cc0bc7842e97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.767837:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042c2b8c0/0xabf1cc0bc7842e97 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.767853:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042c2b8c0/0xabf1cc0bc7842e97 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.767860:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042c2b8c0/0xabf1cc0bc7842e97 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.767879:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773351.767881:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773351.767883:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790773351.768152:0:18630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790773351.768158:0:18630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac34cf05/0xabf1cc0bc7842e9e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.768166:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=494s v=(0 0) 00010000:00010000:3.0:1790773351.768170:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773351.768174:0:18630:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac34cf05/0xabf1cc0bc7842e9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790773351.768283:0:19515:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790773351.768290:0:19515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008001acb1/0xabf1cc0bc7842ea5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.768299:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1790773351.768301:0:19515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790773351.768305:0:19515:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008001acb1/0xabf1cc0bc7842ea5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.768315:0:19515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008001acb1/0xabf1cc0bc7842ea5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.768323:0:19515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008001acb1/0xabf1cc0bc7842ea5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.768330:0:19515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008001acb1/0xabf1cc0bc7842ea5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.768350:0:19515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1790773351.768400:0:19515:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:1.0:1790773351.768509:0:19515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:17147:x1877761496117120:12345-0@lo:5:osp-pre-0-0.0 Request processed in 119760us (120347us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773351.768522:0:19515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1790773351.768602:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790773351.768609:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008001acb1/0xabf1cc0bc7842ea5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.768617:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12b000 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:0.0:1790773351.768620:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008001acb1/0xabf1cc0bc7842ea5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.768628:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008001acb1/0xabf1cc0bc7842ea5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.768640:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008001acb1/0xabf1cc0bc7842ea5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.768657:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008001acb1/0xabf1cc0bc7842ea5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.768674:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773351.768676:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773351.768677:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773351.774266:0:18630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac34cf05/0xabf1cc0bc7842e9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.774290:0:18630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac34cf05/0xabf1cc0bc7842e9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.774306:0:18630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac34cf05/0xabf1cc0bc7842e9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.774327:0:18630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1790773351.774613:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa88700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17147:1877761496117120:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1790773351.774632:0:17147:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:3.0:1790773351.774678:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa88700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17147:1877761496117760:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1790773351.774743:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773351.774776:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d251cfd780 going to sleep for 11 seconds 00000100:00100000:3.0:1790773351.774795:0:19203:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496117760 00000100:00100000:3.0:1790773351.774800:0:19203:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496117760 00000100:00100000:3.0:1790773351.774847:0:19203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790773351.774856:0:19203:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17147:x1877761496117760:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1790773351.774896:0:19203:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00010000:00010000:1.0:1790773351.775734:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790773351.775743:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac34cf05/0xabf1cc0bc7842e9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.775755:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a3e00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:1.0:1790773351.775769:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac34cf05/0xabf1cc0bc7842e9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.775781:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac34cf05/0xabf1cc0bc7842e9e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.775801:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac34cf05/0xabf1cc0bc7842e9e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.775809:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac34cf05/0xabf1cc0bc7842e9e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.775833:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773351.775835:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773351.775837:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790773351.776745:0:18630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790773351.776756:0:18630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb30bf7b/0xabf1cc0bc7842eac lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.776773:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=494s v=(0 0) 00010000:00010000:3.0:1790773351.776779:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773351.776787:0:18630:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb30bf7b/0xabf1cc0bc7842eac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.776802:0:18630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb30bf7b/0xabf1cc0bc7842eac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.776823:0:18630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb30bf7b/0xabf1cc0bc7842eac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.776831:0:18630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb30bf7b/0xabf1cc0bc7842eac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.776850:0:18630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790773351.776862:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790773351.776866:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb30bf7b/0xabf1cc0bc7842eac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.776873:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a3600 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:3.0:1790773351.776878:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb30bf7b/0xabf1cc0bc7842eac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.776887:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb30bf7b/0xabf1cc0bc7842eac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.776900:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb30bf7b/0xabf1cc0bc7842eac lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.776908:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb30bf7b/0xabf1cc0bc7842eac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.776922:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773351.776930:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773351.776932:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790773351.778643:0:18630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790773351.778654:0:18630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012431c86/0xabf1cc0bc7842eb3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.778670:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=494s v=(0 0) 00010000:00010000:3.0:1790773351.778674:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773351.778680:0:18630:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012431c86/0xabf1cc0bc7842eb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.778693:0:18630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012431c86/0xabf1cc0bc7842eb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.778702:0:18630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012431c86/0xabf1cc0bc7842eb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.778710:0:18630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000012431c86/0xabf1cc0bc7842eb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.780016:0:18630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790773351.781047:0:18630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790773351.781058:0:18630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab7ce6bf/0xabf1cc0bc7842eba lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.781076:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=494s v=(0 0) 00010000:00010000:3.0:1790773351.781080:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773351.781085:0:18630:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab7ce6bf/0xabf1cc0bc7842eba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.781120:0:18630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab7ce6bf/0xabf1cc0bc7842eba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.781130:0:18630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab7ce6bf/0xabf1cc0bc7842eba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.781139:0:18630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab7ce6bf/0xabf1cc0bc7842eba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.781155:0:18630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1790773351.781169:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790773351.781175:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000012431c86/0xabf1cc0bc7842eb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790773351.783018:0:18630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790773351.783031:0:18630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d29e9e6/0xabf1cc0bc7842ec1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.783049:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=494s v=(0 0) 00010000:00010000:2.0:1790773351.783054:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790773351.783060:0:18630:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d29e9e6/0xabf1cc0bc7842ec1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.783077:0:18630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d29e9e6/0xabf1cc0bc7842ec1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.783087:0:18630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d29e9e6/0xabf1cc0bc7842ec1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.783106:0:18630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d29e9e6/0xabf1cc0bc7842ec1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.783119:0:18630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1790773351.783445:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a2200 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:3.0:1790773351.783451:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000012431c86/0xabf1cc0bc7842eb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.783462:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000012431c86/0xabf1cc0bc7842eb3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.783480:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000012431c86/0xabf1cc0bc7842eb3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.783488:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012431c86/0xabf1cc0bc7842eb3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.783519:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790773351.783525:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab7ce6bf/0xabf1cc0bc7842eba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.783531:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a3800 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:3.0:1790773351.783535:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab7ce6bf/0xabf1cc0bc7842eba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.783543:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab7ce6bf/0xabf1cc0bc7842eba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.783553:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab7ce6bf/0xabf1cc0bc7842eba lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.783561:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab7ce6bf/0xabf1cc0bc7842eba lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.783572:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790773351.783575:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d29e9e6/0xabf1cc0bc7842ec1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.783581:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc5600 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:3.0:1790773351.783584:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d29e9e6/0xabf1cc0bc7842ec1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.783604:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d29e9e6/0xabf1cc0bc7842ec1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.783615:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d29e9e6/0xabf1cc0bc7842ec1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.783622:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d29e9e6/0xabf1cc0bc7842ec1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.783635:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773351.783636:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773351.783638:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773351.785587:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790773351.785751:0:18630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790773351.785761:0:18630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2276468/0xabf1cc0bc7842ec8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.785779:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=494s v=(0 0) 00010000:00010000:2.0:1790773351.785783:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790773351.785789:0:18630:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2276468/0xabf1cc0bc7842ec8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.785804:0:18630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2276468/0xabf1cc0bc7842ec8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.785814:0:18630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2276468/0xabf1cc0bc7842ec8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.785823:0:18630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2276468/0xabf1cc0bc7842ec8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.785849:0:18630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790773351.785859:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790773351.785865:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2276468/0xabf1cc0bc7842ec8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.785948:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc4000 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:2.0:1790773351.785952:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2276468/0xabf1cc0bc7842ec8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.785961:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2276468/0xabf1cc0bc7842ec8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.785975:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2276468/0xabf1cc0bc7842ec8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.785982:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2276468/0xabf1cc0bc7842ec8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.786000:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773351.786002:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773351.786004:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790773351.786409:0:18630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790773351.786415:0:18630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051327c90/0xabf1cc0bc7842ecf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.786425:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=494s v=(0 0) 00010000:00010000:2.0:1790773351.786428:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790773351.786433:0:18630:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051327c90/0xabf1cc0bc7842ecf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.786444:0:18630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051327c90/0xabf1cc0bc7842ecf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.786458:0:18630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051327c90/0xabf1cc0bc7842ecf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.786467:0:18630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051327c90/0xabf1cc0bc7842ecf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.786485:0:18630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790773351.787612:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790773351.787623:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051327c90/0xabf1cc0bc7842ecf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.787634:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc4a00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:1.0:1790773351.787638:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051327c90/0xabf1cc0bc7842ecf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.787648:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051327c90/0xabf1cc0bc7842ecf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.787663:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051327c90/0xabf1cc0bc7842ecf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.787679:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051327c90/0xabf1cc0bc7842ecf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.787699:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773351.787700:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773351.787702:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790773351.787846:0:18630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790773351.787853:0:18630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071775af6/0xabf1cc0bc7842ed6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.787863:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=494s v=(0 0) 00010000:00010000:2.0:1790773351.787867:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790773351.787872:0:18630:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071775af6/0xabf1cc0bc7842ed6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.788499:0:18630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071775af6/0xabf1cc0bc7842ed6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.788510:0:18630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071775af6/0xabf1cc0bc7842ed6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.788519:0:18630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071775af6/0xabf1cc0bc7842ed6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.788550:0:18630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790773351.789034:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790773351.789042:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071775af6/0xabf1cc0bc7842ed6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.789050:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc5e00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:3.0:1790773351.789054:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071775af6/0xabf1cc0bc7842ed6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.789063:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071775af6/0xabf1cc0bc7842ed6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.789077:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071775af6/0xabf1cc0bc7842ed6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.789096:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071775af6/0xabf1cc0bc7842ed6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.789111:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773351.789112:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773351.789114:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790773351.790420:0:18630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790773351.790431:0:18630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f8391af/0xabf1cc0bc7842edd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.790446:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=494s v=(0 0) 00010000:00010000:2.0:1790773351.790450:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790773351.790457:0:18630:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f8391af/0xabf1cc0bc7842edd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.790470:0:18630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f8391af/0xabf1cc0bc7842edd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.790479:0:18630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f8391af/0xabf1cc0bc7842edd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.790488:0:18630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f8391af/0xabf1cc0bc7842edd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.790682:0:18630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790773351.791039:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790773351.791046:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f8391af/0xabf1cc0bc7842edd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.791055:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc4200 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:3.0:1790773351.791059:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f8391af/0xabf1cc0bc7842edd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.791068:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f8391af/0xabf1cc0bc7842edd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.791082:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f8391af/0xabf1cc0bc7842edd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.791089:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f8391af/0xabf1cc0bc7842edd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773351.791110:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773351.791111:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773351.791113:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1790773351.791447:0:18624:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:1.0:1790773351.791489:0:18624:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:2.0:1790773351.791588:0:18630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790773351.791594:0:18630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034fac215/0xabf1cc0bc7842ee4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.791605:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=494s v=(0 0) 00010000:00010000:2.0:1790773351.791616:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790773351.791621:0:18630:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034fac215/0xabf1cc0bc7842ee4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.791631:0:18630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034fac215/0xabf1cc0bc7842ee4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.791639:0:18630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034fac215/0xabf1cc0bc7842ee4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.791647:0:18630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034fac215/0xabf1cc0bc7842ee4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.791664:0:18630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790773351.791672:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790773351.791677:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034fac215/0xabf1cc0bc7842ee4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.791684:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc5800 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:2.0:1790773351.791688:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034fac215/0xabf1cc0bc7842ee4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.791695:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034fac215/0xabf1cc0bc7842ee4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.791705:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034fac215/0xabf1cc0bc7842ee4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.791723:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034fac215/0xabf1cc0bc7842ee4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.791737:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773351.791739:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773351.791741:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790773351.794843:0:18630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790773351.794857:0:18630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000715485c4/0xabf1cc0bc7842eeb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.794888:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=494s v=(0 0) 00010000:00010000:2.0:1790773351.794893:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790773351.794899:0:18630:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000715485c4/0xabf1cc0bc7842eeb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.794914:0:18630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000715485c4/0xabf1cc0bc7842eeb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.794924:0:18630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000715485c4/0xabf1cc0bc7842eeb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.794932:0:18630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000715485c4/0xabf1cc0bc7842eeb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.794954:0:18630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790773351.794965:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790773351.794978:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000715485c4/0xabf1cc0bc7842eeb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.794986:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc5000 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:2.0:1790773351.794991:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000715485c4/0xabf1cc0bc7842eeb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.795000:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000715485c4/0xabf1cc0bc7842eeb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.795016:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000715485c4/0xabf1cc0bc7842eeb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.795025:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000715485c4/0xabf1cc0bc7842eeb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.795045:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773351.795047:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773351.795049:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790773351.795508:0:18630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790773351.795515:0:18630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d276718/0xabf1cc0bc7842ef2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.795524:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=494s v=(0 0) 00010000:00010000:2.0:1790773351.795527:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790773351.795531:0:18630:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d276718/0xabf1cc0bc7842ef2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.795552:0:18630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d276718/0xabf1cc0bc7842ef2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.795561:0:18630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d276718/0xabf1cc0bc7842ef2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.795568:0:18630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d276718/0xabf1cc0bc7842ef2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.795581:0:18630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790773351.795589:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790773351.795593:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003d276718/0xabf1cc0bc7842ef2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.795599:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d24166e400 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:2.0:1790773351.795602:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003d276718/0xabf1cc0bc7842ef2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.795611:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003d276718/0xabf1cc0bc7842ef2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.795621:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003d276718/0xabf1cc0bc7842ef2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.795627:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d276718/0xabf1cc0bc7842ef2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.795648:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773351.795650:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773351.795651:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790773351.795928:0:18630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790773351.795934:0:18630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086c2bb83/0xabf1cc0bc7842ef9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.795943:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=494s v=(0 0) 00010000:00010000:2.0:1790773351.795946:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790773351.795950:0:18630:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086c2bb83/0xabf1cc0bc7842ef9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.795958:0:18630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086c2bb83/0xabf1cc0bc7842ef9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.795966:0:18630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086c2bb83/0xabf1cc0bc7842ef9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.795974:0:18630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000086c2bb83/0xabf1cc0bc7842ef9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.795987:0:18630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790773351.795993:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790773351.795996:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000086c2bb83/0xabf1cc0bc7842ef9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.796013:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d24166ec00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:2.0:1790773351.796016:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000086c2bb83/0xabf1cc0bc7842ef9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.796025:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000086c2bb83/0xabf1cc0bc7842ef9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.796036:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000086c2bb83/0xabf1cc0bc7842ef9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.796043:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086c2bb83/0xabf1cc0bc7842ef9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.796056:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773351.796057:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773351.796059:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790773351.796360:0:18630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790773351.796365:0:18630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2ae6a0f/0xabf1cc0bc7842f00 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.796374:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=494s v=(0 0) 00010000:00010000:2.0:1790773351.796377:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790773351.796381:0:18630:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2ae6a0f/0xabf1cc0bc7842f00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.796390:0:18630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2ae6a0f/0xabf1cc0bc7842f00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.796405:0:18630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2ae6a0f/0xabf1cc0bc7842f00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.796411:0:18630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2ae6a0f/0xabf1cc0bc7842f00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.796424:0:18630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790773351.796431:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790773351.796434:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2ae6a0f/0xabf1cc0bc7842f00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.796441:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d24166e200 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:2.0:1790773351.796444:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2ae6a0f/0xabf1cc0bc7842f00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.796452:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2ae6a0f/0xabf1cc0bc7842f00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.796462:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2ae6a0f/0xabf1cc0bc7842f00 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.796469:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2ae6a0f/0xabf1cc0bc7842f00 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.796481:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773351.796488:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773351.796490:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790773351.796789:0:18630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790773351.796794:0:18630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1688cf2/0xabf1cc0bc7842f07 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.796803:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=494s v=(0 0) 00010000:00010000:2.0:1790773351.796806:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790773351.796810:0:18630:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1688cf2/0xabf1cc0bc7842f07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.796819:0:18630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1688cf2/0xabf1cc0bc7842f07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.796827:0:18630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1688cf2/0xabf1cc0bc7842f07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.796834:0:18630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1688cf2/0xabf1cc0bc7842f07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.796848:0:18630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790773351.796854:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790773351.796858:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1688cf2/0xabf1cc0bc7842f07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.796864:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d24166e600 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:2.0:1790773351.796867:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1688cf2/0xabf1cc0bc7842f07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.796943:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1688cf2/0xabf1cc0bc7842f07 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.796954:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1688cf2/0xabf1cc0bc7842f07 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.796960:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1688cf2/0xabf1cc0bc7842f07 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.796973:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773351.796974:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773351.796976:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790773351.797299:0:18630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790773351.797305:0:18630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbf8d4fd/0xabf1cc0bc7842f0e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.797313:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=494s v=(0 0) 00010000:00010000:2.0:1790773351.797316:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790773351.797320:0:18630:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fbf8d4fd/0xabf1cc0bc7842f0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.797330:0:18630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fbf8d4fd/0xabf1cc0bc7842f0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.797337:0:18630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbf8d4fd/0xabf1cc0bc7842f0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.797357:0:18630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fbf8d4fd/0xabf1cc0bc7842f0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.797372:0:18630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790773351.797379:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790773351.797383:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fbf8d4fd/0xabf1cc0bc7842f0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.797390:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d24166f400 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:2.0:1790773351.797393:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbf8d4fd/0xabf1cc0bc7842f0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.797401:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbf8d4fd/0xabf1cc0bc7842f0e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.797413:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fbf8d4fd/0xabf1cc0bc7842f0e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.797420:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fbf8d4fd/0xabf1cc0bc7842f0e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.797433:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773351.797435:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773351.797436:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773351.798397:0:19203:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17147:x1877761496117760:12345-0@lo:5:osp-pre-0-0.0 Request processed in 23534us (23646us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1790773351.798408:0:19203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00002000:00010000:2.0:1790773351.798565:0:18630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790773351.798582:0:18630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c22190cf/0xabf1cc0bc7842f15 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.798593:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=494s v=(0 0) 00010000:00010000:2.0:1790773351.798596:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790773351.798601:0:18630:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c22190cf/0xabf1cc0bc7842f15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.798612:0:18630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c22190cf/0xabf1cc0bc7842f15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.798621:0:18630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c22190cf/0xabf1cc0bc7842f15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.798629:0:18630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c22190cf/0xabf1cc0bc7842f15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.798653:0:18630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790773351.799000:0:17147:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1790773351.799010:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa88700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17147:1877761496117760:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1790773351.799028:0:17147:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:1.0:1790773351.799194:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790773351.799225:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c22190cf/0xabf1cc0bc7842f15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.799234:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d24166ea00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:1.0:1790773351.799238:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c22190cf/0xabf1cc0bc7842f15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.799248:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c22190cf/0xabf1cc0bc7842f15 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.799262:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c22190cf/0xabf1cc0bc7842f15 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.799270:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c22190cf/0xabf1cc0bc7842f15 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773351.799289:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773351.799297:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773351.799299:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790773351.799638:0:18630:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790773351.799645:0:18630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023bdf60d/0xabf1cc0bc7842f1c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.799654:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=494s v=(0 0) 00010000:00010000:2.0:1790773351.799657:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790773351.799662:0:18630:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023bdf60d/0xabf1cc0bc7842f1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.799672:0:18630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023bdf60d/0xabf1cc0bc7842f1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.799687:0:18630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023bdf60d/0xabf1cc0bc7842f1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.799693:0:18630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000023bdf60d/0xabf1cc0bc7842f1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773351.799715:0:18630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1790773351.799764:0:18630:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:2.0:1790773351.799840:0:18630:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17149:x1877761496116864:12345-0@lo:5:osp-pre-1-0.0 Request processed in 154030us (156710us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773351.799849:0:18630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1790773351.799952:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790773351.799957:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000023bdf60d/0xabf1cc0bc7842f1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.799964:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d24166fa00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:0.0:1790773351.799968:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000023bdf60d/0xabf1cc0bc7842f1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.799975:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000023bdf60d/0xabf1cc0bc7842f1c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.799987:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000023bdf60d/0xabf1cc0bc7842f1c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.799994:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023bdf60d/0xabf1cc0bc7842f1c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773351.800020:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773351.800022:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773351.800024:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773351.800084:0:17149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9ca680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17149:1877761496116864:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1790773351.800096:0:17149:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:3.0:1790773351.800143:0:17149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa8b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17149:1877761496117888:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1790773351.800198:0:17149:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773351.800259:0:17149:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d251cfdcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790773351.800370:0:18629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496117888 00000100:00100000:0.0:1790773351.800377:0:18629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496117888 00000100:00100000:0.0:1790773351.800936:0:18629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790773351.800948:0:18629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17149:x1877761496117888:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1790773351.800989:0:18629:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:2.0:1790773351.828731:0:18629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17149:x1877761496117888:12345-0@lo:5:osp-pre-1-0.0 Request processed in 27778us (28526us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1790773351.828744:0:18629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790773351.829027:0:17149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa8b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17149:1877761496117888:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1790773351.829049:0:17149:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000040:00080000:3.0:1790773352.402040:0:17873:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1790773352.462400:0:17120:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790773352.462410:0:17120:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93d27f91f800 from 10 10000000:01000000:0.0:1790773352.462416:0:17120:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790773352.462471:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d25074b200/0xabf1cc0bc7842f23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773352.462486:0:17120:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d25074b200/0xabf1cc0bc7842f23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773352.462498:0:17120:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d25074b200/0xabf1cc0bc7842f23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773352.462522:0:17120:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496118016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790773352.462592:0:17120:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773352.462638:0:17120:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2517af600 going to sleep for 11 seconds 00000100:00100000:1.0:1790773352.462729:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496118016 00000100:00100000:1.0:1790773352.462738:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496118016 00000100:00100000:1.0:1790773352.462795:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1790773352.462806:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+22:17120:x1877761496118016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790773352.462821:0:17117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773352.462836:0:17117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d27b12b000/0xabf1cc0bc7842f2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7842f23 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773352.462861:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d27b12b000/0xabf1cc0bc7842f2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7842f23 expref: 23 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773352.462872:0:17117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d27b12b000/0xabf1cc0bc7842f2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7842f23 expref: 23 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773352.462882:0:17117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12b000, rc 0) 00000100:00100000:1.0:1790773352.462938:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+23:17120:x1877761496118016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773352.462945:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1790773352.463237:0:17120:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496118016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790773352.463255:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d25074b200/0xabf1cc0bc7842f23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842f2a expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773352.463281:0:17120:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d25074b200/0xabf1cc0bc7842f23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7842f2a expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773352.463333:0:17120:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496118144:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1790773352.463368:0:17120:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773352.463391:0:17120:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2517af600 going to sleep for 11 seconds 00000100:00100000:3.0:1790773352.463501:0:17116:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496118144 00000100:00100000:3.0:1790773352.463507:0:17116:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496118144 00000100:00100000:3.0:1790773352.463544:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1790773352.463552:0:17116:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+23:17120:x1877761496118144:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1790773352.463567:0:17116:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790773352.463586:0:17116:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790773352.463589:0:17116:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1790773352.463667:0:17116:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+23:17120:x1877761496118144:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 116us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773352.463676:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1790773352.463801:0:17120:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496118144:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1790773352.463861:0:17120:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790773352.463868:0:17120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d25074b200/0xabf1cc0bc7842f23 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842f2a expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773352.463877:0:17120:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d25074b200/0xabf1cc0bc7842f23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842f2a expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790773352.463886:0:17120:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790773352.463888:0:17120:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93d14444c000 from 10 10000000:01000000:0.0:1790773352.464017:0:17120:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790773352.464040:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d25074a600/0xabf1cc0bc7842f31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773352.464048:0:17120:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d25074a600/0xabf1cc0bc7842f31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773352.464057:0:17120:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d25074a600/0xabf1cc0bc7842f31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773352.464071:0:17120:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496118272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790773352.464109:0:17120:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773352.464137:0:17120:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2517af600 going to sleep for 11 seconds 00000100:00100000:3.0:1790773352.464463:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496118272 00000100:00100000:3.0:1790773352.464469:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496118272 00000100:00100000:3.0:1790773352.464496:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1790773352.464502:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+23:17120:x1877761496118272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790773352.464511:0:17115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773352.464526:0:17115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d26c4a3800/0xabf1cc0bc7842f38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7842f31 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773352.464544:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d26c4a3800/0xabf1cc0bc7842f38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7842f31 expref: 24 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773352.464554:0:17115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d26c4a3800/0xabf1cc0bc7842f38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7842f31 expref: 24 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773352.464561:0:17115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26c4a3800, rc 0) 00000100:00100000:3.0:1790773352.464600:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+24:17120:x1877761496118272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773352.464606:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1790773352.464663:0:17120:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496118272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790773352.464675:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d25074a600/0xabf1cc0bc7842f31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842f38 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773352.464684:0:17120:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d25074a600/0xabf1cc0bc7842f31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7842f38 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773352.464722:0:17120:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496118400:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1790773352.464753:0:17120:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773352.464780:0:17120:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d143e37f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790773352.464819:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496118400 00000100:00100000:3.0:1790773352.464823:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496118400 00000100:00100000:3.0:1790773352.464850:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1790773352.464855:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d243ed8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+24:17120:x1877761496118400:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1790773352.464865:0:17117:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790773352.464878:0:17117:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790773352.464881:0:17117:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1790773352.464954:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d243ed8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+24:17120:x1877761496118400:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 98us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773352.464960:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1790773352.464984:0:17120:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496118400:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1790773352.465031:0:17120:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790773352.465037:0:17120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d25074a600/0xabf1cc0bc7842f31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842f38 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773352.465046:0:17120:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d25074a600/0xabf1cc0bc7842f31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842f38 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773352.668733:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773353.680435:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773354.702391:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773355.352033:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790773355.352059:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496118528:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790773355.352246:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773355.352368:0:18631:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496118528 00000100:00100000:3.0:1790773355.352377:0:18631:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496118528 00000100:00100000:3.0:1790773355.352444:0:18631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790773355.352454:0:18631:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496118528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790773355.352489:0:18631:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1790773355.352554:0:18631:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496118528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773355.352562:0:18631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1790773355.353134:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790773355.354325:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496118528:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1790773355.725409:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773356.365439:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496118656:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790773356.365570:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773356.365898:0:17127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496118656 00000100:00100000:3.0:1790773356.365908:0:17127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496118656 00000100:00100000:3.0:1790773356.365969:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790773356.365979:0:17127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496118656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790773356.366019:0:17127:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1790773356.366069:0:17127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496118656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773356.366077:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790773356.366195:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496118656:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1790773356.749429:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773356.877443:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496118912:0@lo:400:kworker.0 00000100:00100000:1.0:1790773356.877524:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773356.877614:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496119424:0@lo:400:kworker.0 00000100:00100000:1.0:1790773356.877639:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773356.877654:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3604:1877761496119936:0@lo:400:kworker.0 00000100:00100000:1.0:1790773356.877673:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773356.877696:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1790773356.877702:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496119040:0@lo:400:kworker.0 00000100:00100000:1.0:1790773356.877722:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773356.877737:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496119552:0@lo:400:kworker.0 00000100:00100000:1.0:1790773356.877755:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773356.877777:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3604:1877761496120064:0@lo:400:kworker.0 00000100:00100000:1.0:1790773356.877800:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773356.877829:0:17122:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496119936 00000100:00100000:1.0:1790773356.877836:0:17122:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496119936 00000100:00100000:1.0:1790773356.877880:0:17122:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496120064 00000100:00100000:1.0:1790773356.877882:0:17122:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496120064 00000100:00100000:1.0:1790773356.877896:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790773356.877903:0:17122:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3604:x1877761496119936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773356.877948:0:17122:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3604:x1877761496119936:12345-0@lo:400:kworker.0 Request processed in 45us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773356.877962:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790773356.877977:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790773356.877982:0:17122:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3604:x1877761496120064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773356.878005:0:17122:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3604:x1877761496120064:12345-0@lo:400:kworker.0 Request processed in 24us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773356.878011:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1790773356.878046:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143ce0380 x1877761496120064/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773356.878059:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3604:1877761496120064:0@lo:400:kworker.0 00010000:00080000:1.0:1790773356.878068:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143ce3b80 x1877761496119936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773356.878076:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3604:1877761496119936:0@lo:400:kworker.0 00000100:00100000:0.0:1790773356.878346:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3607:1877761496118784:0@lo:400:kworker.0 00000100:00100000:0.0:1790773356.878379:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773356.878406:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3607:1877761496119296:0@lo:400:kworker.0 00000100:00100000:0.0:1790773356.878427:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773356.878444:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3607:1877761496119808:0@lo:400:kworker.0 00000100:00100000:0.0:1790773356.878464:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773356.878478:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496120320:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790773356.878512:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773356.878533:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1790773356.878539:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496119168:0@lo:400:kworker.0 00000100:00100000:0.0:1790773356.878561:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773356.878579:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877761496119680:0@lo:400:kworker.0 00000100:00100000:0.0:1790773356.878598:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773356.878613:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3607:1877761496120192:0@lo:400:kworker.0 00000100:00100000:0.0:1790773356.878632:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773356.878681:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496118784 00000100:00100000:0.0:1790773356.878686:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496118784 00000100:00100000:0.0:1790773356.878716:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1790773356.878723:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d243edb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+24:3607:x1877761496118784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773356.878779:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d243edb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+24:3607:x1877761496118784:12345-0@lo:400:kworker.0 Request processed in 56us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773356.878786:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1790773356.878813:0:17128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496118912 00000100:00100000:0.0:1790773356.878816:0:17128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496118912 00000100:00100000:0.0:1790773356.878832:0:17128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496120320 00000100:00100000:0.0:1790773356.878834:0:17128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496120320 00000100:00100000:0.0:1790773356.878845:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790773356.878849:0:17128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3604:x1877761496118912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773356.878882:0:17128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3604:x1877761496118912:12345-0@lo:400:kworker.0 Request processed in 32us (1359us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773356.878888:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790773356.878899:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790773356.878904:0:17128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496120320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790773356.878925:0:17128:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1790773356.878954:0:17128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496120320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 50us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773356.878960:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790773356.878979:0:17124:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496119296 00000100:00100000:0.0:1790773356.878982:0:17124:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496119296 00000100:00100000:0.0:1790773356.878996:0:17124:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496119808 00000100:00100000:0.0:1790773356.878999:0:17124:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496119808 00000100:00100000:0.0:1790773356.879010:0:17124:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496119680 00000100:00100000:0.0:1790773356.879012:0:17124:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496119680 00000100:00100000:0.0:1790773356.879020:0:17124:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496120192 00000100:00100000:0.0:1790773356.879022:0:17124:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496120192 00000100:00100000:0.0:1790773356.879033:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790773356.879038:0:17124:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1877761496119296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773356.879073:0:17124:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1877761496119296:12345-0@lo:400:kworker.0 Request processed in 34us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773356.879079:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790773356.879090:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790773356.879096:0:17124:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1877761496119808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773356.879122:0:17124:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1877761496119808:12345-0@lo:400:kworker.0 Request processed in 27us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773356.879128:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790773356.879149:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790773356.879155:0:17124:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877761496119680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773356.879181:0:17124:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877761496119680:12345-0@lo:400:kworker.0 Request processed in 26us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773356.879186:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790773356.879197:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790773356.879202:0:17124:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1877761496120192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773356.879264:0:17124:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1877761496120192:12345-0@lo:400:kworker.0 Request processed in 62us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773356.879270:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790773356.879289:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790773356.879298:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496120448:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790773356.879323:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773356.879352:0:18631:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496120448 00000100:00100000:0.0:1790773356.879356:0:18631:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496120448 00000100:00100000:0.0:1790773356.879382:0:18631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790773356.879389:0:18631:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496120448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790773356.879412:0:18631:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1790773356.879445:0:18631:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496120448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773356.879451:0:18631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790773356.879491:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496120448:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1790773356.879526:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143ce3100 x1877761496119680/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773356.879537:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877761496119680:0@lo:400:kworker.0 00010000:00080000:0.0:1790773356.879547:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1437d5c00 x1877761496120192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773356.879554:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3607:1877761496120192:0@lo:400:kworker.0 00000100:00100000:0.0:1790773356.879563:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3607:1877761496118784:0@lo:400:kworker.0 00010000:00080000:0.0:1790773356.879572:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143ce1880 x1877761496119296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773356.879580:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3607:1877761496119296:0@lo:400:kworker.0 00010000:00080000:0.0:1790773356.879590:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143ce1180 x1877761496119808/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773356.879598:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3607:1877761496119808:0@lo:400:kworker.0 00000100:00100000:0.0:1790773356.879610:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496120320:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790773356.879650:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496118912:0@lo:400:kworker.0 00000100:00100000:0.0:1790773356.879687:0:18630:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496119424 00000100:00100000:0.0:1790773356.879697:0:18630:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496119424 00000100:00100000:0.0:1790773356.879724:0:18630:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496119040 00000100:00100000:0.0:1790773356.879727:0:18630:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496119040 00000100:00100000:0.0:1790773356.879737:0:18630:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496119552 00000100:00100000:0.0:1790773356.879739:0:18630:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496119552 00000100:00100000:0.0:1790773356.879751:0:18630:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496119168 00000100:00100000:0.0:1790773356.879753:0:18630:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496119168 00000100:00100000:0.0:1790773356.879765:0:18630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790773356.879770:0:18630:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496119424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773356.879807:0:18630:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496119424:12345-0@lo:400:kworker.0 Request processed in 36us (2167us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773356.879813:0:18630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790773356.879825:0:18630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790773356.879831:0:18630:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496119040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773356.879856:0:18630:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496119040:12345-0@lo:400:kworker.0 Request processed in 26us (2133us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773356.879861:0:18630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790773356.879871:0:18630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790773356.879876:0:18630:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496119552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773356.879899:0:18630:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496119552:12345-0@lo:400:kworker.0 Request processed in 23us (2144us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773356.879903:0:18630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790773356.879911:0:18630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790773356.879916:0:18630:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3607:x1877761496119168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773356.879939:0:18630:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3607:x1877761496119168:12345-0@lo:400:kworker.0 Request processed in 23us (1378us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773356.879944:0:18630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790773356.879974:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496119168:0@lo:400:kworker.0 00000100:00100000:0.0:1790773356.879992:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496119040:0@lo:400:kworker.0 00000100:00100000:0.0:1790773356.880000:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496119552:0@lo:400:kworker.0 00000100:00100000:0.0:1790773356.880009:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496119424:0@lo:400:kworker.0 00000100:00080000:0.0:1790773356.880032:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790773356.880036:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790773356.880038:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790773356.880040:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790773356.880483:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496120704:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790773356.880528:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773356.880557:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496120576:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790773356.880581:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773356.880607:0:18632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496120704 00000100:00100000:3.0:1790773356.880611:0:18632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496120704 00000100:00100000:3.0:1790773356.880627:0:18632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496120576 00000100:00100000:3.0:1790773356.880629:0:18632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496120576 00000100:00100000:3.0:1790773356.880641:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790773356.880646:0:18632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496120704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790773356.880673:0:18632:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1790773356.880708:0:18632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496120704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773356.880715:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790773356.880728:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790773356.880734:0:18632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3605:x1877761496120576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790773356.880754:0:18632:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1790773356.880783:0:18632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3605:x1877761496120576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773356.880789:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790773356.880819:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496120704:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790773356.880846:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496120576:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1790773357.137010:0:19797:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg219-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000001:00080000:2.0:1790773357.411656:0:19441:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00010000:00010000:2.0:1790773357.780083:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1790773358.076200:0:19849:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790773358.078809:0:19849:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790773358.797937:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1790773358.980916:0:19899:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790773358.981178:0:19899:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:3.0:1790773359.182435:0:17158:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790773359.275382:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773359.275454:0:17116:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484507008 00000100:00100000:0.0:1790773359.275462:0:17116:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484507008 00000100:00100000:0.0:1790773359.275545:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 115 00000100:00100000:0.0:1790773359.275552:0:17116:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d243ed8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2396:x1877761484507008:12345-192.168.202.19@tcp:250:mount.lustre.0 00010000:00080000:0.0:1790773359.275584:0:17116:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5@192.168.202.19@tcp t0 exp 0000000000000000 cur 502 last 0 00000020:00000080:0.0:1790773359.275607:0:17116:0:(genops.c:1384:class_connect()) connect: client 1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5, cookie 0xabf1cc0bc7842f3f 00000100:00080000:0.0:1790773359.275726:0:17116:0:(import.c:65:import_set_state_nolock()) ffff93d141c44800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790773359.275796:0:17116:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d243ed8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+5:2396:x1877761484507008:12345-192.168.202.19@tcp:250:mount.lustre.0 Request processed in 239us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773359.275803:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 115 00000100:00100000:3.0:1790773359.289381:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773359.289489:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484507136 00000100:00100000:0.0:1790773359.289500:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484507136 00000100:00100000:0.0:1790773359.289579:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 116 00000100:00100000:0.0:1790773359.289587:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d243ed9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+5:14863:x1877761484507136:12345-192.168.202.19@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790773359.289604:0:17115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773359.289625:0:17115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d25074b600/0xabf1cc0bc7842f46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bf7c expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773359.289674:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d25074b600/0xabf1cc0bc7842f46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf7c expref: 6 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773359.289684:0:17115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d25074b600/0xabf1cc0bc7842f46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf7c expref: 6 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773359.289704:0:17115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074b600, rc 0) 00000100:00100000:0.0:1790773359.289764:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d243ed9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+6:14863:x1877761484507136:12345-192.168.202.19@tcp:101:mount.lustre.0 Request processed in 176us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773359.289771:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 116 00000100:00100000:1.0:1790773359.292389:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773359.292472:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484507264 00000100:00100000:3.0:1790773359.292482:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484507264 00000100:00100000:3.0:1790773359.292548:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 117 00000100:00100000:3.0:1790773359.292557:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d243edb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+6:14863:x1877761484507264:12345-192.168.202.19@tcp:501:mount.lustre.0 00000100:00100000:3.0:1790773359.292668:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d243edb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+6:14863:x1877761484507264:12345-192.168.202.19@tcp:501:mount.lustre.0 Request processed in 113us (289us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790773359.292673:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 117 00000100:00100000:1.0:1790773359.294868:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773359.295015:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484507392 00000100:00100000:0.0:1790773359.295025:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484507392 00000100:00100000:0.0:1790773359.295080:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 118 00000100:00100000:0.0:1790773359.295090:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d280a70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+6:14863:x1877761484507392:12345-192.168.202.19@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790773359.295108:0:17115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773359.295140:0:17115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d25074a000/0xabf1cc0bc7842f4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bf83 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773359.295169:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d25074a000/0xabf1cc0bc7842f4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf83 expref: 7 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773359.295181:0:17115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d25074a000/0xabf1cc0bc7842f4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf83 expref: 7 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773359.295189:0:17115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074a000, rc 0) 00000100:00100000:0.0:1790773359.295276:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d280a70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+7:14863:x1877761484507392:12345-192.168.202.19@tcp:101:mount.lustre.0 Request processed in 187us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773359.295300:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 118 00000100:00100000:1.0:1790773359.305448:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773359.305581:0:17116:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484507520 00000100:00100000:0.0:1790773359.305592:0:17116:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484507520 00000100:00100000:0.0:1790773359.305766:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 119 00000100:00100000:0.0:1790773359.305778:0:17116:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d280a70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+7:14863:x1877761484507520:12345-192.168.202.19@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790773359.306023:0:17116:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d280a70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+8:14863:x1877761484507520:12345-192.168.202.19@tcp:501:mount.lustre.0 Request processed in 247us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773359.306032:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 119 00000100:00100000:1.0:1790773359.310350:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773359.310780:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484507648 00000100:00100000:3.0:1790773359.310791:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484507648 00000100:00100000:3.0:1790773359.311514:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 120 00000100:00100000:3.0:1790773359.311554:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d280a73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+8:14863:x1877761484507648:12345-192.168.202.19@tcp:503:mount.lustre.0 00000100:00100000:3.0:1790773359.311821:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d280a73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+8:14863:x1877761484507648:12345-192.168.202.19@tcp:503:mount.lustre.0 Request processed in 269us (1479us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773359.311891:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 120 00000100:00100000:3.0:1790773359.315491:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773359.316326:0:17116:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484507776 00000100:00100000:0.0:1790773359.316340:0:17116:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484507776 00000100:00100000:0.0:1790773359.316404:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 121 00000100:00100000:0.0:1790773359.316414:0:17116:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d280a72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+8:14882:x1877761484507776:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790773359.316583:0:17116:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d280a72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+8:14882:x1877761484507776:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 170us (1105us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773359.316593:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 121 00000100:00100000:0.0:1790773359.354040:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773359.354168:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484507904 00000100:00100000:3.0:1790773359.354178:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484507904 00000100:00100000:3.0:1790773359.354259:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 122 00000100:00100000:3.0:1790773359.354269:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d280a71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+8:14882:x1877761484507904:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790773359.354432:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d280a71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+8:14882:x1877761484507904:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 164us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773359.354441:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 122 00000100:00100000:0.0:1790773359.362384:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773359.362583:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484508032 00000100:00100000:2.0:1790773359.362604:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484508032 00000100:00100000:2.0:1790773359.362671:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 123 00000100:00100000:2.0:1790773359.362683:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d280a72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+8:14882:x1877761484508032:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790773359.362918:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d280a72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+8:14882:x1877761484508032:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 237us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773359.362930:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 123 00000100:00100000:1.0:1790773359.376577:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773359.376734:0:17116:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484508160 00000100:00100000:0.0:1790773359.376746:0:17116:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484508160 00000100:00100000:0.0:1790773359.377008:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 124 00000100:00100000:0.0:1790773359.377019:0:17116:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d280a70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+8:14863:x1877761484508160:12345-192.168.202.19@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790773359.377037:0:17116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773359.377053:0:17116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d25074b800/0xabf1cc0bc7842f54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bfb4 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773359.377099:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d25074b800/0xabf1cc0bc7842f54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bfb4 expref: 9 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773359.377124:0:17116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d25074b800/0xabf1cc0bc7842f54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bfb4 expref: 9 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773359.377133:0:17116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074b800, rc 0) 00000100:00100000:0.0:1790773359.377242:0:17116:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d280a70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+9:14863:x1877761484508160:12345-192.168.202.19@tcp:101:mount.lustre.0 Request processed in 225us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773359.377250:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 124 00000100:00100000:0.0:1790773359.380622:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773359.380725:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484508288 00000100:00100000:3.0:1790773359.380734:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484508288 00000100:00100000:3.0:1790773359.380785:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 125 00000100:00100000:3.0:1790773359.380984:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d280a72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+9:14863:x1877761484508288:12345-192.168.202.19@tcp:256:mount.lustre.0 20000000:01000000:3.0:1790773359.381014:0:17117:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1790773359.381042:0:17117:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1790773359.381046:0:17117:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1790773359.381050:0:17117:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1790773359.381052:0:17117:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1790773359.381054:0:17117:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:3.0:1790773359.383946:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d280a72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+9:14863:x1877761484508288:12345-192.168.202.19@tcp:256:mount.lustre.0 Request processed in 2956us (3322us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773359.383961:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 125 00000100:00100000:1.0:1790773359.387649:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773359.387945:0:17116:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484508416 00000100:00100000:0.0:1790773359.387956:0:17116:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484508416 00000100:00100000:0.0:1790773359.388015:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 126 00000100:00100000:0.0:1790773359.388025:0:17116:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d280a70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+9:14863:x1877761484508416:12345-192.168.202.19@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790773359.388044:0:17116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773359.388060:0:17116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d25074ae00/0xabf1cc0bc7842f5b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bfbb expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773359.388089:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d25074ae00/0xabf1cc0bc7842f5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bfbb expref: 10 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773359.388099:0:17116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d25074ae00/0xabf1cc0bc7842f5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bfbb expref: 10 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773359.388107:0:17116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074ae00, rc 0) 00000100:00100000:2.0:1790773359.388352:0:17116:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d280a70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+10:14863:x1877761484508416:12345-192.168.202.19@tcp:101:mount.lustre.0 Request processed in 326us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773359.388360:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 126 00000100:00100000:0.0:1790773359.390369:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773359.390510:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484508544 00000100:00100000:3.0:1790773359.390524:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484508544 00000100:00100000:3.0:1790773359.390573:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 127 00000100:00100000:3.0:1790773359.390582:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d280a73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+10:14863:x1877761484508544:12345-192.168.202.19@tcp:501:mount.lustre.0 00000100:00100000:3.0:1790773359.390958:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d280a73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+10:14863:x1877761484508544:12345-192.168.202.19@tcp:501:mount.lustre.0 Request processed in 375us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773359.390967:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 127 00000100:00100000:1.0:1790773359.393323:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773359.394947:0:17116:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484508672 00000100:00100000:2.0:1790773359.394963:0:17116:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484508672 00000100:00100000:2.0:1790773359.395032:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 128 00000100:00100000:2.0:1790773359.395043:0:17116:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+10:14863:x1877761484508672:12345-192.168.202.19@tcp:503:mount.lustre.0 00000100:00100000:2.0:1790773359.395247:0:17116:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+10:14863:x1877761484508672:12345-192.168.202.19@tcp:503:mount.lustre.0 Request processed in 205us (1936us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773359.395256:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 128 00000100:00100000:1.0:1790773359.399611:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773359.399964:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484508800 00000100:00100000:2.0:1790773359.399975:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484508800 00000100:00100000:2.0:1790773359.400029:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 129 00000100:00100000:2.0:1790773359.400036:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+10:14884:x1877761484508800:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790773359.400198:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+10:14884:x1877761484508800:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 161us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773359.400240:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 129 00000100:00100000:0.0:1790773359.410917:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773359.413288:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484508928 00000100:00100000:3.0:1790773359.413306:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484508928 00000100:00100000:3.0:1790773359.413384:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 130 00000100:00100000:3.0:1790773359.413395:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+10:14884:x1877761484508928:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790773359.413593:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+10:14884:x1877761484508928:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 198us (2685us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773359.413602:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 130 00000100:00100000:1.0:1790773359.429294:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773359.429375:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773359.429483:0:17124:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484509056 00000100:00100000:0.0:1790773359.429494:0:17124:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484509056 00000100:00100000:0.0:1790773359.429544:0:17124:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484509312 00000100:00100000:0.0:1790773359.429547:0:17124:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484509312 00000100:00100000:0.0:1790773359.429559:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:0.0:1790773359.429567:0:17124:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2396:x1877761484509056:12345-192.168.202.19@tcp:38:mount.lustre.0 00010000:00080000:0.0:1790773359.429596:0:17124:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 332c789e-f22c-433e-a652-7f15822046a7@192.168.202.19@tcp t0 exp 0000000000000000 cur 502 last 0 00000020:00000080:0.0:1790773359.429650:0:17124:0:(genops.c:1384:class_connect()) connect: client 332c789e-f22c-433e-a652-7f15822046a7, cookie 0xabf1cc0bc7842f62 00000004:00100000:0.0:1790773359.429678:0:17124:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1790773359.430081:0:17124:0:(import.c:65:import_set_state_nolock()) ffff93d141c40800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790773359.430165:0:17124:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:332c789e-f22c-433e-a652-7f15822046a7+6:2396:x1877761484509056:12345-192.168.202.19@tcp:38:mount.lustre.0 Request processed in 597us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773359.430173:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:0.0:1790773359.430192:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 8 00000100:00100000:0.0:1790773359.430196:0:17124:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2396:x1877761484509312:12345-192.168.202.19@tcp:38:mount.lustre.0 00010000:00080000:0.0:1790773359.430234:0:17124:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 332c789e-f22c-433e-a652-7f15822046a7@192.168.202.19@tcp t0 exp 0000000000000000 cur 502 last 0 00000020:00000080:0.0:1790773359.430266:0:17124:0:(genops.c:1384:class_connect()) connect: client 332c789e-f22c-433e-a652-7f15822046a7, cookie 0xabf1cc0bc7842f69 00000004:00100000:0.0:1790773359.430279:0:17124:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1790773359.430415:0:17124:0:(import.c:65:import_set_state_nolock()) ffff93d141c42000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790773359.430457:0:17124:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:332c789e-f22c-433e-a652-7f15822046a7+6:2396:x1877761484509312:12345-192.168.202.19@tcp:38:mount.lustre.0 Request processed in 259us (1082us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773359.430463:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 8 00000100:00100000:1.0:1790773359.443484:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773359.443529:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773359.443569:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773359.443665:0:17122:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484509568 00000100:00100000:2.0:1790773359.443677:0:17122:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484509568 00000100:00100000:2.0:1790773359.443748:0:17122:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484509440 00000100:00100000:2.0:1790773359.443751:0:17122:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484509440 00000100:00100000:2.0:1790773359.443766:0:17122:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484509184 00000100:00100000:2.0:1790773359.443768:0:17122:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484509184 00000100:00100000:2.0:1790773359.443813:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:2.0:1790773359.443823:0:17122:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:332c789e-f22c-433e-a652-7f15822046a7+7:14863:x1877761484509568:12345-192.168.202.19@tcp:41:mount.lustre.0 00000004:00000024:2.0:1790773359.443860:0:17122:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1790773359.443962:0:17122:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:332c789e-f22c-433e-a652-7f15822046a7+7:14863:x1877761484509568:12345-192.168.202.19@tcp:41:mount.lustre.0 Request processed in 140us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773359.443969:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:2.0:1790773359.443987:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:2.0:1790773359.443993:0:17122:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:332c789e-f22c-433e-a652-7f15822046a7+6:0:x1877761484509440:12345-192.168.202.19@tcp:41:mount.lustre.0 00000004:00000024:2.0:1790773359.444010:0:17122:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790773359.444046:0:17122:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:332c789e-f22c-433e-a652-7f15822046a7+6:0:x1877761484509440:12345-192.168.202.19@tcp:41:mount.lustre.0 Request processed in 53us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773359.444052:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:2.0:1790773359.444066:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00100000:2.0:1790773359.444072:0:17122:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:332c789e-f22c-433e-a652-7f15822046a7+6:0:x1877761484509184:12345-192.168.202.19@tcp:41:mount.lustre.0 00000004:00000024:2.0:1790773359.444081:0:17122:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1790773359.444101:0:17122:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:332c789e-f22c-433e-a652-7f15822046a7+6:0:x1877761484509184:12345-192.168.202.19@tcp:41:mount.lustre.0 Request processed in 30us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773359.444107:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00080000:1.0:1790773359.444523:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790773359.444528:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790773359.447168:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773359.447538:0:17122:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484509696 00000100:00100000:2.0:1790773359.447550:0:17122:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484509696 00000100:00100000:2.0:1790773359.447605:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00100000:2.0:1790773359.447615:0:17122:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:332c789e-f22c-433e-a652-7f15822046a7+6:14863:x1877761484509696:12345-192.168.202.19@tcp:40:mount.lustre.0 00000100:00100000:2.0:1790773359.447716:0:17122:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:332c789e-f22c-433e-a652-7f15822046a7+6:14863:x1877761484509696:12345-192.168.202.19@tcp:40:mount.lustre.0 Request processed in 101us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773359.447743:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00100000:2.0:1790773359.455813:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773359.455858:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773359.455901:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773359.456046:0:17134:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484510080 00000100:00100000:3.0:1790773359.456058:0:17134:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484510080 00000100:00100000:3.0:1790773359.456134:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 3 00000100:00100000:3.0:1790773359.456154:0:17134:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:332c789e-f22c-433e-a652-7f15822046a7+6:14863:x1877761484510080:12345-192.168.202.19@tcp:900:mount.lustre.0 00000100:00100000:3.0:1790773359.456270:0:17134:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:332c789e-f22c-433e-a652-7f15822046a7+6:14863:x1877761484510080:12345-192.168.202.19@tcp:900:mount.lustre.0 Request processed in 128us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773359.456279:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 3 00000100:00100000:1.0:1790773359.456653:0:18629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484509824 00000100:00100000:1.0:1790773359.456660:0:18629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484509824 00000100:00100000:1.0:1790773359.456685:0:18629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484509952 00000100:00100000:1.0:1790773359.456688:0:18629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484509952 00000100:00100000:1.0:1790773359.456710:0:18629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:1.0:1790773359.456716:0:18629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2396:x1877761484509824:12345-192.168.202.19@tcp:8:mount.lustre.0 00010000:00080000:1.0:1790773359.456745:0:18629:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 332c789e-f22c-433e-a652-7f15822046a7@192.168.202.19@tcp t0 exp 0000000000000000 cur 502 last 0 00000020:00000080:1.0:1790773359.456775:0:18629:0:(genops.c:1384:class_connect()) connect: client 332c789e-f22c-433e-a652-7f15822046a7, cookie 0xabf1cc0bc7842f70 00002000:00100000:1.0:1790773359.456790:0:18629:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 332c789e-f22c-433e-a652-7f15822046a7/ffff93d14338a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790773359.456818:0:18629:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1790773359.457001:0:18629:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1790773359.457032:0:18629:0:(import.c:65:import_set_state_nolock()) ffff93d14338b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790773359.457074:0:18629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:332c789e-f22c-433e-a652-7f15822046a7+6:2396:x1877761484509824:12345-192.168.202.19@tcp:8:mount.lustre.0 Request processed in 356us (1215us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773359.457082:0:18629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:1.0:1790773359.457097:0:18629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:1.0:1790773359.457102:0:18629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2396:x1877761484509952:12345-192.168.202.19@tcp:8:mount.lustre.0 00010000:00080000:1.0:1790773359.457129:0:18629:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 332c789e-f22c-433e-a652-7f15822046a7@192.168.202.19@tcp t0 exp 0000000000000000 cur 502 last 0 00000020:00000080:1.0:1790773359.457298:0:18629:0:(genops.c:1384:class_connect()) connect: client 332c789e-f22c-433e-a652-7f15822046a7, cookie 0xabf1cc0bc7842f77 00002000:00100000:1.0:1790773359.457303:0:18629:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 332c789e-f22c-433e-a652-7f15822046a7/ffff93d143388000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790773359.457316:0:18629:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1790773359.457435:0:18629:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1790773359.457452:0:18629:0:(import.c:65:import_set_state_nolock()) ffff93d14338f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790773359.457478:0:18629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:332c789e-f22c-433e-a652-7f15822046a7+6:2396:x1877761484509952:12345-192.168.202.19@tcp:8:mount.lustre.0 Request processed in 374us (1577us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773359.457485:0:18629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:2.0:1790773359.467246:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773359.467412:0:17125:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484510208 00000100:00100000:3.0:1790773359.467423:0:17125:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484510208 00000100:00100000:3.0:1790773359.467485:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:3.0:1790773359.467495:0:17125:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:332c789e-f22c-433e-a652-7f15822046a7+6:14863:x1877761484510208:12345-192.168.202.19@tcp:33:mount.lustre.0 00000004:00080000:2.0:1790773359.469238:0:17125:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1624us 00000004:00200000:3.0:1790773359.483641:0:17125:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1790773359.483784:0:17125:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:332c789e-f22c-433e-a652-7f15822046a7+6:14863:x1877761484510208:12345-192.168.202.19@tcp:33:mount.lustre.0 Request processed in 16283us (16571us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773359.483795:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:1.0:1790773359.623929:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773359.624046:0:17123:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484510336 00000100:00100000:3.0:1790773359.624055:0:17123:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484510336 00000100:00100000:3.0:1790773359.624141:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 13 00000100:00100000:3.0:1790773359.624156:0:17123:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:332c789e-f22c-433e-a652-7f15822046a7+6:14907:x1877761484510336:12345-192.168.202.19@tcp:101:mkdir.0 00010000:00010000:3.0:1790773359.624182:0:17123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773359.624676:0:17123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3600/0xabf1cc0bc7842f7e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bfec expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773359.624912:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ba00/0xabf1cc0bc7842f85 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773359.624927:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ba00/0xabf1cc0bc7842f85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773359.624943:0:17123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ba00/0xabf1cc0bc7842f85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790773359.625001:0:17123:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1790773359.625005:0:17123:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790773359.625047:0:17123:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ba00/0xabf1cc0bc7842f85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773359.625076:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3600/0xabf1cc0bc7842f7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bfec expref: 8 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773359.625097:0:17123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ba00/0xabf1cc0bc7842f85 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bfec expref: 7 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773359.625117:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d26ff64700) 00010000:00010000:0.0:1790773359.625121:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790773359.625125:0:17123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d25074ba00, rc 0) 00000100:00100000:0.0:1790773359.625290:0:17123:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:332c789e-f22c-433e-a652-7f15822046a7+7:14907:x1877761484510336:12345-192.168.202.19@tcp:101:mkdir.0 Request processed in 1138us (1370us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773359.625299:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 13 00010000:00010000:2.0:1790773359.821385:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773360.462330:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496120832:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790773360.462432:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773360.462993:0:18632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496120832 00000100:00100000:3.0:1790773360.463004:0:18632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496120832 00000100:00100000:3.0:1790773360.463144:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790773360.463153:0:18632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496120832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790773360.463176:0:18632:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1790773360.463263:0:18632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496120832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773360.463271:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790773360.463537:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496120832:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1790773360.463978:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790773360.845615:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773361.485507:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496120960:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790773361.485645:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773361.485935:0:17128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496120960 00000100:00100000:2.0:1790773361.485944:0:17128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496120960 00000100:00100000:2.0:1790773361.486003:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790773361.486014:0:17128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496120960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790773361.486052:0:17128:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1790773361.486134:0:17128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496120960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 122us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773361.486142:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790773361.486368:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496120960:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790773361.788708:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773361.788801:0:17124:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484510464 00000100:00100000:0.0:1790773361.788812:0:17124:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484510464 00000100:00100000:0.0:1790773361.788895:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 14 00000100:00100000:0.0:1790773361.788905:0:17124:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:332c789e-f22c-433e-a652-7f15822046a7+7:14959:x1877761484510464:12345-192.168.202.19@tcp:41:lfs.0 00000004:00000024:0.0:1790773361.788936:0:17124:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1790773361.789039:0:17124:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:332c789e-f22c-433e-a652-7f15822046a7+7:14959:x1877761484510464:12345-192.168.202.19@tcp:41:lfs.0 Request processed in 135us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773361.789047:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 14 00000100:00080000:1.0:1790773361.790754:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790773361.794303:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773361.795260:0:17123:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484510592 00000100:00100000:0.0:1790773361.795276:0:17123:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484510592 00000100:00100000:0.0:1790773361.795378:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 15 00000100:00100000:0.0:1790773361.795389:0:17123:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:332c789e-f22c-433e-a652-7f15822046a7+6:14959:x1877761484510592:12345-192.168.202.19@tcp:41:lfs.0 00000004:00000024:0.0:1790773361.795435:0:17123:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1790773361.795555:0:17123:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:332c789e-f22c-433e-a652-7f15822046a7+6:14959:x1877761484510592:12345-192.168.202.19@tcp:41:lfs.0 Request processed in 168us (1262us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773361.795564:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 15 00000100:00080000:1.0:1790773361.795684:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790773361.797874:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773361.798119:0:18632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484510720 00000100:00100000:0.0:1790773361.798129:0:18632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484510720 00000100:00100000:0.0:1790773361.798336:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:0.0:1790773361.798357:0:18632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:332c789e-f22c-433e-a652-7f15822046a7+6:14959:x1877761484510720:12345-192.168.202.19@tcp:13:lfs.0 00002000:00000024:0.0:1790773361.798394:0:18632:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1790773361.798514:0:18632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:332c789e-f22c-433e-a652-7f15822046a7+6:14959:x1877761484510720:12345-192.168.202.19@tcp:13:lfs.0 Request processed in 161us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773361.798529:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00080000:1.0:1790773361.799570:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790773361.807011:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773361.807276:0:18632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484510848 00000100:00100000:0.0:1790773361.807286:0:18632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484510848 00000100:00100000:0.0:1790773361.807365:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00100000:0.0:1790773361.807376:0:18632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:332c789e-f22c-433e-a652-7f15822046a7+6:14959:x1877761484510848:12345-192.168.202.19@tcp:13:lfs.0 00002000:00000024:0.0:1790773361.807413:0:18632:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1790773361.807520:0:18632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:332c789e-f22c-433e-a652-7f15822046a7+6:14959:x1877761484510848:12345-192.168.202.19@tcp:13:lfs.0 Request processed in 146us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773361.807528:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00080000:1.0:1790773361.808934:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1790773361.869642:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773361.997416:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496121088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790773361.997489:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773361.997550:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790773361.997559:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496121216:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790773361.997564:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496121344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790773361.997583:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773361.997655:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773361.997956:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496121856:0@lo:400:kworker.0 00000100:00100000:1.0:1790773361.997987:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773361.998003:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3605:1877761496121728:0@lo:400:kworker.0 00000100:00100000:1.0:1790773361.998004:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3606:1877761496122368:0@lo:400:kworker.0 00000100:00100000:1.0:1790773361.998026:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773361.998029:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3607:1877761496121472:0@lo:400:kworker.0 00000100:00100000:1.0:1790773361.998057:0:19515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496121856 00000100:00100000:3.0:1790773361.998058:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773361.998064:0:19515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496121856 00000100:00100000:3.0:1790773361.998079:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877761496121984:0@lo:400:kworker.0 00000100:00100000:1.0:1790773361.998142:0:19515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790773361.998149:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773361.998165:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3607:1877761496122496:0@lo:400:kworker.0 00000100:00100000:3.0:1790773361.998190:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773361.998239:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773361.998250:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3605:1877761496122240:0@lo:400:kworker.0 00000100:00100000:3.0:1790773361.998383:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773361.998400:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1790773361.998406:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496121600:0@lo:400:kworker.0 00000100:00100000:3.0:1790773361.998430:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773361.998446:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3605:1877761496122112:0@lo:400:kworker.0 00000100:00100000:3.0:1790773361.998467:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773361.998477:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496122624:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790773361.998479:0:18631:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496121088 00000100:00100000:2.0:1790773361.998484:0:18631:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496121088 00000100:00100000:3.0:1790773361.998513:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773361.998514:0:18631:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496121216 00000100:00100000:2.0:1790773361.998516:0:18631:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496121216 00000100:00100000:2.0:1790773361.998527:0:18631:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496121344 00000100:00100000:2.0:1790773361.998530:0:18631:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496121344 00000100:00100000:3.0:1790773361.998537:0:17127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496121600 00000100:00100000:3.0:1790773361.998540:0:17127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496121600 00000100:00100000:3.0:1790773361.998555:0:17127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496122624 00000100:00100000:2.0:1790773361.998555:0:18631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790773361.998557:0:17127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496122624 00000100:00100000:2.0:1790773361.998562:0:18631:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496121088:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790773361.998567:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790773361.998571:0:17127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3605:x1877761496121600:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1790773361.998584:0:18631:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1790773361.998636:0:18631:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496121088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (1147us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773361.998644:0:18631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790773361.998931:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790773361.998941:0:18632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496121216:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790773361.998951:0:18632:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1790773361.998982:0:18632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496121216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (1399us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773361.998988:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790773361.999001:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790773361.999007:0:18632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496121344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790773361.999017:0:18632:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1790773361.999049:0:18632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496121344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (1393us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773361.999055:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790773361.999105:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496121344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790773361.999128:0:17123:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496122368 00000100:00100000:0.0:1790773361.999132:0:17123:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496122368 00000100:00100000:1.0:1790773361.999259:0:19515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496121856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773361.999296:0:19515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496121856:12345-0@lo:400:kworker.0 Request processed in 40us (1307us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773361.999301:0:19515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790773361.999334:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496121856:0@lo:400:kworker.0 00000100:00100000:3.0:1790773361.999409:0:17127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3605:x1877761496121600:12345-0@lo:400:kworker.0 Request processed in 701us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773361.999426:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790773361.999441:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1790773361.999760:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790773361.999764:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790773361.999782:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790773361.999822:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496121600:0@lo:400:kworker.0 00000100:00100000:1.0:1790773361.999834:0:3605:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1790773361.999850:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496121088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790773361.999864:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496121216:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790773361.999892:0:17122:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496121984 00000100:00100000:1.0:1790773361.999896:0:17122:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496121984 00000100:00100000:1.0:1790773361.999923:0:17122:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496122496 00000100:00100000:1.0:1790773361.999925:0:17122:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496122496 00000100:00100000:1.0:1790773361.999941:0:17122:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496121728 00000100:00100000:1.0:1790773361.999943:0:17122:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496121728 00000100:00100000:1.0:1790773361.999952:0:17122:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496122240 00000100:00100000:1.0:1790773361.999954:0:17122:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496122240 00000100:00100000:1.0:1790773361.999963:0:17122:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496122112 00000100:00100000:1.0:1790773361.999965:0:17122:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496122112 00000100:00100000:1.0:1790773361.999978:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790773361.999984:0:17122:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877761496121984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773362.000015:0:17127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496122624:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790773362.000028:0:17122:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877761496121984:12345-0@lo:400:kworker.0 Request processed in 44us (1878us total) trans 0 rc 0/0 00000004:00000024:3.0:1790773362.000034:0:17127:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1790773362.000034:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790773362.000046:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790773362.000052:0:17122:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1877761496122496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773362.000071:0:17127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496122624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 58us (1557us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773362.000076:0:17122:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1877761496122496:12345-0@lo:400:kworker.0 Request processed in 25us (1886us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773362.000081:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790773362.001578:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773362.001615:0:17116:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496121472 00000100:00100000:2.0:1790773362.001623:0:17116:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496121472 00000100:00100000:2.0:1790773362.001671:0:17116:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484510976 00000100:00100000:2.0:1790773362.001674:0:17116:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484510976 00000100:00100000:3.0:1790773362.001680:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790773362.001688:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1790773362.001694:0:17116:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+24:3607:x1877761496121472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773362.001705:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 132 00000100:00100000:3.0:1790773362.001712:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+10:14989:x1877761484510976:12345-192.168.202.19@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790773362.001722:0:17117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773362.001739:0:17117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d26c4a2200/0xabf1cc0bc7842f8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6bff3 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773362.001746:0:17116:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+24:3607:x1877761496121472:12345-0@lo:400:kworker.0 Request processed in 53us (3688us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773362.001752:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:2.0:1790773362.001983:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790773362.001987:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790773362.002044:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790773362.002054:0:17123:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3605:x1877761496121728:12345-0@lo:400:kworker.0 00010000:00010000:3.0:1790773362.002068:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d26c4a2200/0xabf1cc0bc7842f8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bff3 expref: 11 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773362.002082:0:17117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d26c4a2200/0xabf1cc0bc7842f8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bff3 expref: 11 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773362.002102:0:17117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26c4a2200, rc 0) 00000100:00100000:0.0:1790773362.002104:0:17123:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3605:x1877761496121728:12345-0@lo:400:kworker.0 Request processed in 53us (3864us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773362.002110:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790773362.002124:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790773362.002131:0:17123:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3605:x1877761496122240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773362.002283:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790773362.002294:0:17122:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3605:x1877761496122112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773362.002499:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+11:14989:x1877761484510976:12345-192.168.202.19@tcp:101:mount.lustre.0 Request processed in 785us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773362.002505:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 132 00000100:00100000:0.0:1790773362.002540:0:17123:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3605:x1877761496122240:12345-0@lo:400:kworker.0 Request processed in 410us (4156us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773362.002546:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790773362.002558:0:17123:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1790773362.002565:0:17123:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1790773362.002677:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790773362.002685:0:17123:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3606:x1877761496122368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773362.002722:0:17123:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3606:x1877761496122368:12345-0@lo:400:kworker.0 Request processed in 39us (4694us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773362.002727:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790773362.002917:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496122624:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790773362.002933:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3605:1877761496121728:0@lo:400:kworker.0 00010000:00080000:0.0:1790773362.002946:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27fa90e00 x1877761496122240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773362.002955:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3605:1877761496122240:0@lo:400:kworker.0 00000100:00100000:0.0:1790773362.002998:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3606:1877761496122368:0@lo:400:kworker.0 00000100:00100000:1.0:1790773362.005227:0:17122:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3605:x1877761496122112:12345-0@lo:400:kworker.0 Request processed in 2855us (6677us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773362.005243:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790773362.005411:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3607:1877761496121472:0@lo:400:kworker.0 00000100:00100000:2.0:1790773362.005431:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877761496121984:0@lo:400:kworker.0 00010000:00080000:2.0:1790773362.005461:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27fa92300 x1877761496122496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773362.005472:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3607:1877761496122496:0@lo:400:kworker.0 00000100:00100000:0.0:1790773362.006094:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3605:1877761496122112:0@lo:400:kworker.0 00000100:00100000:2.0:1790773362.010081:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773362.010251:0:17116:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484511104 00000100:00100000:0.0:1790773362.010263:0:17116:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484511104 00000100:00100000:0.0:1790773362.010323:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 133 00000100:00100000:0.0:1790773362.010333:0:17116:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+11:14989:x1877761484511104:12345-192.168.202.19@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790773362.010497:0:17116:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+11:14989:x1877761484511104:12345-192.168.202.19@tcp:501:mount.lustre.0 Request processed in 165us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773362.010506:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 133 00000100:00100000:3.0:1790773362.016614:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773362.017106:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484511232 00000100:00100000:0.0:1790773362.017118:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484511232 00000100:00100000:0.0:1790773362.017273:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 134 00000100:00100000:0.0:1790773362.017285:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143066850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+11:14989:x1877761484511232:12345-192.168.202.19@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790773362.017485:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143066850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+11:14989:x1877761484511232:12345-192.168.202.19@tcp:503:mount.lustre.0 Request processed in 201us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773362.017493:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 134 00000100:00100000:1.0:1790773362.040800:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773362.041175:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484511360 00000100:00100000:2.0:1790773362.041196:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484511360 00000100:00100000:2.0:1790773362.041302:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 135 00000100:00100000:2.0:1790773362.041312:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143067050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+11:14997:x1877761484511360:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790773362.042131:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143067050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+11:14997:x1877761484511360:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 814us (1336us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773362.042141:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 135 00000100:00100000:1.0:1790773362.114002:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773362.114134:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484511488 00000100:00100000:0.0:1790773362.114146:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484511488 00000100:00100000:0.0:1790773362.114247:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 136 00000100:00100000:0.0:1790773362.114257:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143067450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+11:14997:x1877761484511488:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790773362.114420:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143067450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+11:14997:x1877761484511488:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 165us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773362.114428:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 136 00000100:00100000:2.0:1790773362.125579:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773362.125912:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484511616 00000100:00100000:0.0:1790773362.125923:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484511616 00000100:00100000:0.0:1790773362.125985:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 137 00000100:00100000:0.0:1790773362.125996:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143065450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+11:14997:x1877761484511616:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790773362.127448:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143065450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+11:14997:x1877761484511616:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 185us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773362.127463:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 137 00000100:00100000:1.0:1790773362.132730:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773362.132944:0:17116:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484511744 00000100:00100000:2.0:1790773362.132958:0:17116:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484511744 00000100:00100000:2.0:1790773362.133022:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 138 00000100:00100000:2.0:1790773362.133033:0:17116:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143067850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+11:14989:x1877761484511744:12345-192.168.202.19@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790773362.133055:0:17116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773362.133074:0:17116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d24166ea00/0xabf1cc0bc7842f93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c024 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773362.133119:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d24166ea00/0xabf1cc0bc7842f93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c024 expref: 12 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773362.133140:0:17116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d24166ea00/0xabf1cc0bc7842f93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c024 expref: 12 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773362.133150:0:17116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d24166ea00, rc 0) 00000100:00100000:2.0:1790773362.133584:0:17116:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143067850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+12:14989:x1877761484511744:12345-192.168.202.19@tcp:101:mount.lustre.0 Request processed in 551us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773362.133593:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 138 00000100:00100000:1.0:1790773362.139833:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773362.140050:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484511872 00000100:00100000:0.0:1790773362.140060:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484511872 00000100:00100000:0.0:1790773362.140161:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 139 00000100:00100000:0.0:1790773362.140171:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143064850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+12:14989:x1877761484511872:12345-192.168.202.19@tcp:256:mount.lustre.0 20000000:01000000:0.0:1790773362.140233:0:17115:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1790773362.140273:0:17115:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1790773362.140278:0:17115:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1790773362.140280:0:17115:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1790773362.140283:0:17115:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1790773362.140285:0:17115:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1790773362.142104:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143064850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+12:14989:x1877761484511872:12345-192.168.202.19@tcp:256:mount.lustre.0 Request processed in 1913us (2275us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773362.142132:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 139 00000100:00100000:1.0:1790773362.146018:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773362.146135:0:17116:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484512000 00000100:00100000:2.0:1790773362.146145:0:17116:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484512000 00000100:00100000:2.0:1790773362.146329:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 140 00000100:00100000:2.0:1790773362.146340:0:17116:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143067c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+12:14989:x1877761484512000:12345-192.168.202.19@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790773362.146360:0:17116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773362.146378:0:17116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d24166f400/0xabf1cc0bc7842f9a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c02b expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773362.146425:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d24166f400/0xabf1cc0bc7842f9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c02b expref: 13 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773362.146436:0:17116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d24166f400/0xabf1cc0bc7842f9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c02b expref: 13 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773362.146453:0:17116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d24166f400, rc 0) 00000100:00100000:2.0:1790773362.146519:0:17116:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143067c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+13:14989:x1877761484512000:12345-192.168.202.19@tcp:101:mount.lustre.0 Request processed in 181us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773362.146525:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 140 00000100:00100000:1.0:1790773362.149825:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773362.149952:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484512128 00000100:00100000:2.0:1790773362.149963:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484512128 00000100:00100000:2.0:1790773362.150015:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 141 00000100:00100000:2.0:1790773362.150025:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143064050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+13:14989:x1877761484512128:12345-192.168.202.19@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790773362.150235:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143064050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+13:14989:x1877761484512128:12345-192.168.202.19@tcp:501:mount.lustre.0 Request processed in 211us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773362.150243:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 141 00000100:00100000:0.0:1790773362.151822:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773362.151912:0:17116:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484512256 00000100:00100000:2.0:1790773362.151918:0:17116:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484512256 00000100:00100000:2.0:1790773362.151970:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 142 00000100:00100000:2.0:1790773362.151979:0:17116:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143064450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+13:14989:x1877761484512256:12345-192.168.202.19@tcp:503:mount.lustre.0 00000100:00100000:2.0:1790773362.152080:0:17116:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143064450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+13:14989:x1877761484512256:12345-192.168.202.19@tcp:503:mount.lustre.0 Request processed in 103us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773362.152097:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 142 00000100:00100000:1.0:1790773362.157728:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773362.158285:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484512384 00000100:00100000:2.0:1790773362.158297:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484512384 00000100:00100000:2.0:1790773362.158411:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 143 00000100:00100000:2.0:1790773362.158422:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143065050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+13:15004:x1877761484512384:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790773362.158588:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143065050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+13:15004:x1877761484512384:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 168us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773362.158596:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 143 00000100:00100000:1.0:1790773362.164097:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773362.164238:0:17116:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484512512 00000100:00100000:2.0:1790773362.164248:0:17116:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484512512 00000100:00100000:2.0:1790773362.164307:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 144 00000100:00100000:2.0:1790773362.164318:0:17116:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143065c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+13:15004:x1877761484512512:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790773362.164476:0:17116:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143065c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+13:15004:x1877761484512512:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 159us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773362.164485:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 144 00000100:00100000:0.0:1790773362.178766:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773362.178858:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773362.179335:0:17124:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484512640 00000100:00100000:2.0:1790773362.179346:0:17124:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484512640 00000100:00100000:2.0:1790773362.179387:0:17124:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484512896 00000100:00100000:2.0:1790773362.179391:0:17124:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484512896 00000100:00100000:2.0:1790773362.179417:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:2.0:1790773362.179426:0:17124:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2396:x1877761484512640:12345-192.168.202.19@tcp:38:mount.lustre.0 00010000:00080000:2.0:1790773362.179457:0:17124:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from cc5bed67-af2d-4aff-9e99-0fd42cc26e20@192.168.202.19@tcp t0 exp 0000000000000000 cur 504 last 0 00000020:00000080:2.0:1790773362.179506:0:17124:0:(genops.c:1384:class_connect()) connect: client cc5bed67-af2d-4aff-9e99-0fd42cc26e20, cookie 0xabf1cc0bc7842fa1 00000004:00100000:2.0:1790773362.179531:0:17124:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1790773362.179627:0:17124:0:(import.c:65:import_set_state_nolock()) ffff93d143290000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790773362.179696:0:17124:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+6:2396:x1877761484512640:12345-192.168.202.19@tcp:38:mount.lustre.0 Request processed in 270us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773362.179704:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:2.0:1790773362.179723:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:2.0:1790773362.179727:0:17124:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2396:x1877761484512896:12345-192.168.202.19@tcp:38:mount.lustre.0 00010000:00080000:2.0:1790773362.179742:0:17124:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from cc5bed67-af2d-4aff-9e99-0fd42cc26e20@192.168.202.19@tcp t0 exp 0000000000000000 cur 504 last 0 00000020:00000080:2.0:1790773362.179764:0:17124:0:(genops.c:1384:class_connect()) connect: client cc5bed67-af2d-4aff-9e99-0fd42cc26e20, cookie 0xabf1cc0bc7842fa8 00000004:00100000:2.0:1790773362.179775:0:17124:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1790773362.179845:0:17124:0:(import.c:65:import_set_state_nolock()) ffff93d27ff72800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790773362.179871:0:17124:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+6:2396:x1877761484512896:12345-192.168.202.19@tcp:38:mount.lustre.0 Request processed in 142us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773362.179879:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:1.0:1790773362.188950:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773362.188990:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773362.189022:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773362.189130:0:19912:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484513024 00000100:00100000:0.0:1790773362.189142:0:19912:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484513024 00000100:00100000:0.0:1790773362.189237:0:19912:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484512768 00000100:00100000:0.0:1790773362.189241:0:19912:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484512768 00000100:00100000:0.0:1790773362.189256:0:19912:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484513152 00000100:00100000:0.0:1790773362.189259:0:19912:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484513152 00000100:00100000:0.0:1790773362.189273:0:19912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 18 00000100:00100000:0.0:1790773362.189283:0:19912:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+6:0:x1877761484513024:12345-192.168.202.19@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790773362.189315:0:19912:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1790773362.189388:0:19912:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+6:0:x1877761484513024:12345-192.168.202.19@tcp:41:mount.lustre.0 Request processed in 106us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773362.189413:0:19912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 18 00000100:00100000:0.0:1790773362.189432:0:19912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 19 00000100:00100000:0.0:1790773362.189438:0:19912:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+7:0:x1877761484512768:12345-192.168.202.19@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790773362.189461:0:19912:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1790773362.189488:0:19912:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+7:0:x1877761484512768:12345-192.168.202.19@tcp:41:mount.lustre.0 Request processed in 51us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773362.189495:0:19912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 19 00000100:00100000:0.0:1790773362.189507:0:19912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00100000:0.0:1790773362.189513:0:19912:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+6:14989:x1877761484513152:12345-192.168.202.19@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790773362.189538:0:19912:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1790773362.189559:0:19912:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+6:14989:x1877761484513152:12345-192.168.202.19@tcp:41:mount.lustre.0 Request processed in 47us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773362.189566:0:19912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00080000:1.0:1790773362.190831:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790773362.190840:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790773362.194053:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773362.195796:0:19912:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484513280 00000100:00100000:0.0:1790773362.195810:0:19912:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484513280 00000100:00100000:0.0:1790773362.195882:0:19912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:0.0:1790773362.195893:0:19912:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+6:14989:x1877761484513280:12345-192.168.202.19@tcp:40:mount.lustre.0 00000100:00100000:0.0:1790773362.195997:0:19912:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+6:14989:x1877761484513280:12345-192.168.202.19@tcp:40:mount.lustre.0 Request processed in 105us (1954us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773362.196005:0:19912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:0.0:1790773362.199687:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773362.199731:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773362.199825:0:18630:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484513408 00000100:00100000:2.0:1790773362.199836:0:18630:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484513408 00000100:00100000:2.0:1790773362.199879:0:18630:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484513536 00000100:00100000:2.0:1790773362.199882:0:18630:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484513536 00000100:00100000:2.0:1790773362.199908:0:18630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 18 00000100:00100000:2.0:1790773362.199917:0:18630:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2396:x1877761484513408:12345-192.168.202.19@tcp:8:mount.lustre.0 00010000:00080000:2.0:1790773362.199953:0:18630:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from cc5bed67-af2d-4aff-9e99-0fd42cc26e20@192.168.202.19@tcp t0 exp 0000000000000000 cur 505 last 0 00000020:00000080:2.0:1790773362.199986:0:18630:0:(genops.c:1384:class_connect()) connect: client cc5bed67-af2d-4aff-9e99-0fd42cc26e20, cookie 0xabf1cc0bc7842faf 00002000:00100000:2.0:1790773362.199997:0:18630:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli cc5bed67-af2d-4aff-9e99-0fd42cc26e20/ffff93d27ff70800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790773362.200008:0:18630:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1790773362.200239:0:18628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 19 00000100:00100000:3.0:1790773362.200245:0:18628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14378d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2396:x1877761484513536:12345-192.168.202.19@tcp:8:mount.lustre.0 00010000:00080000:3.0:1790773362.200267:0:18628:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from cc5bed67-af2d-4aff-9e99-0fd42cc26e20@192.168.202.19@tcp t0 exp 0000000000000000 cur 505 last 0 00000020:00000080:3.0:1790773362.200284:0:18628:0:(genops.c:1384:class_connect()) connect: client cc5bed67-af2d-4aff-9e99-0fd42cc26e20, cookie 0xabf1cc0bc7842fb6 00002000:00100000:3.0:1790773362.200289:0:18628:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli cc5bed67-af2d-4aff-9e99-0fd42cc26e20/ffff93d24402c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790773362.200295:0:18628:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790773362.200343:0:18628:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1790773362.200375:0:18628:0:(import.c:65:import_set_state_nolock()) ffff93d24402e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790773362.200455:0:18628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14378d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+6:2396:x1877761484513536:12345-192.168.202.19@tcp:8:mount.lustre.0 Request processed in 198us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773362.200462:0:18628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 19 00002000:00080000:2.0:1790773362.200649:0:18630:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1790773362.200665:0:18630:0:(import.c:65:import_set_state_nolock()) ffff93d27ff73800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790773362.200706:0:18630:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+6:2396:x1877761484513408:12345-192.168.202.19@tcp:8:mount.lustre.0 Request processed in 790us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773362.200714:0:18630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 18 00000100:00100000:0.0:1790773362.202624:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773362.202935:0:17134:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484513664 00000100:00100000:3.0:1790773362.202945:0:17134:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484513664 00000100:00100000:3.0:1790773362.203006:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00100000:3.0:1790773362.203016:0:17134:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14378dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+6:14989:x1877761484513664:12345-192.168.202.19@tcp:900:mount.lustre.0 00000100:00100000:3.0:1790773362.203106:0:17134:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14378dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+6:14989:x1877761484513664:12345-192.168.202.19@tcp:900:mount.lustre.0 Request processed in 92us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773362.203113:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00100000:3.0:1790773362.218571:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773362.220665:0:17126:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484513792 00000100:00100000:1.0:1790773362.220682:0:17126:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484513792 00000100:00100000:1.0:1790773362.220799:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 1 00000100:00100000:1.0:1790773362.220809:0:17126:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+6:14989:x1877761484513792:12345-192.168.202.19@tcp:33:mount.lustre.0 00000004:00200000:1.0:1790773362.220903:0:17126:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1790773362.220997:0:17126:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+6:14989:x1877761484513792:12345-192.168.202.19@tcp:33:mount.lustre.0 Request processed in 190us (2438us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773362.221005:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 1 00000100:00100000:1.0:1790773362.408783:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773362.408870:0:17123:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484513920 00000100:00100000:3.0:1790773362.408881:0:17123:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484513920 00000100:00100000:3.0:1790773362.408948:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 22 00000100:00100000:3.0:1790773362.408958:0:17123:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+6:15028:x1877761484513920:12345-192.168.202.19@tcp:101:mkdir.0 00010000:00010000:3.0:1790773362.408981:0:17123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773362.409001:0:17123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3400/0xabf1cc0bc7842fbd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c05c expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773362.409106:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2800/0xabf1cc0bc7842fc4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773362.409131:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2800/0xabf1cc0bc7842fc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773362.409145:0:17123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2800/0xabf1cc0bc7842fc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790773362.409187:0:17123:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1790773362.409190:0:17123:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790773362.409255:0:17123:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2800/0xabf1cc0bc7842fc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773362.409279:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3400/0xabf1cc0bc7842fbd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c05c expref: 8 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773362.409297:0:17123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2800/0xabf1cc0bc7842fc4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c05c expref: 7 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773362.409305:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d26ff64700) 00010000:00010000:3.0:1790773362.409307:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790773362.409311:0:17123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26c4a2800, rc 0) 00000100:00100000:3.0:1790773362.409367:0:17123:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+7:15028:x1877761484513920:12345-192.168.202.19@tcp:101:mkdir.0 Request processed in 411us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773362.409374:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 22 00000040:00080000:1.0:1790773362.637879:0:17873:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790773362.895576:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773363.917385:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773364.946424:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790773365.073113:0:18624:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cc5bed67-af2d-4aff-9e99-0fd42cc26e20 00000001:00100000:0.0:1790773365.073137:0:18624:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 332c789e-f22c-433e-a652-7f15822046a7 00000001:00100000:0.0:1790773365.073890:0:17102:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cc5bed67-af2d-4aff-9e99-0fd42cc26e20 00000001:00100000:0.0:1790773365.073899:0:17102:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 332c789e-f22c-433e-a652-7f15822046a7 00000001:00100000:1.0:1790773365.075616:0:19441:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cc5bed67-af2d-4aff-9e99-0fd42cc26e20 00000001:00100000:1.0:1790773365.075629:0:19441:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 332c789e-f22c-433e-a652-7f15822046a7 00000001:00100000:0.0:1790773365.075754:0:17855:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of cc5bed67-af2d-4aff-9e99-0fd42cc26e20 00000001:00100000:0.0:1790773365.075761:0:17855:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 332c789e-f22c-433e-a652-7f15822046a7 00000001:02000400:2.0:1790773365.418822:0:19998:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1790773365.591373:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496122752:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790773365.591467:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773365.591657:0:18632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496122752 00000100:00100000:2.0:1790773365.591667:0:18632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496122752 00000100:00100000:2.0:1790773365.591746:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790773365.591758:0:18632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14378d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496122752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790773365.591790:0:18632:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1790773365.591838:0:18632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14378d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496122752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773365.591845:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1790773365.592080:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790773365.592126:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496122752:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1790773365.965418:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773366.606430:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790773366.606467:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496122880:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790773366.606548:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773366.606714:0:17128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496122880 00000100:00100000:3.0:1790773366.606722:0:17128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496122880 00000100:00100000:3.0:1790773366.606781:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790773366.606790:0:17128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496122880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790773366.606823:0:17128:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1790773366.606878:0:17128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496122880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773366.606885:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790773366.606964:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496122880:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1790773366.997437:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773367.117746:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496123008:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790773367.117944:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773367.118831:0:18632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496123008 00000100:00100000:2.0:1790773367.118842:0:18632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496123008 00000100:00100000:2.0:1790773367.118905:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790773367.118918:0:18632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496123008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790773367.118949:0:18632:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1790773367.119025:0:18632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496123008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 112us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773367.119033:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790773367.119069:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496123136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790773367.119107:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790773367.119147:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790773367.119157:0:18631:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496123136 00000100:00100000:2.0:1790773367.119160:0:18631:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496123136 00000100:00100000:2.0:1790773367.119183:0:18631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790773367.119189:0:18631:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496123136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790773367.119199:0:18631:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1790773367.119247:0:18631:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496123136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773367.119253:0:18631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790773367.119296:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496123008:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1790773367.119329:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790773367.119347:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496123136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790773367.120637:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496123392:0@lo:400:kworker.0 00000100:00100000:1.0:1790773367.120700:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773367.120735:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3606:1877761496123904:0@lo:400:kworker.0 00000100:00100000:1.0:1790773367.120772:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773367.120791:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3606:1877761496124416:0@lo:400:kworker.0 00000100:00100000:1.0:1790773367.120812:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773367.120833:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790773367.120840:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496123520:0@lo:400:kworker.0 00000100:00100000:1.0:1790773367.120863:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773367.120880:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3606:1877761496124032:0@lo:400:kworker.0 00000100:00100000:1.0:1790773367.120899:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773367.120927:0:17128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496123392 00000100:00100000:1.0:1790773367.120933:0:17128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496123392 00000100:00100000:1.0:1790773367.120977:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790773367.120985:0:17128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496123392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773367.121032:0:17128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496123392:12345-0@lo:400:kworker.0 Request processed in 48us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773367.121051:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790773367.121072:0:19912:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496123904 00000100:00100000:1.0:1790773367.121084:0:19912:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496123904 00000100:00100000:1.0:1790773367.121110:0:19912:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496124416 00000100:00100000:1.0:1790773367.121113:0:19912:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496124416 00000100:00100000:1.0:1790773367.121129:0:19912:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496124032 00000100:00100000:1.0:1790773367.121131:0:19912:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496124032 00000100:00100000:1.0:1790773367.121142:0:19912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790773367.121147:0:19912:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1877761496123904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773367.121177:0:19912:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1877761496123904:12345-0@lo:400:kworker.0 Request processed in 30us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773367.121183:0:19912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790773367.121194:0:19912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790773367.121199:0:19912:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3606:x1877761496124416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773367.121243:0:19912:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3606:x1877761496124416:12345-0@lo:400:kworker.0 Request processed in 44us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773367.121248:0:19912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790773367.121259:0:19912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790773367.121264:0:19912:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1877761496124032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773367.121285:0:19912:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1877761496124032:12345-0@lo:400:kworker.0 Request processed in 22us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773367.121290:0:19912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790773367.121308:0:18629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496123520 00000100:00100000:1.0:1790773367.121311:0:18629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496123520 00000100:00100000:1.0:1790773367.121336:0:18629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790773367.121343:0:18629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496123520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773367.121374:0:18629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496123520:12345-0@lo:400:kworker.0 Request processed in 32us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773367.121393:0:18629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790773367.121436:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496123520:0@lo:400:kworker.0 00000100:00100000:1.0:1790773367.121447:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3606:1877761496124032:0@lo:400:kworker.0 00000100:00100000:1.0:1790773367.121455:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496123392:0@lo:400:kworker.0 00000100:00100000:1.0:1790773367.121462:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3606:1877761496123904:0@lo:400:kworker.0 00010000:00080000:1.0:1790773367.121474:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143ce1c00 x1877761496124416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773367.121484:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3606:1877761496124416:0@lo:400:kworker.0 00000100:00100000:2.0:1790773367.123232:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3605:1877761496123264:0@lo:400:kworker.0 00000100:00100000:2.0:1790773367.123301:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773367.123351:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496123776:0@lo:400:kworker.0 00000100:00100000:2.0:1790773367.123377:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773367.123731:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3605:1877761496124288:0@lo:400:kworker.0 00000100:00100000:2.0:1790773367.123840:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773367.123871:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1790773367.123878:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3605:1877761496123648:0@lo:400:kworker.0 00000100:00100000:2.0:1790773367.123903:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773367.123921:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3605:1877761496124160:0@lo:400:kworker.0 00000100:00100000:2.0:1790773367.123942:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773367.123972:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496123264 00000100:00100000:2.0:1790773367.123992:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496123264 00000100:00100000:2.0:1790773367.124053:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1790773367.124062:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143066450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+24:3605:x1877761496123264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773367.124115:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143066450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+24:3605:x1877761496123264:12345-0@lo:400:kworker.0 Request processed in 54us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773367.124122:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1790773367.124156:0:18630:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496123776 00000100:00100000:2.0:1790773367.124160:0:18630:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496123776 00000100:00100000:2.0:1790773367.124191:0:18630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790773367.124197:0:18630:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496123776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773367.124245:0:18630:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496123776:12345-0@lo:400:kworker.0 Request processed in 48us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773367.124251:0:18630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790773367.124267:0:19912:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496124288 00000100:00100000:2.0:1790773367.124270:0:19912:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496124288 00000100:00100000:2.0:1790773367.124292:0:19912:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496123648 00000100:00100000:2.0:1790773367.124295:0:19912:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496123648 00000100:00100000:2.0:1790773367.124307:0:19912:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496124160 00000100:00100000:2.0:1790773367.124309:0:19912:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496124160 00000100:00100000:2.0:1790773367.126904:0:19912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790773367.126921:0:19912:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3605:x1877761496124288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773367.127012:0:19912:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3605:x1877761496124288:12345-0@lo:400:kworker.0 Request processed in 97us (3171us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773367.127020:0:19912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790773367.127051:0:19912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790773367.127058:0:19912:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3605:x1877761496123648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773367.127088:0:19912:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3605:x1877761496123648:12345-0@lo:400:kworker.0 Request processed in 31us (3185us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773367.127101:0:19912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790773367.127115:0:19912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790773367.127121:0:19912:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3605:x1877761496124160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773367.127152:0:19912:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3605:x1877761496124160:12345-0@lo:400:kworker.0 Request processed in 31us (3208us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773367.127158:0:19912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1790773367.127220:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790773367.127226:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790773367.127229:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790773367.127275:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3605:1877761496123648:0@lo:400:kworker.0 00010000:00080000:2.0:1790773367.127289:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27fa92a00 x1877761496124160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773367.127300:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3605:1877761496124160:0@lo:400:kworker.0 00000100:00100000:2.0:1790773367.127311:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3605:1877761496123264:0@lo:400:kworker.0 00000100:00100000:2.0:1790773367.127323:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496123776:0@lo:400:kworker.0 00000100:00100000:2.0:1790773367.127333:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3605:1877761496124288:0@lo:400:kworker.0 00000100:00100000:1.0:1790773367.128174:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790773367.128187:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496124544:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790773367.128256:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773367.128290:0:17128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496124544 00000100:00100000:1.0:1790773367.128296:0:17128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496124544 00000100:00100000:1.0:1790773367.128342:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790773367.128350:0:17128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496124544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790773367.128391:0:17128:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1790773367.128429:0:17128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496124544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773367.128435:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790773367.128469:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496124544:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790773367.130153:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496124672:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790773367.130231:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773367.130278:0:18631:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496124672 00000100:00100000:2.0:1790773367.130286:0:18631:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496124672 00000100:00100000:2.0:1790773367.130343:0:18631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790773367.130352:0:18631:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496124672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790773367.130372:0:18631:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1790773367.130433:0:18631:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496124672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773367.130440:0:18631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790773367.130480:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496124672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790773367.341772:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773367.341822:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773367.341916:0:19912:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484514176 00000100:00100000:2.0:1790773367.341926:0:19912:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484514176 00000100:00100000:2.0:1790773367.342032:0:19912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 46 00000100:00100000:2.0:1790773367.342055:0:19912:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14378c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:332c789e-f22c-433e-a652-7f15822046a7+6:2400:x1877761484514176:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1790773367.342152:0:19912:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14378c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:332c789e-f22c-433e-a652-7f15822046a7+6:2400:x1877761484514176:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 99us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773367.342160:0:19912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 46 00000100:00100000:3.0:1790773367.342580:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484514048 00000100:00100000:3.0:1790773367.342587:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484514048 00000100:00100000:3.0:1790773367.342625:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 146 00000100:00100000:3.0:1790773367.342634:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143065850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+13:2400:x1877761484514048:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1790773367.342672:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143065850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+13:2400:x1877761484514048:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 39us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773367.342679:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 146 00000100:00080000:0.0:1790773367.343329:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790773367.347328:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773367.348935:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773367.348977:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773367.349045:0:17123:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484514304 00000100:00100000:3.0:1790773367.349057:0:17123:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484514304 00000100:00100000:3.0:1790773367.349145:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 47 00000100:00100000:3.0:1790773367.349156:0:17123:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:332c789e-f22c-433e-a652-7f15822046a7+5:2400:x1877761484514304:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1790773367.349270:0:17123:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:332c789e-f22c-433e-a652-7f15822046a7+5:2400:x1877761484514304:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 116us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773367.349278:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 47 00000100:00080000:0.0:1790773367.349473:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790773367.353404:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773367.353440:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773367.353500:0:19912:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484514816 00000100:00100000:3.0:1790773367.353510:0:19912:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484514816 00000100:00100000:3.0:1790773367.353575:0:19912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 48 00000100:00100000:3.0:1790773367.353586:0:19912:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+5:2400:x1877761484514816:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1790773367.353696:0:19912:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+5:2400:x1877761484514816:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 111us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773367.353704:0:19912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 48 00000100:00100000:1.0:1790773367.354046:0:19515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484514432 00000100:00100000:1.0:1790773367.354053:0:19515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484514432 00000100:00100000:1.0:1790773367.354231:0:19515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484514560 00000100:00100000:1.0:1790773367.354236:0:19515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484514560 00000100:00100000:1.0:1790773367.354269:0:19515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:1.0:1790773367.354277:0:19515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14378c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:332c789e-f22c-433e-a652-7f15822046a7+5:2399:x1877761484514432:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773367.354331:0:19515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14378c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:332c789e-f22c-433e-a652-7f15822046a7+5:2399:x1877761484514432:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 55us (7016us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773367.354338:0:19515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:1.0:1790773367.354364:0:19515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:1.0:1790773367.354371:0:19515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:332c789e-f22c-433e-a652-7f15822046a7+5:2400:x1877761484514560:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773367.354398:0:19515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:332c789e-f22c-433e-a652-7f15822046a7+5:2400:x1877761484514560:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 27us (5421us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773367.354404:0:19515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00080000:1.0:1790773367.354612:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790773367.354618:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790773367.354621:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790773367.356927:0:18630:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484515072 00000100:00100000:2.0:1790773367.356942:0:18630:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484515072 00000100:00100000:2.0:1790773367.357017:0:18630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00100000:2.0:1790773367.357027:0:18630:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+5:2400:x1877761484515072:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1790773367.357132:0:18630:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+5:2400:x1877761484515072:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 106us (3690us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773367.357140:0:18630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00100000:2.0:1790773367.357222:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773367.357337:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773367.357362:0:18628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484514944 00000100:00100000:2.0:1790773367.357366:0:18628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484514944 00000100:00100000:2.0:1790773367.357403:0:18628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00100000:2.0:1790773367.357409:0:18628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+5:2399:x1877761484514944:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1790773367.357439:0:18628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+5:2399:x1877761484514944:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 30us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773367.357445:0:18628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00100000:2.0:1790773367.357462:0:17123:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484514688 00000100:00100000:2.0:1790773367.357466:0:17123:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484514688 00000100:00100000:2.0:1790773367.357490:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 49 00000100:00100000:2.0:1790773367.357496:0:17123:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+6:2399:x1877761484514688:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1790773367.357520:0:17123:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+6:2399:x1877761484514688:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 25us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773367.357527:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 49 00000100:00080000:3.0:1790773367.359376:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790773367.359387:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790773367.359390:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1790773368.025947:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790773368.994766:0:20145:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff5b960890 20000000:00000080:2.0:1790773368.994784:0:20145:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93d27dfed400 uarg=0000000000000000 20000000:01000000:2.0:1790773368.994832:0:20145:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790773368.994838:0:20145:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790773368.994843:0:20145:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1790773368.999903:0:20146:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1790773369.000097:0:20145:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1790773369.008342:0:20145:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1790773369.008385:0:20145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93d26c4a2a00/0xabf1cc0bc7842fcb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773369.008408:0:20145:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d1434ac400/0xabf1cc0bc7842c60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7842c59 expref: 23 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773369.008418:0:20145:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d1434ac000/0xabf1cc0bc7842c6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7842c67 expref: 23 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773369.008425:0:20145:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d26efc4c00/0xabf1cc0bc7842cad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7842ca6 expref: 23 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773369.008433:0:20145:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d27b12a600/0xabf1cc0bc7842d47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7842d40 expref: 23 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773369.008443:0:20145:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d25074ae00/0xabf1cc0bc7842f5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bfbb expref: 12 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773369.008451:0:20145:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d24166f400/0xabf1cc0bc7842f9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c02b expref: 12 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773369.008629:0:20145:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93d26c4a2a00/0xabf1cc0bc7842fcb lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773369.008692:0:20145:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d24166f400/0xabf1cc0bc7842f9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c02b expref: 12 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773369.008708:0:20145:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d24166f400/0xabf1cc0bc7842f9a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c02b expref: 12 pid: 17116 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773369.008794:0:20145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20145:1877761496124800:192.168.202.19@tcp:104: 00010000:00010000:3.0:1790773369.008950:0:20145:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d25074ae00/0xabf1cc0bc7842f5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bfbb expref: 12 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773369.008959:0:20145:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d25074ae00/0xabf1cc0bc7842f5b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bfbb expref: 12 pid: 17116 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773369.008969:0:20145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20145:1877761496124928:192.168.202.19@tcp:104: 00010000:00010000:3.0:1790773369.009000:0:20145:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d27b12a600/0xabf1cc0bc7842d47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc7842d40 expref: 23 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773369.009008:0:20145:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d27b12a600/0xabf1cc0bc7842d47 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc7842d40 expref: 23 pid: 17115 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773369.009016:0:20145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20145:1877761496125056:0@lo:104: 00000100:00100000:3.0:1790773369.009137:0:20145:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790773369.009189:0:20145:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d26efc4c00/0xabf1cc0bc7842cad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc7842ca6 expref: 23 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773369.009197:0:20145:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d26efc4c00/0xabf1cc0bc7842cad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc7842ca6 expref: 23 pid: 17116 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773369.009247:0:20145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20145:1877761496125184:0@lo:104: 00000100:00100000:3.0:1790773369.009276:0:20145:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790773369.010140:0:20145:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d1434ac000/0xabf1cc0bc7842c6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc7842c67 expref: 23 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773369.010152:0:20145:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d1434ac000/0xabf1cc0bc7842c6e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc7842c67 expref: 23 pid: 17115 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773369.010162:0:20145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20145:1877761496125312:0@lo:104: 00000100:00100000:3.0:1790773369.010190:0:20145:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773369.015336:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773369.015368:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773369.015409:0:17108:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484515200 00000100:00100000:2.0:1790773369.015420:0:17108:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484515200 00010000:00010000:2.0:1790773369.015479:0:17108:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d24166f400/0xabf1cc0bc7842f9a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c02b expref: 13 pid: 17116 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773369.015521:0:17108:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484515328 00000100:00100000:2.0:1790773369.015525:0:17108:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484515328 00010000:00010000:2.0:1790773369.015538:0:17108:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d25074ae00/0xabf1cc0bc7842f5b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bfbb expref: 14 pid: 17116 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773369.015568:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:2.0:1790773369.015577:0:17108:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+14:2398:x1877761484515200:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790773369.015594:0:17108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790773369.015600:0:17108:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d24166f400/0xabf1cc0bc7842f9a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c02b expref: 14 pid: 17116 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773369.015612:0:17108:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d24166f400/0xabf1cc0bc7842f9a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c02b expref: 14 pid: 17116 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773369.015632:0:17108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790773369.015689:0:17108:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+14:2398:x1877761484515200:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 112us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773369.015696:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:2.0:1790773369.015725:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:2.0:1790773369.015732:0:17108:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+13:2398:x1877761484515328:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790773369.015742:0:17108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790773369.015746:0:17108:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d25074ae00/0xabf1cc0bc7842f5b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bfbb expref: 13 pid: 17116 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773369.015755:0:17108:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d25074ae00/0xabf1cc0bc7842f5b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bfbb expref: 13 pid: 17116 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773369.015765:0:17108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790773369.015782:0:17108:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+13:2398:x1877761484515328:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 51us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773369.015789:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 10 00010000:00010000:3.0:1790773369.016111:0:20145:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d1434ac400/0xabf1cc0bc7842c60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc7842c59 expref: 23 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773369.016123:0:20145:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d1434ac400/0xabf1cc0bc7842c60 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc7842c59 expref: 23 pid: 17115 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773369.016136:0:20145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20145:1877761496125440:0@lo:104: 00000100:00100000:3.0:1790773369.016175:0:20145:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773369.016401:0:17106:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496125056 00000100:00100000:0.0:1790773369.016407:0:17106:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496125056 00000100:00100000:0.0:1790773369.016437:0:17106:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496125184 00000100:00100000:0.0:1790773369.016440:0:17106:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496125184 00000100:00100000:1.0:1790773369.016557:0:17105:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496125312 00000100:00100000:1.0:1790773369.016630:0:17105:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496125312 00000100:00100000:0.0:1790773369.016822:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790773369.016832:0:17106:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+5:20145:x1877761496125056:12345-0@lo:104: 00010000:00010000:0.0:1790773369.016848:0:17106:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d1434ace00/0xabf1cc0bc7842d40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7842d47 expref: -99 pid: 19440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773369.017784:0:17106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790773369.017796:0:17106:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+5:20145:x1877761496125056:12345-0@lo:104: Request processed in 965us (8658us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773369.017823:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790773369.017855:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790773369.017863:0:17106:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+4:20145:x1877761496125184:12345-0@lo:104: 00010000:00010000:0.0:1790773369.017876:0:17106:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d26efc5400/0xabf1cc0bc7842ca6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7842cad expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773369.018236:0:20145:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d251cfd480 going to sleep for 11 seconds 00010000:00010000:3.0:1790773369.018268:0:20145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d24166f400/0xabf1cc0bc7842f9a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c02b expref: 12 pid: 17116 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773369.018284:0:20145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20145:1877761496124800:192.168.202.19@tcp:104: 00010000:00010000:3.0:1790773369.018296:0:20145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d25074ae00/0xabf1cc0bc7842f5b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bfbb expref: 11 pid: 17116 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773369.018303:0:20145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20145:1877761496124928:192.168.202.19@tcp:104: 00000100:00100000:3.0:1790773369.018325:0:20145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20145:1877761496125056:0@lo:104: 00000100:00100000:3.0:1790773369.018332:0:20145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20145:1877761496125184:0@lo:104: 00010000:00010000:2.0:1790773369.018652:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790773369.018660:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d1434ace00/0xabf1cc0bc7842d40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7842d47 expref: -99 pid: 19440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773369.018668:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ace00 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:2.0:1790773369.018672:0:17110:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d1434ace00/0xabf1cc0bc7842d40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc7842d47 expref: -99 pid: 19440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773369.018681:0:17110:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d1434ace00/0xabf1cc0bc7842d40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc7842d47 expref: -99 pid: 19440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790773369.018688:0:17110:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d1434ace00/0xabf1cc0bc7842d40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc7842d47 expref: -99 pid: 19440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790773369.018694:0:17110:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790773369.018742:0:17110:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d1434ace00/0xabf1cc0bc7842d40 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7842d47 expref: -99 pid: 19440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773369.018749:0:17110:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790773369.018770:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d1434ace00/0xabf1cc0bc7842d40 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7842d47 expref: -99 pid: 19440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773369.018777:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d1434ace00/0xabf1cc0bc7842d40 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7842d47 expref: -99 pid: 19440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773369.018788:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790773369.018792:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d26efc5400/0xabf1cc0bc7842ca6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7842cad expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773369.018798:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc5400 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:2.0:1790773369.018801:0:17110:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d26efc5400/0xabf1cc0bc7842ca6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc7842cad expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773369.018816:0:17110:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d26efc5400/0xabf1cc0bc7842ca6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc7842cad expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790773369.018823:0:17110:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d26efc5400/0xabf1cc0bc7842ca6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc7842cad expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790773369.018829:0:17110:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790773369.018844:0:17110:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d26efc5400/0xabf1cc0bc7842ca6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7842cad expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773369.018849:0:17110:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790773369.018869:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d26efc5400/0xabf1cc0bc7842ca6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7842cad expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773369.018876:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d26efc5400/0xabf1cc0bc7842ca6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7842cad expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773369.018886:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773369.018888:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773369.018890:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773369.018905:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3605:1877761496125568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790773369.018953:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773369.019000:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3606:1877761496125696:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790773369.019317:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773369.019365:0:17107:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496125568 00000100:00100000:2.0:1790773369.019373:0:17107:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496125568 00010000:00010000:2.0:1790773369.019404:0:17107:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d27b12a600/0xabf1cc0bc7842d47 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7842d40 expref: 24 pid: 17115 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773369.019438:0:17107:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496125696 00000100:00100000:2.0:1790773369.019442:0:17107:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496125696 00010000:00010000:2.0:1790773369.019789:0:17107:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d26efc4c00/0xabf1cc0bc7842cad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7842ca6 expref: 25 pid: 17116 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773369.019813:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790773369.019823:0:17107:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+25:3605:x1877761496125568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790773369.019840:0:17107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790773369.019848:0:17107:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d27b12a600/0xabf1cc0bc7842d47 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7842d40 expref: 25 pid: 17115 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773369.019863:0:17107:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d27b12a600/0xabf1cc0bc7842d47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc7842d40 expref: 25 pid: 17115 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773369.019864:0:17105:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1790773369.019889:0:17105:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:2.0:1790773369.019896:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d27b12a600/0xabf1cc0bc7842d47 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc7842d40 expref: 25 pid: 17115 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773369.019957:0:17109:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1790773369.019964:0:17109:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1790773369.020379:0:17107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790773369.020438:0:17107:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+24:3605:x1877761496125568:12345-0@lo:103:ldlm_bl.0 Request processed in 617us (1483us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773369.020446:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790773369.020469:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790773369.020476:0:17107:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+23:3606:x1877761496125696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790773369.021430:0:17107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790773369.021442:0:17107:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d26efc4c00/0xabf1cc0bc7842cad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7842ca6 expref: 23 pid: 17116 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773369.021464:0:17107:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d26efc4c00/0xabf1cc0bc7842cad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc7842ca6 expref: 23 pid: 17116 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773369.021496:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d26efc4c00/0xabf1cc0bc7842cad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc7842ca6 expref: 23 pid: 17116 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773369.021512:0:17107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790773369.021565:0:17107:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+22:3606:x1877761496125696:12345-0@lo:103:ldlm_bl.0 Request processed in 1089us (2248us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773369.021573:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790773369.021625:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3605:1877761496125568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790773369.021656:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3606:1877761496125696:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790773369.021981:0:17106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1790773369.021992:0:17106:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+4:20145:x1877761496125184:12345-0@lo:104: Request processed in 4128us (12714us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773369.022000:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1790773369.022073:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773369.022803:0:17105:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496125440 00000100:00100000:3.0:1790773369.022812:0:17105:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496125440 00000100:00100000:3.0:1790773369.022861:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790773369.022872:0:17105:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+4:20145:x1877761496125312:12345-0@lo:104: 00010000:00010000:3.0:1790773369.022888:0:17105:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d25074aa00/0xabf1cc0bc7842c67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7842c6e expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773369.022946:0:20147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790773369.022965:0:20147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+4:20145:x1877761496125440:12345-0@lo:104: 00010000:00010000:1.0:1790773369.022983:0:20147:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d1434ac600/0xabf1cc0bc7842c59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7842c60 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773369.022986:0:17105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790773369.023005:0:17105:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+4:20145:x1877761496125312:12345-0@lo:104: Request processed in 134us (12811us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773369.023016:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1790773369.023065:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790773369.023073:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d25074aa00/0xabf1cc0bc7842c67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7842c6e expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773369.023083:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074aa00 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:3.0:1790773369.023088:0:17110:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d25074aa00/0xabf1cc0bc7842c67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc7842c6e expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773369.023098:0:17110:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d25074aa00/0xabf1cc0bc7842c67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc7842c6e expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773369.023100:0:20147:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:00010000:3.0:1790773369.023113:0:17110:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d25074aa00/0xabf1cc0bc7842c67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc7842c6e expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773369.023116:0:20147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+3:20145:x1877761496125440:12345-0@lo:104: Request processed in 156us (6937us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773369.023138:0:20147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 10000000:01000000:3.0:1790773369.023140:0:17110:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790773369.023193:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790773369.023237:0:17110:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d25074aa00/0xabf1cc0bc7842c67 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7842c6e expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773369.023248:0:17110:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790773369.023275:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d25074aa00/0xabf1cc0bc7842c67 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7842c6e expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773369.023282:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d25074aa00/0xabf1cc0bc7842c67 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7842c6e expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773369.023301:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773369.023303:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773369.023305:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773369.023322:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3607:1877761496125824:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790773369.023383:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773369.023452:0:17107:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496125824 00000100:00100000:3.0:1790773369.023470:0:17107:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496125824 00010000:00010000:3.0:1790773369.023671:0:17107:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d1434ac000/0xabf1cc0bc7842c6e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7842c67 expref: 22 pid: 17115 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773369.023700:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790773369.023708:0:17107:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d280a71c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+22:3607:x1877761496125824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790773369.023719:0:17107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773369.023724:0:17107:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d1434ac000/0xabf1cc0bc7842c6e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7842c67 expref: 22 pid: 17115 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773369.023733:0:17107:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d1434ac000/0xabf1cc0bc7842c6e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc7842c67 expref: 22 pid: 17115 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773369.023748:0:17107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790773369.023789:0:17107:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d280a71c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+22:3607:x1877761496125824:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773369.023795:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790773369.023863:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3607:1877761496125824:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790773369.023896:0:20145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d1434ac000/0xabf1cc0bc7842c6e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc7842c67 expref: 21 pid: 17115 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773369.023906:0:20145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20145:1877761496125312:0@lo:104: 00000100:00100000:3.0:1790773369.023916:0:20145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20145:1877761496125440:0@lo:104: 00010000:00010000:3.0:1790773369.023940:0:20145:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93d26c4a2a00/0xabf1cc0bc7842fcb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773369.025756:0:20149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773369.025776:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d1434ac600/0xabf1cc0bc7842c59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7842c60 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773369.025792:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ac600 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:1.0:1790773369.025797:0:17111:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d1434ac600/0xabf1cc0bc7842c59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc7842c60 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773369.025811:0:17111:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d1434ac600/0xabf1cc0bc7842c59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc7842c60 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790773369.025819:0:17111:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d1434ac600/0xabf1cc0bc7842c59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc7842c60 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790773369.025827:0:17111:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790773369.025889:0:17111:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d1434ac600/0xabf1cc0bc7842c59 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7842c60 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773369.025897:0:17111:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790773369.025927:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d1434ac600/0xabf1cc0bc7842c59 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7842c60 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773369.025936:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d1434ac600/0xabf1cc0bc7842c59 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7842c60 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773369.025959:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773369.025961:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773369.025964:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773369.025971:0:20149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773369.025973:0:20149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773369.026002:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3604:1877761496125952:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790773369.026095:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773369.026262:0:17107:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496125952 00000100:00100000:3.0:1790773369.026271:0:17107:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496125952 00010000:00010000:3.0:1790773369.026304:0:17107:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d1434ac400/0xabf1cc0bc7842c60 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7842c59 expref: 21 pid: 17115 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773369.026336:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790773369.026346:0:17107:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+21:3604:x1877761496125952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790773369.026361:0:17107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773369.026366:0:17107:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d1434ac400/0xabf1cc0bc7842c60 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7842c59 expref: 21 pid: 17115 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773369.026379:0:17107:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d1434ac400/0xabf1cc0bc7842c60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc7842c59 expref: 21 pid: 17115 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773369.026396:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d1434ac400/0xabf1cc0bc7842c60 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc7842c59 expref: 21 pid: 17115 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773369.026430:0:17107:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93d26c4a2a00/0xabf1cc0bc7842fcb lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773369.026439:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d26c4a2a00/0xabf1cc0bc7842fcb lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773369.026468:0:17107:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d26c4a2a00/0xabf1cc0bc7842fcb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773369.026475:0:17107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d26c4a2a00/0xabf1cc0bc7842fcb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773369.026482:0:17107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93d26c4a2a00/0xabf1cc0bc7842fcb lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773369.026499:0:17107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93d26c4a2a00/0xabf1cc0bc7842fcb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773369.026505:0:17107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a2a00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:3.0:1790773369.026510:0:17107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93d26c4a2a00/0xabf1cc0bc7842fcb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773369.026519:0:17107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93d26c4a2a00/0xabf1cc0bc7842fcb lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773369.026539:0:17107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93d26c4a2a00/0xabf1cc0bc7842fcb lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773369.026550:0:17107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790773369.026595:0:17107:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+20:3604:x1877761496125952:12345-0@lo:103:ldlm_bl.0 Request processed in 250us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773369.026609:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790773369.026808:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3604:1877761496125952:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790773369.027235:0:20145:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93d26c4a2a00/0xabf1cc0bc7842fcb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773369.027250:0:20145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93d26c4a2a00/0xabf1cc0bc7842fcb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773369.027257:0:20145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d26c4a2a00/0xabf1cc0bc7842fcb lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773369.038468:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790773369.422973:0:17158:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790773370.062849:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773370.224717:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773370.224805:0:17116:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484515456 00000100:00100000:3.0:1790773370.224815:0:17116:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484515456 00000100:00100000:3.0:1790773370.224874:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 147 00000100:00100000:3.0:1790773370.224885:0:17116:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143066c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+11:14877:x1877761484515456:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790773370.224903:0:17116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773370.224922:0:17116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d26c4a3400/0xabf1cc0bc7842fd2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c063 expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773370.224948:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d26c4a3400/0xabf1cc0bc7842fd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c063 expref: 12 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773370.224960:0:17116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d26c4a3400/0xabf1cc0bc7842fd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c063 expref: 12 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773370.224969:0:17116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26c4a3400, rc 0) 00000100:00100000:3.0:1790773370.225037:0:17116:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143066c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+12:14877:x1877761484515456:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 Request processed in 154us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773370.225054:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 147 00000100:00100000:0.0:1790773370.244434:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773370.244472:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484515584 00000100:00100000:0.0:1790773370.244483:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484515584 00000100:00100000:0.0:1790773370.244532:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 148 00000100:00100000:0.0:1790773370.244541:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d255216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+12:14877:x1877761484515584:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790773370.244688:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d255216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+12:14877:x1877761484515584:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 Request processed in 148us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773370.244709:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 148 00000100:00100000:2.0:1790773370.246624:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773370.246660:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484515712 00000100:00100000:2.0:1790773370.246669:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484515712 00000100:00100000:2.0:1790773370.246713:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 149 00000100:00100000:2.0:1790773370.246722:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d255214850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+12:14877:x1877761484515712:12345-192.168.202.19@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790773370.246843:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d255214850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+12:14877:x1877761484515712:12345-192.168.202.19@tcp:503:ll_cfg_requeue.0 Request processed in 121us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773370.246851:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 149 00000100:00100000:2.0:1790773370.257271:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773370.260763:0:17116:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484515840 00000100:00100000:0.0:1790773370.260778:0:17116:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484515840 00000100:00100000:0.0:1790773370.260875:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 150 00000100:00100000:0.0:1790773370.260885:0:17116:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+12:14877:x1877761484515840:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790773370.260903:0:17116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773370.260919:0:17116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d2532e4e00/0xabf1cc0bc7842fd9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c06a expref: -99 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773370.260968:0:17116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d2532e4e00/0xabf1cc0bc7842fd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c06a expref: 13 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773370.260980:0:17116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d2532e4e00/0xabf1cc0bc7842fd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c06a expref: 13 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773370.260989:0:17116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d2532e4e00, rc 0) 00000100:00100000:0.0:1790773370.261066:0:17116:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+13:14877:x1877761484515840:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 Request processed in 181us (3806us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773370.261074:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 150 00000100:00100000:1.0:1790773370.268133:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773370.268322:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484515968 00000100:00100000:0.0:1790773370.268332:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484515968 00000100:00100000:0.0:1790773370.268389:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 151 00000100:00100000:0.0:1790773370.268400:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+13:14877:x1877761484515968:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790773370.268569:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+13:14877:x1877761484515968:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 Request processed in 154us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773370.268578:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 151 00000100:00100000:3.0:1790773370.272872:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773370.272961:0:17116:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484516096 00000100:00100000:1.0:1790773370.272972:0:17116:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484516096 00000100:00100000:1.0:1790773370.273044:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 152 00000100:00100000:1.0:1790773370.273055:0:17116:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+13:14877:x1877761484516096:12345-192.168.202.19@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790773370.273225:0:17116:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+13:14877:x1877761484516096:12345-192.168.202.19@tcp:503:ll_cfg_requeue.0 Request processed in 172us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773370.273233:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 152 10000000:01000000:0.0:1790773370.385914:0:17120:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790773370.385923:0:17120:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d14316e800 from 13 10000000:01000000:0.0:1790773370.385928:0:17120:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790773370.385976:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d2532e5c00/0xabf1cc0bc7842fe0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773370.385988:0:17120:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d2532e5c00/0xabf1cc0bc7842fe0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773370.386001:0:17120:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d2532e5c00/0xabf1cc0bc7842fe0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773370.386301:0:17120:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14378e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496126080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790773370.386373:0:17120:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773370.386466:0:17120:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26efcc600 going to sleep for 11 seconds 00000100:00100000:2.0:1790773370.390330:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496126080 00000100:00100000:2.0:1790773370.390346:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496126080 00000100:00100000:2.0:1790773370.390407:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1790773370.390424:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+20:17120:x1877761496126080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790773370.390444:0:17117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773370.390462:0:17117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d24166e200/0xabf1cc0bc7842fe7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7842fe0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773370.390490:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d24166e200/0xabf1cc0bc7842fe7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7842fe0 expref: 21 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773370.390503:0:17117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d24166e200/0xabf1cc0bc7842fe7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7842fe0 expref: 21 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773370.390512:0:17117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d24166e200, rc 0) 00000100:00100000:2.0:1790773370.391875:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+21:17120:x1877761496126080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1447us (5495us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773370.391887:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1790773370.396876:0:17120:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14378e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496126080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790773370.396913:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d2532e5c00/0xabf1cc0bc7842fe0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842fe7 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773370.396927:0:17120:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d2532e5c00/0xabf1cc0bc7842fe0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7842fe7 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773370.397033:0:17120:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496126208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790773370.400240:0:17120:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773370.400287:0:17120:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d251cfd480 going to sleep for 11 seconds 00000100:00100000:2.0:1790773370.402106:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496126208 00000100:00100000:2.0:1790773370.402121:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496126208 00000100:00100000:2.0:1790773370.402191:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1790773370.402221:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+21:17120:x1877761496126208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790773370.402380:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+21:17120:x1877761496126208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 179us (2147us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773370.402388:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1790773370.403344:0:17120:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496126208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790773370.403404:0:17120:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445dce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496126336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790773370.403462:0:17120:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773370.404872:0:17120:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d241254540 going to sleep for 11 seconds 00000100:00100000:0.0:1790773370.406883:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496126336 00000100:00100000:0.0:1790773370.406897:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496126336 00000100:00100000:0.0:1790773370.407855:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1790773370.407870:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+21:17120:x1877761496126336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790773370.408058:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+21:17120:x1877761496126336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 191us (4594us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773370.408067:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1790773370.408162:0:17120:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445dce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496126336:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790773370.408841:0:20199:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1790773370.408904:0:17120:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1790773370.408924:0:17120:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790773370.408934:0:17120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d2532e5c00/0xabf1cc0bc7842fe0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842fe7 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773370.408945:0:17120:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d2532e5c00/0xabf1cc0bc7842fe0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842fe7 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773370.408954:0:17120:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790773370.408957:0:17120:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d26be90800 from 13 10000000:01000000:3.0:1790773370.408959:0:17120:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790773370.408994:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2600/0xabf1cc0bc7842fee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773370.409003:0:17120:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2600/0xabf1cc0bc7842fee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773370.409024:0:17120:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2600/0xabf1cc0bc7842fee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773370.409045:0:17120:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496126464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790773370.409094:0:17120:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773370.412093:0:17120:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d251cfd3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790773370.414307:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496126464 00000100:00100000:2.0:1790773370.414362:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496126464 00000100:00100000:2.0:1790773370.414473:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1790773370.414501:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+21:17120:x1877761496126464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790773370.414536:0:17115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773370.414572:0:17115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d24166ec00/0xabf1cc0bc7842ff5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7842fee expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773370.414643:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d24166ec00/0xabf1cc0bc7842ff5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7842fee expref: 22 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773370.414675:0:17115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d24166ec00/0xabf1cc0bc7842ff5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7842fee expref: 22 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773370.414698:0:17115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d24166ec00, rc 0) 00000100:00100000:2.0:1790773370.414873:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+22:17120:x1877761496126464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 390us (5778us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773370.414880:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1790773370.415035:0:17120:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496126464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790773370.415058:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2600/0xabf1cc0bc7842fee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842ff5 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773370.415067:0:17120:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2600/0xabf1cc0bc7842fee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7842ff5 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773370.415142:0:17120:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496126592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790773370.415176:0:17120:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773370.415231:0:17120:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d241254000 going to sleep for 11 seconds 00000100:00100000:2.0:1790773370.415245:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496126592 00000100:00100000:2.0:1790773370.415257:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496126592 00000100:00100000:2.0:1790773370.415279:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1790773370.415285:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+22:17120:x1877761496126592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790773370.415386:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+22:17120:x1877761496126592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773370.415392:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1790773370.415419:0:17120:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496126592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790773370.415465:0:17120:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496126720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790773370.415500:0:17120:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773370.415516:0:17120:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d14312c000 going to sleep for 11 seconds 00000100:00100000:2.0:1790773370.415527:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496126720 00000100:00100000:2.0:1790773370.415530:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496126720 00000100:00100000:2.0:1790773370.415547:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1790773370.415553:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+22:17120:x1877761496126720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790773370.415622:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+22:17120:x1877761496126720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773370.415628:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1790773370.415665:0:17120:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496126720:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1790773370.416495:0:20200:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1790773370.416577:0:17120:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1790773370.416613:0:17120:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790773370.416636:0:17120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2600/0xabf1cc0bc7842fee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842ff5 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773370.416660:0:17120:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2600/0xabf1cc0bc7842fee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842ff5 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790773370.416702:0:17120:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790773370.416721:0:17120:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d27f91f800 from 13 10000000:01000000:2.0:1790773370.416724:0:17120:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790773370.416766:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d24166f400/0xabf1cc0bc7842ffc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773370.416775:0:17120:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d24166f400/0xabf1cc0bc7842ffc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773370.416785:0:17120:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d24166f400/0xabf1cc0bc7842ffc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773370.416802:0:17120:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496126848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790773370.416843:0:17120:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773370.416871:0:17120:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d14312c540 going to sleep for 11 seconds 00000100:00100000:2.0:1790773370.416887:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496126848 00000100:00100000:2.0:1790773370.416892:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496126848 00000100:00100000:2.0:1790773370.416917:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1790773370.416924:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+22:17120:x1877761496126848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790773370.416934:0:17115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773370.416946:0:17115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d24166e400/0xabf1cc0bc7843003 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7842ffc expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773370.416966:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d24166e400/0xabf1cc0bc7843003 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7842ffc expref: 23 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773370.416976:0:17115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d24166e400/0xabf1cc0bc7843003 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7842ffc expref: 23 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773370.416993:0:17115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d24166e400, rc 0) 00000100:00100000:2.0:1790773370.417059:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+23:17120:x1877761496126848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773370.417080:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1790773370.417175:0:17120:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496126848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790773370.417187:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d24166f400/0xabf1cc0bc7842ffc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843003 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773370.417243:0:17120:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d24166f400/0xabf1cc0bc7842ffc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7843003 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773370.417312:0:17120:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496126976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790773370.417352:0:17120:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773370.417370:0:17120:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d14312c540 going to sleep for 11 seconds 00000100:00100000:2.0:1790773370.417380:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496126976 00000100:00100000:2.0:1790773370.417383:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496126976 00000100:00100000:2.0:1790773370.417398:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1790773370.417403:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+23:17120:x1877761496126976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790773370.417478:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+23:17120:x1877761496126976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 74us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773370.417484:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1790773370.417538:0:17120:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496126976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790773370.417563:0:17120:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496127104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790773370.417623:0:17120:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773370.417685:0:17120:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d14312c540 going to sleep for 11 seconds 00000100:00100000:2.0:1790773370.417709:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496127104 00000100:00100000:2.0:1790773370.417713:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496127104 00000100:00100000:2.0:1790773370.417753:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1790773370.417759:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+23:17120:x1877761496127104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790773370.417848:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+23:17120:x1877761496127104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773370.417854:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1790773370.417893:0:17120:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496127104:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790773370.420951:0:20201:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1790773370.424833:0:17120:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1790773370.424870:0:17120:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790773370.424882:0:17120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d24166f400/0xabf1cc0bc7842ffc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843003 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773370.424895:0:17120:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d24166f400/0xabf1cc0bc7842ffc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843003 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790773370.424907:0:17120:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790773370.424910:0:17120:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d14444c000 from 13 10000000:01000000:2.0:1790773370.424913:0:17120:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790773370.424951:0:17120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d24166fe00/0xabf1cc0bc784300a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773370.424959:0:17120:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d24166fe00/0xabf1cc0bc784300a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773370.424972:0:17120:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d24166fe00/0xabf1cc0bc784300a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773370.424995:0:17120:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496127232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790773370.425076:0:17120:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773370.425161:0:17120:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ef8c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790773370.425505:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496127232 00000100:00100000:3.0:1790773370.425514:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496127232 00000100:00100000:2.0:1790773370.425648:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1790773370.425657:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+23:17120:x1877761496127232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790773370.425672:0:17115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773370.425686:0:17115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d24166fc00/0xabf1cc0bc7843011 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc784300a expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773370.425722:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d24166fc00/0xabf1cc0bc7843011 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc784300a expref: 24 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773370.425732:0:17115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d24166fc00/0xabf1cc0bc7843011 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc784300a expref: 24 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773370.425741:0:17115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d24166fc00, rc 0) 00000100:00100000:2.0:1790773370.425864:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+24:17120:x1877761496127232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 207us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773370.425871:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1790773370.425944:0:17120:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496127232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790773370.425961:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d24166fe00/0xabf1cc0bc784300a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843011 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773370.425971:0:17120:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d24166fe00/0xabf1cc0bc784300a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7843011 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773370.426049:0:17120:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496127360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790773370.426078:0:17120:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773370.426546:0:17120:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d251cfdd80 going to sleep for 11 seconds 00000100:00100000:0.0:1790773370.427086:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496127360 00000100:00100000:0.0:1790773370.427094:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496127360 00000100:00100000:0.0:1790773370.427131:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1790773370.427139:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+24:17120:x1877761496127360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790773370.427318:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+24:17120:x1877761496127360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 170us (1228us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773370.427325:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1790773370.427410:0:17120:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496127360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790773370.427452:0:17120:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496127488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790773370.427498:0:17120:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773370.427517:0:17120:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d251cfdd80 going to sleep for 11 seconds 00000100:00100000:0.0:1790773370.427610:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496127488 00000100:00100000:0.0:1790773370.427614:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496127488 00000100:00100000:0.0:1790773370.427631:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1790773370.427637:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+24:17120:x1877761496127488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790773370.427725:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+24:17120:x1877761496127488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773370.427732:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1790773370.427913:0:17120:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdd0c180-4c21-4c72-90c1-0147a5902c2f:17120:1877761496127488:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790773370.429414:0:20202:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1790773370.430259:0:17120:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1790773370.430286:0:17120:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790773370.430296:0:17120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d24166fe00/0xabf1cc0bc784300a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843011 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773370.430307:0:17120:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d24166fe00/0xabf1cc0bc784300a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843011 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773370.701533:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790773370.701556:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496127616:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790773370.701623:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773370.701672:0:18631:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496127616 00000100:00100000:2.0:1790773370.701679:0:18631:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496127616 00000100:00100000:2.0:1790773370.701730:0:18631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790773370.701742:0:18631:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496127616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790773370.701771:0:18631:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1790773370.701817:0:18631:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496127616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773370.701833:0:18631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1790773370.701855:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790773370.701893:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496127616:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1790773371.094419:0:20149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773371.725561:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496127744:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790773371.725649:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773371.726057:0:17128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496127744 00000100:00100000:1.0:1790773371.726066:0:17128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496127744 00000100:00100000:1.0:1790773371.726174:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790773371.726183:0:17128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496127744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790773371.726238:0:17128:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1790773371.728558:0:17128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496127744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2361us (2893us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773371.728576:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790773371.729059:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496127744:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1790773372.117829:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773372.239481:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496128000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790773372.239590:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773372.239679:0:18631:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496128000 00000100:00100000:2.0:1790773372.239692:0:18631:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496128000 00000100:00100000:2.0:1790773372.239770:0:18631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790773372.239783:0:18631:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496128000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790773372.239827:0:18631:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1790773372.239900:0:18631:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496128000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773372.239909:0:18631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1790773372.239937:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790773372.239999:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496128000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790773372.240027:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790773372.240037:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496127872:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790773372.240070:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773372.240104:0:17127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496127872 00000100:00100000:2.0:1790773372.240108:0:17127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496127872 00000100:00100000:2.0:1790773372.240137:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790773372.240144:0:17127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496127872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790773372.240174:0:17127:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790773372.240263:0:17127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496127872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 119us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773372.240270:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790773372.240300:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496127872:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790773372.240582:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790773372.240602:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496128128:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790773372.240638:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773372.240686:0:18631:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496128128 00000100:00100000:1.0:1790773372.240691:0:18631:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496128128 00000100:00100000:1.0:1790773372.240724:0:18631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790773372.240732:0:18631:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496128128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790773372.240754:0:18631:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1790773372.240789:0:18631:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496128128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773372.240796:0:18631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1790773372.240814:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790773372.240847:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496128128:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790773372.240868:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496128256:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790773372.240893:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773372.240917:0:18631:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496128256 00000100:00100000:1.0:1790773372.240920:0:18631:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496128256 00000100:00100000:1.0:1790773372.240943:0:18631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790773372.240949:0:18631:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496128256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790773372.240978:0:18631:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1790773372.241027:0:18631:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496128256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773372.241033:0:18631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1790773372.241049:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790773372.241068:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496128256:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790773372.241694:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14378f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3604:1877761496128512:0@lo:400:kworker.0 00000100:00100000:0.0:1790773372.241733:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773372.241755:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14378d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3604:1877761496129024:0@lo:400:kworker.0 00000100:00100000:0.0:1790773372.241791:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773372.241812:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1790773372.241818:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14378f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496128640:0@lo:400:kworker.0 00000100:00100000:0.0:1790773372.241857:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773372.241873:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14378fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3604:1877761496129152:0@lo:400:kworker.0 00000100:00100000:0.0:1790773372.241895:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773372.241923:0:17122:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496128512 00000100:00100000:0.0:1790773372.241928:0:17122:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496128512 00000100:00100000:0.0:1790773372.241960:0:17122:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496129024 00000100:00100000:0.0:1790773372.241963:0:17122:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496129024 00000100:00100000:0.0:1790773372.241984:0:17122:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496129152 00000100:00100000:0.0:1790773372.241986:0:17122:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496129152 00000100:00100000:0.0:1790773372.242019:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790773372.242026:0:17122:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14378c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3604:x1877761496128512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773372.242070:0:17122:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14378c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3604:x1877761496128512:12345-0@lo:400:kworker.0 Request processed in 45us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773372.242077:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790773372.242105:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790773372.242111:0:17122:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14378ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3604:x1877761496129024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773372.242141:0:17122:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14378ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3604:x1877761496129024:12345-0@lo:400:kworker.0 Request processed in 30us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773372.242147:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790773372.242158:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790773372.242164:0:17122:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14378e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3604:x1877761496129152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773372.242190:0:17122:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14378e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3604:x1877761496129152:12345-0@lo:400:kworker.0 Request processed in 27us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773372.242197:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:0.0:1790773372.242265:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790773372.242269:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790773372.242294:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d14378fb80 x1877761496129152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773372.242308:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14378fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3604:1877761496129152:0@lo:400:kworker.0 00000100:00100000:0.0:1790773372.242320:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14378f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3604:1877761496128512:0@lo:400:kworker.0 00000100:00100000:0.0:1790773372.242329:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14378d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3604:1877761496129024:0@lo:400:kworker.0 00000100:00100000:3.0:1790773372.242758:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14378ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3607:1877761496128384:0@lo:400:kworker.0 00000100:00100000:3.0:1790773372.242815:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773372.242869:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14378e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877761496128896:0@lo:400:kworker.0 00000100:00100000:3.0:1790773372.242906:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773372.242927:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14378f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3607:1877761496129408:0@lo:400:kworker.0 00000100:00100000:3.0:1790773372.242947:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773372.242966:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1790773372.242972:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14378ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496128768:0@lo:400:kworker.0 00000100:00100000:3.0:1790773372.243008:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773372.243027:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14378ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3607:1877761496129280:0@lo:400:kworker.0 00000100:00100000:3.0:1790773372.243048:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773372.243069:0:19912:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496128896 00000100:00100000:3.0:1790773372.243073:0:19912:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496128896 00000100:00100000:3.0:1790773372.243098:0:19912:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496129408 00000100:00100000:3.0:1790773372.243101:0:19912:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496129408 00000100:00100000:3.0:1790773372.243121:0:19912:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496129280 00000100:00100000:3.0:1790773372.243123:0:19912:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496129280 00000100:00100000:3.0:1790773372.243137:0:19912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790773372.243143:0:19912:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877761496128896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773372.243185:0:19912:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877761496128896:12345-0@lo:400:kworker.0 Request processed in 41us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773372.243192:0:19912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790773372.243270:0:19912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790773372.243277:0:19912:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1877761496129408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773372.243307:0:19912:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1877761496129408:12345-0@lo:400:kworker.0 Request processed in 32us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773372.243314:0:19912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790773372.243327:0:19912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790773372.243333:0:19912:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1877761496129280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773372.243371:0:19912:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1877761496129280:12345-0@lo:400:kworker.0 Request processed in 39us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773372.243378:0:19912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1790773372.243410:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790773372.243413:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790773372.243439:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14378ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3607:1877761496129280:0@lo:400:kworker.0 00000100:00100000:3.0:1790773372.243450:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14378e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877761496128896:0@lo:400:kworker.0 00010000:00080000:3.0:1790773372.243460:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d14378f100 x1877761496129408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773372.243470:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14378f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3607:1877761496129408:0@lo:400:kworker.0 00000100:00100000:0.0:1790773372.243930:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496128384 00000100:00100000:0.0:1790773372.243937:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496128384 00000100:00100000:0.0:1790773372.243985:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1790773372.244003:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+24:3607:x1877761496128384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773372.244049:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+24:3607:x1877761496128384:12345-0@lo:400:kworker.0 Request processed in 48us (1233us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773372.244055:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1790773372.244979:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14378ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3607:1877761496128384:0@lo:400:kworker.0 00000100:00100000:2.0:1790773372.245177:0:19515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496128768 00000100:00100000:2.0:1790773372.245183:0:19515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496128768 00000100:00100000:2.0:1790773372.245296:0:19515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790773372.245306:0:19515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496128768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773372.245384:0:19515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496128768:12345-0@lo:400:kworker.0 Request processed in 79us (2374us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773372.245392:0:19515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790773372.245424:0:17127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496128640 00000100:00100000:2.0:1790773372.245429:0:17127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496128640 00000100:00100000:2.0:1790773372.245461:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790773372.245469:0:17127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14378df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496128640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773372.245513:0:17127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14378df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496128640:12345-0@lo:400:kworker.0 Request processed in 45us (3655us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773372.245520:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790773372.245674:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14378ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496128768:0@lo:400:kworker.0 00000100:00080000:3.0:1790773372.245959:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790773372.246052:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14378f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496128640:0@lo:400:kworker.0 00000100:00100000:0.0:1790773372.487113:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773372.487279:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773372.487307:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773372.487472:0:19912:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484516480 00000100:00100000:3.0:1790773372.487486:0:19912:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484516480 00000100:00100000:3.0:1790773372.487568:0:19912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 56 00000100:00100000:3.0:1790773372.487579:0:19912:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14378f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:332c789e-f22c-433e-a652-7f15822046a7+5:2398:x1877761484516480:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1790773372.487688:0:19912:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14378f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:332c789e-f22c-433e-a652-7f15822046a7+5:2398:x1877761484516480:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 110us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773372.487697:0:19912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 56 00000100:00080000:3.0:1790773372.487810:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790773372.487965:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773372.488010:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773372.488035:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773372.488059:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773372.488080:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773372.488100:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773372.488122:0:18629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484516736 00000100:00100000:0.0:1790773372.488126:0:18629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484516736 00000100:00100000:0.0:1790773372.488160:0:18629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484517248 00000100:00100000:0.0:1790773372.488163:0:18629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484517248 00000100:00100000:0.0:1790773372.488178:0:18629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484516608 00000100:00100000:0.0:1790773372.488180:0:18629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484516608 00000100:00100000:0.0:1790773372.488193:0:18629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484517120 00000100:00100000:0.0:1790773372.488196:0:18629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484517120 00000100:00100000:0.0:1790773372.488237:0:18629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 14 00000100:00100000:0.0:1790773372.488245:0:18629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14378d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:332c789e-f22c-433e-a652-7f15822046a7+5:2398:x1877761484516736:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1790773372.488284:0:18629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14378d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:332c789e-f22c-433e-a652-7f15822046a7+5:2398:x1877761484516736:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 40us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773372.488290:0:18629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 14 00000100:00100000:0.0:1790773372.488305:0:18629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 15 00000100:00100000:0.0:1790773372.488311:0:18629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14378fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+5:2398:x1877761484517248:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1790773372.488510:0:17123:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484516992 00000100:00100000:3.0:1790773372.488515:0:17123:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484516992 00000100:00100000:3.0:1790773372.488541:0:17123:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484516352 00000100:00100000:3.0:1790773372.488543:0:17123:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484516352 00000100:00100000:3.0:1790773372.488557:0:17123:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484516864 00000100:00100000:3.0:1790773372.488576:0:17123:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484516864 00000100:00100000:3.0:1790773372.488595:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 57 00000100:00100000:3.0:1790773372.488601:0:17123:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14378f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+5:2398:x1877761484516992:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1790773372.488716:0:17123:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14378f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+5:2398:x1877761484516992:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 33us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773372.488724:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 57 00000100:00100000:3.0:1790773372.488738:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 58 00000100:00100000:3.0:1790773372.488744:0:17123:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14378ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:332c789e-f22c-433e-a652-7f15822046a7+6:2398:x1877761484516352:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1790773372.488772:0:17123:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14378ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:332c789e-f22c-433e-a652-7f15822046a7+6:2398:x1877761484516352:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 28us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773372.488778:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 58 00000100:00100000:3.0:1790773372.488790:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 59 00000100:00100000:3.0:1790773372.488795:0:17123:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14378f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+6:2398:x1877761484516864:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1790773372.488819:0:17123:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14378f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+6:2398:x1877761484516864:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 23us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773372.488825:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 59 00000100:00080000:3.0:1790773372.489055:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790773372.489060:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790773372.489062:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790773372.489065:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790773372.489358:0:18630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:2.0:1790773372.489370:0:18630:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14378ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:332c789e-f22c-433e-a652-7f15822046a7+5:2398:x1877761484516608:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1790773372.489413:0:18630:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14378ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:332c789e-f22c-433e-a652-7f15822046a7+5:2398:x1877761484516608:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 47us (1353us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773372.489420:0:18630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:2.0:1790773372.489435:0:18630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:2.0:1790773372.489442:0:18630:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14378e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+5:2398:x1877761484517120:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1790773372.489479:0:18630:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14378e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+5:2398:x1877761484517120:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 37us (1377us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773372.489485:0:18630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:0.0:1790773372.489791:0:18629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14378fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+5:2398:x1877761484517248:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 1479us (1780us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773372.489798:0:18629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 15 00000100:00100000:1.0:1790773372.491583:0:17116:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484516224 00000100:00100000:1.0:1790773372.491615:0:17116:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484516224 00000100:00100000:1.0:1790773372.491946:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 166 00000100:00100000:1.0:1790773372.491959:0:17116:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+13:2398:x1877761484516224:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773372.492639:0:17116:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+13:2398:x1877761484516224:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 677us (5537us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773372.492651:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 166 00000100:00100000:2.0:1790773372.669087:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773372.669188:0:17123:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484517376 00000100:00100000:3.0:1790773372.669202:0:17123:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484517376 00000100:00100000:2.0:1790773372.669575:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 23 00000100:00100000:2.0:1790773372.669589:0:17123:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:332c789e-f22c-433e-a652-7f15822046a7+6:15544:x1877761484517376:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790773372.669620:0:17123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773372.669652:0:17123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e600/0xabf1cc0bc7843018 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c071 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.669759:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fa00/0xabf1cc0bc784301f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.669776:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fa00/0xabf1cc0bc784301f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.669792:0:17123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fa00/0xabf1cc0bc784301f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.671823:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166ee00/0xabf1cc0bc7843026 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.671851:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166ee00/0xabf1cc0bc7843026 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.671867:0:17123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166ee00/0xabf1cc0bc7843026 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.671970:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527000/0xabf1cc0bc784302d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.672004:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527000/0xabf1cc0bc784302d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.672013:0:17123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527000/0xabf1cc0bc784302d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790773372.672052:0:17123:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790773372.672056:0:17123:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790773372.672097:0:17123:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527000/0xabf1cc0bc784302d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.672109:0:17123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fa00/0xabf1cc0bc784301f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.672116:0:17123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fa00/0xabf1cc0bc784301f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.672122:0:17123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fa00/0xabf1cc0bc784301f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.672127:0:17123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d24166fa00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:2.0:1790773372.672131:0:17123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fa00/0xabf1cc0bc784301f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.672138:0:17123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fa00/0xabf1cc0bc784301f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.672151:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d26ff64700) 00010000:00010000:2.0:1790773372.672154:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790773372.672159:0:17123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fa00/0xabf1cc0bc784301f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.672174:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fa00/0xabf1cc0bc784301f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.672889:0:17123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166ee00/0xabf1cc0bc7843026 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.672902:0:17123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166ee00/0xabf1cc0bc7843026 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.672909:0:17123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166ee00/0xabf1cc0bc7843026 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.672914:0:17123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d24166ee00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:2.0:1790773372.672918:0:17123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166ee00/0xabf1cc0bc7843026 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.672925:0:17123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166ee00/0xabf1cc0bc7843026 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.672936:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff93d26ff73500) 00010000:00010000:2.0:1790773372.672938:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790773372.672941:0:17123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166ee00/0xabf1cc0bc7843026 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.672947:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166ee00/0xabf1cc0bc7843026 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.673015:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e600/0xabf1cc0bc7843018 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c071 expref: 8 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.673051:0:17123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527000/0xabf1cc0bc784302d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c071 expref: 7 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.673059:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93d26ff73900) 00010000:00010000:2.0:1790773372.673061:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790773372.673064:0:17123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d241527000, rc 0) 00000100:00100000:2.0:1790773372.673147:0:17123:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:332c789e-f22c-433e-a652-7f15822046a7+7:15544:x1877761484517376:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 3561us (4074us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773372.673156:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 23 00000100:00100000:3.0:1790773372.682465:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773372.682556:0:17133:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484517504 00000100:00100000:2.0:1790773372.682573:0:17133:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484517504 00000100:00100000:2.0:1790773372.682649:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00100000:2.0:1790773372.682660:0:17133:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:332c789e-f22c-433e-a652-7f15822046a7+7:15544:x1877761484517504:12345-192.168.202.19@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1790773372.682763:0:17133:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:332c789e-f22c-433e-a652-7f15822046a7+7:15544:x1877761484517504:12345-192.168.202.19@tcp:900:lhsmtool_posix.0 Request processed in 105us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773372.682770:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00100000:0.0:1790773372.698539:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773372.698967:0:19912:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484517760 00000100:00100000:3.0:1790773372.698978:0:19912:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484517760 00000100:00100000:3.0:1790773372.699054:0:19912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 24 00000100:00100000:3.0:1790773372.699065:0:19912:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14378ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:332c789e-f22c-433e-a652-7f15822046a7+7:15544:x1877761484517760:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790773372.699105:0:19912:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773372.699127:0:19912:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2400/0xabf1cc0bc7843034 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c078 expref: -99 pid: 19912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.699249:0:19912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3a00/0xabf1cc0bc784303b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.699265:0:19912:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3a00/0xabf1cc0bc784303b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.699277:0:19912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3a00/0xabf1cc0bc784303b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.699327:0:19912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2c00/0xabf1cc0bc7843042 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.699333:0:19912:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2c00/0xabf1cc0bc7843042 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.699337:0:19912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2c00/0xabf1cc0bc7843042 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.699435:0:19912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2a00/0xabf1cc0bc7843049 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.699441:0:19912:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2a00/0xabf1cc0bc7843049 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.699446:0:19912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2a00/0xabf1cc0bc7843049 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790773372.699453:0:19912:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1790773372.699582:0:19912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3a00/0xabf1cc0bc784303b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.699590:0:19912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3a00/0xabf1cc0bc784303b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.699597:0:19912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3a00/0xabf1cc0bc784303b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.699603:0:19912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a3a00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773372.699607:0:19912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3a00/0xabf1cc0bc784303b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.699612:0:19912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3a00/0xabf1cc0bc784303b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.699620:0:19912:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93d26ff73900) 00010000:00010000:3.0:1790773372.699622:0:19912:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790773372.699625:0:19912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3a00/0xabf1cc0bc784303b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.699629:0:19912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3a00/0xabf1cc0bc784303b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.699638:0:19912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2c00/0xabf1cc0bc7843042 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.699641:0:19912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2c00/0xabf1cc0bc7843042 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.699645:0:19912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2c00/0xabf1cc0bc7843042 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.699655:0:19912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a2c00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773372.699657:0:19912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2c00/0xabf1cc0bc7843042 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.699660:0:19912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2c00/0xabf1cc0bc7843042 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.699664:0:19912:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff93d26ff64100) 00010000:00010000:3.0:1790773372.699665:0:19912:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790773372.699667:0:19912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2c00/0xabf1cc0bc7843042 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.699670:0:19912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2c00/0xabf1cc0bc7843042 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.701874:0:19912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2400/0xabf1cc0bc7843034 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c078 expref: 10 pid: 19912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.701897:0:19912:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2a00/0xabf1cc0bc7843049 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c078 expref: 9 pid: 19912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.701906:0:19912:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93d26ff64e00) 00010000:00010000:3.0:1790773372.701909:0:19912:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790773372.701912:0:19912:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26c4a2a00, rc 0) 00000100:00100000:3.0:1790773372.702046:0:19912:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14378ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:332c789e-f22c-433e-a652-7f15822046a7+9:15544:x1877761484517760:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 2982us (3516us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1790773372.702056:0:19912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 24 00000100:00100000:0.0:1790773372.717335:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773372.717437:0:17122:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484517888 00000100:00100000:3.0:1790773372.717459:0:17122:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484517888 00000100:00100000:3.0:1790773372.717520:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 25 00000100:00100000:3.0:1790773372.717530:0:17122:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f974000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:332c789e-f22c-433e-a652-7f15822046a7+9:15544:x1877761484517888:12345-192.168.202.19@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1790773372.717637:0:17122:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f974000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:332c789e-f22c-433e-a652-7f15822046a7+9:15544:x1877761484517888:12345-192.168.202.19@tcp:59:lhsmtool_posix.0 Request processed in 109us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773372.717645:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 25 00000100:00100000:0.0:1790773372.719729:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773372.719818:0:17124:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484518016 00000100:00100000:2.0:1790773372.719828:0:17124:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484518016 00000100:00100000:2.0:1790773372.719893:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 26 00000100:00100000:2.0:1790773372.719903:0:17124:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:332c789e-f22c-433e-a652-7f15822046a7+5:15544:x1877761484518016:12345-192.168.202.19@tcp:59:lhsmtool_posix.0 00000004:00080000:2.0:1790773372.724131:0:17124:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 4184us 00000100:00100000:0.0:1790773372.731267:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773372.731867:0:17122:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484518144 00000100:00100000:3.0:1790773372.731879:0:17122:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484518144 00000100:00100000:3.0:1790773372.731981:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 27 00000100:00100000:3.0:1790773372.732004:0:17122:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f976d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:332c789e-f22c-433e-a652-7f15822046a7+9:15550:x1877761484518144:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:3.0:1790773372.732026:0:17122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773372.732649:0:17122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2400/0xabf1cc0bc7843057 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c07f expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.732728:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2c00/0xabf1cc0bc784305e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.732743:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2c00/0xabf1cc0bc784305e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.732754:0:17122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2c00/0xabf1cc0bc784305e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.732769:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3a00/0xabf1cc0bc7843065 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.732776:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3a00/0xabf1cc0bc7843065 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.732783:0:17122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3a00/0xabf1cc0bc7843065 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.732841:0:17122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2c00/0xabf1cc0bc784305e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.732849:0:17122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2c00/0xabf1cc0bc784305e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.732855:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2c00/0xabf1cc0bc784305e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.732861:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a2c00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773372.732865:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2c00/0xabf1cc0bc784305e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.732873:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2c00/0xabf1cc0bc784305e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.732886:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d26ff64700) 00010000:00010000:3.0:1790773372.732889:0:17122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790773372.732893:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2c00/0xabf1cc0bc784305e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.732899:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2c00/0xabf1cc0bc784305e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.732911:0:17122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3a00/0xabf1cc0bc7843065 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.732916:0:17122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3a00/0xabf1cc0bc7843065 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.732921:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3a00/0xabf1cc0bc7843065 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.732932:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a3a00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773372.732935:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3a00/0xabf1cc0bc7843065 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.732940:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3a00/0xabf1cc0bc7843065 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.732947:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93d26ff64100) 00010000:00010000:3.0:1790773372.732949:0:17122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790773372.732951:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3a00/0xabf1cc0bc7843065 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.732957:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3a00/0xabf1cc0bc7843065 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.732999:0:17122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2400/0xabf1cc0bc7843057 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c07f expref: 10 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.733009:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d26ff64700) 00010000:00010000:3.0:1790773372.733011:0:17122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790773372.733014:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2400/0xabf1cc0bc7843057 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c07f expref: 10 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.733022:0:17122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26c4a2400, rc 0) 00000100:00100000:3.0:1790773372.733104:0:17122:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f976d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:332c789e-f22c-433e-a652-7f15822046a7+9:15550:x1877761484518144:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 1102us (1846us total) trans 0 rc 301/301 00000100:00100000:3.0:1790773372.733111:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 27 00000100:00100000:3.0:1790773372.737371:0:17124:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:332c789e-f22c-433e-a652-7f15822046a7+5:15544:x1877761484518016:12345-192.168.202.19@tcp:59:lhsmtool_posix.0 Request processed in 17458us (17641us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773372.737392:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 26 00000100:00100000:0.0:1790773372.740011:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773372.741575:0:17131:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484518272 00000100:00100000:3.0:1790773372.741587:0:17131:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484518272 00000100:00100000:3.0:1790773372.741645:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:3.0:1790773372.741656:0:17131:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:332c789e-f22c-433e-a652-7f15822046a7+9:15550:x1877761484518272:12345-192.168.202.19@tcp:700:lfs.0 00000100:00100000:3.0:1790773372.741759:0:17131:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:332c789e-f22c-433e-a652-7f15822046a7+9:15550:x1877761484518272:12345-192.168.202.19@tcp:700:lfs.0 Request processed in 105us (1759us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773372.741767:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:3.0:1790773372.743522:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773372.743585:0:19912:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484518528 00000100:00100000:0.0:1790773372.743595:0:19912:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484518528 00000100:00100000:0.0:1790773372.743643:0:19912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 28 00000100:00100000:0.0:1790773372.743651:0:19912:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:332c789e-f22c-433e-a652-7f15822046a7+9:15550:x1877761484518528:12345-192.168.202.19@tcp:36:lfs.0 00010000:00010000:0.0:1790773372.743712:0:19912:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773372.743737:0:19912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d25074ba00/0xabf1cc0bc7842f85 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bfec expref: 9 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773372.743753:0:19912:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d26ff64700) 00010000:00010000:0.0:1790773372.743759:0:19912:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790773372.743819:0:19912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5600/0xabf1cc0bc784306c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773372.743832:0:19912:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2800/0xabf1cc0bc7842fc4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c05c expref: 5 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773372.743842:0:19912:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5600/0xabf1cc0bc784306c lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773372.743874:0:19912:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2800/0xabf1cc0bc7842fc4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c05c expref: 5 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773372.743889:0:19912:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2800/0xabf1cc0bc7842fc4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c05c expref: 5 pid: 17123 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773372.743923:0:19912:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f977800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19912:1877761496129536:192.168.202.19@tcp:104: 00000100:00100000:0.0:1790773372.744013:0:19912:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26c741180 going to sleep for 11 seconds 00000100:00100000:0.0:1790773372.748534:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773372.748656:0:19912:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f977800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19912:1877761496129536:192.168.202.19@tcp:104: 00010000:00010000:3.0:1790773372.748690:0:19912:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5600/0xabf1cc0bc784306c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773372.748825:0:17109:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484518656 00000100:00100000:1.0:1790773372.748833:0:17109:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484518656 00010000:00010000:1.0:1790773372.748870:0:17109:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2800/0xabf1cc0bc7842fc4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c05c expref: 6 pid: 17123 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773372.748915:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 15 00000100:00100000:1.0:1790773372.748925:0:17109:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f975f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+6:2397:x1877761484518656:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790773372.748942:0:17109:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790773372.748948:0:17109:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2800/0xabf1cc0bc7842fc4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c05c expref: 6 pid: 17123 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773372.748960:0:17109:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2800/0xabf1cc0bc7842fc4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c05c expref: 6 pid: 17123 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773372.748992:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2800/0xabf1cc0bc7842fc4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c05c expref: 6 pid: 17123 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773372.749008:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d26ff64700) 00010000:00010000:1.0:1790773372.749013:0:17109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5600/0xabf1cc0bc784306c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773372.749022:0:17109:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5600/0xabf1cc0bc784306c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773372.749043:0:17109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5600/0xabf1cc0bc784306c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773372.749069:0:17109:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790773372.749115:0:17109:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f975f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+5:2397:x1877761484518656:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 192us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773372.749122:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 15 00010000:00010000:0.0:1790773372.749316:0:19912:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5600/0xabf1cc0bc784306c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773372.749325:0:19912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5600/0xabf1cc0bc784306c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773372.749347:0:19912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5000/0xabf1cc0bc7843073 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773372.749357:0:19912:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5000/0xabf1cc0bc7843073 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773372.749365:0:19912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5000/0xabf1cc0bc7843073 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.751190:0:19912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2400/0xabf1cc0bc784307a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.751233:0:19912:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2400/0xabf1cc0bc784307a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.751245:0:19912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2400/0xabf1cc0bc784307a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790773372.751304:0:19912:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008901b1de reply state 000000006668f99c transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2400/0xabf1cc0bc784307a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773372.751331:0:19912:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2400/0xabf1cc0bc784307a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773372.751340:0:19912:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93d26ff64100) 00010000:00010000:0.0:1790773372.751343:0:19912:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790773372.751348:0:19912:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1790773372.751354:0:19912:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1790773372.751363:0:19912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5600/0xabf1cc0bc784306c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773372.751378:0:19912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5600/0xabf1cc0bc784306c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773372.751385:0:19912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5600/0xabf1cc0bc784306c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773372.751391:0:19912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d2532e5600 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773372.751396:0:19912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5600/0xabf1cc0bc784306c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773372.751404:0:19912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5600/0xabf1cc0bc784306c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773372.751413:0:19912:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d26ff64700) 00010000:00010000:0.0:1790773372.751415:0:19912:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773372.751418:0:19912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5600/0xabf1cc0bc784306c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773372.751424:0:19912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5600/0xabf1cc0bc784306c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790773372.751444:0:19912:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008901b1de reply state 000000006668f99c transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5000/0xabf1cc0bc7843073 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773372.751453:0:19912:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5000/0xabf1cc0bc7843073 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773372.751459:0:19912:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93d254e30700) 00010000:00010000:0.0:1790773372.751461:0:19912:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790773372.751463:0:19912:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1790773372.751549:0:19912:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:332c789e-f22c-433e-a652-7f15822046a7+10:15550:x1877761484518528:12345-192.168.202.19@tcp:36:lfs.0 Request processed in 7893us (8029us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1790773372.751564:0:19912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 28 00000100:00100000:2.0:1790773372.832183:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773372.832238:0:17122:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484518784 00000100:00100000:3.0:1790773372.832250:0:17122:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484518784 00000100:00100000:3.0:1790773372.832307:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 29 00000100:00100000:3.0:1790773372.832315:0:17122:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:332c789e-f22c-433e-a652-7f15822046a7+10:15558:x1877761484518784:12345-192.168.202.19@tcp:101:lctl.0 00010000:00010000:3.0:1790773372.832392:0:17122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773372.833537:0:17122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527800/0xabf1cc0bc7843081 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c086 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.833814:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526a00/0xabf1cc0bc7843088 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.833893:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526a00/0xabf1cc0bc7843088 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.833963:0:17122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526a00/0xabf1cc0bc7843088 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790773372.834022:0:17122:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790773372.834027:0:17122:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790773372.834068:0:17122:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526a00/0xabf1cc0bc7843088 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.834169:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527800/0xabf1cc0bc7843081 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c086 expref: 12 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.834191:0:17122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526a00/0xabf1cc0bc7843088 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c086 expref: 11 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.834201:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d26ff73500) 00010000:00010000:2.0:1790773372.834382:0:17122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790773372.834387:0:17122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d241526a00, rc 0) 00000100:00100000:2.0:1790773372.834467:0:17122:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:332c789e-f22c-433e-a652-7f15822046a7+11:15558:x1877761484518784:12345-192.168.202.19@tcp:101:lctl.0 Request processed in 2151us (2294us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773372.834478:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 29 00000100:00100000:2.0:1790773372.861906:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773372.864645:0:17123:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484518912 00000100:00100000:0.0:1790773372.864661:0:17123:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484518912 00000100:00100000:0.0:1790773372.865343:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 30 00000100:00100000:0.0:1790773372.865355:0:17123:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+5:15559:x1877761484518912:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:0.0:1790773372.865377:0:17123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773372.865397:0:17123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5600/0xabf1cc0bc784308f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c08d expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773372.865462:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4000/0xabf1cc0bc7843096 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773372.865476:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4000/0xabf1cc0bc7843096 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773372.865486:0:17123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4000/0xabf1cc0bc7843096 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790773372.865530:0:17123:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1790773372.865533:0:17123:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790773372.865550:0:17123:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4000/0xabf1cc0bc7843096 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773372.865570:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5600/0xabf1cc0bc784308f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c08d expref: 7 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773372.865588:0:17123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4000/0xabf1cc0bc7843096 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c08d expref: 6 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773372.865614:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d26ff73500) 00010000:00010000:0.0:1790773372.865617:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790773372.865620:0:17123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d2532e4000, rc 0) 00000100:00100000:0.0:1790773372.865697:0:17123:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+6:15559:x1877761484518912:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 344us (3802us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773372.865704:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 30 00000100:00100000:3.0:1790773372.871519:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773372.871779:0:17124:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484519040 00000100:00100000:2.0:1790773372.871803:0:17124:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484519040 00000100:00100000:2.0:1790773372.871865:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 31 00000100:00100000:2.0:1790773372.871875:0:17124:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+6:15559:x1877761484519040:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1790773372.871895:0:17124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773372.871915:0:17124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527800/0xabf1cc0bc784309d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c094 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.871980:0:17124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527400/0xabf1cc0bc78430a4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.872029:0:17124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527400/0xabf1cc0bc78430a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.872041:0:17124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527400/0xabf1cc0bc78430a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.872053:0:17124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527c00/0xabf1cc0bc78430ab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.872060:0:17124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527c00/0xabf1cc0bc78430ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.872066:0:17124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527c00/0xabf1cc0bc78430ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.872144:0:17124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527e00/0xabf1cc0bc78430b2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.872152:0:17124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527e00/0xabf1cc0bc78430b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.872159:0:17124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527e00/0xabf1cc0bc78430b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790773372.872538:0:17124:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790773372.872543:0:17124:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790773372.872567:0:17124:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527e00/0xabf1cc0bc78430b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.872581:0:17124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527400/0xabf1cc0bc78430a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.872587:0:17124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527400/0xabf1cc0bc78430a4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.872593:0:17124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527400/0xabf1cc0bc78430a4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.872599:0:17124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d241527400 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:2.0:1790773372.872602:0:17124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527400/0xabf1cc0bc78430a4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.872609:0:17124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527400/0xabf1cc0bc78430a4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.872622:0:17124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d26ff73500) 00010000:00010000:2.0:1790773372.872625:0:17124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790773372.872629:0:17124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527400/0xabf1cc0bc78430a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.872635:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527400/0xabf1cc0bc78430a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.872647:0:17124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527c00/0xabf1cc0bc78430ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.872663:0:17124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527c00/0xabf1cc0bc78430ab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.872669:0:17124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527c00/0xabf1cc0bc78430ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.872674:0:17124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d241527c00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:2.0:1790773372.872677:0:17124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527c00/0xabf1cc0bc78430ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.872683:0:17124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527c00/0xabf1cc0bc78430ab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.872692:0:17124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93d254e30700) 00010000:00010000:2.0:1790773372.872694:0:17124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790773372.872697:0:17124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527c00/0xabf1cc0bc78430ab lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.872702:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527c00/0xabf1cc0bc78430ab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.872731:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527800/0xabf1cc0bc784309d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c094 expref: 8 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.872743:0:17124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527e00/0xabf1cc0bc78430b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c094 expref: 7 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.872750:0:17124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93d26ff64100) 00010000:00010000:2.0:1790773372.872752:0:17124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790773372.872760:0:17124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d241527e00, rc 0) 00000100:00100000:2.0:1790773372.872875:0:17124:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+7:15559:x1877761484519040:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 1000us (1364us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773372.872883:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 31 00000040:00080000:2.0:1790773372.878008:0:17873:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790773372.879031:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773372.879102:0:17133:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484519168 00000100:00100000:2.0:1790773372.879112:0:17133:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484519168 00000100:00100000:2.0:1790773372.879166:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:2.0:1790773372.879186:0:17133:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+5:15559:x1877761484519168:12345-192.168.202.19@tcp:900:lfs.0 00000100:00100000:2.0:1790773372.879294:0:17133:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+5:15559:x1877761484519168:12345-192.168.202.19@tcp:900:lfs.0 Request processed in 118us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773372.879302:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:1.0:1790773372.886902:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773372.887069:0:19912:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484519424 00000100:00100000:2.0:1790773372.887080:0:19912:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484519424 00000100:00100000:2.0:1790773372.887149:0:19912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 32 00000100:00100000:2.0:1790773372.887160:0:19912:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+7:15559:x1877761484519424:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1790773372.887183:0:19912:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773372.887240:0:19912:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527800/0xabf1cc0bc78430b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c09b expref: -99 pid: 19912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790773372.887350:0:19912:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1790773372.887455:0:19912:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527800/0xabf1cc0bc78430b9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c09b expref: 9 pid: 19912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.887470:0:19912:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d26ff73500) 00010000:00010000:2.0:1790773372.887474:0:19912:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790773372.887479:0:19912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527800/0xabf1cc0bc78430b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c09b expref: 9 pid: 19912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.887509:0:19912:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d241527800, rc 0) 00000100:00100000:2.0:1790773372.887560:0:19912:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+8:15559:x1877761484519424:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 402us (668us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1790773372.887567:0:19912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 32 00000100:00100000:1.0:1790773372.890558:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773372.890646:0:17122:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484519680 00000100:00100000:3.0:1790773372.890658:0:17122:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484519680 00000100:00100000:3.0:1790773372.890713:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 33 00000100:00100000:3.0:1790773372.890723:0:17122:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+8:15559:x1877761484519680:12345-192.168.202.19@tcp:36:lfs.0 00010000:00010000:3.0:1790773372.890779:0:17122:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773372.890804:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527e00/0xabf1cc0bc78430b2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c094 expref: 8 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.890823:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93d26ff64100) 00010000:00010000:3.0:1790773372.890827:0:17122:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790773372.890846:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3a00/0xabf1cc0bc78430c7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.890860:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3a00/0xabf1cc0bc78430c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.890869:0:17122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3a00/0xabf1cc0bc78430c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790773372.891075:0:17122:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000050971e15 reply state 000000009abd6764 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3a00/0xabf1cc0bc78430c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.891088:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3a00/0xabf1cc0bc78430c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.891096:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93d26ff64100) 00010000:00010000:3.0:1790773372.891098:0:17122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1790773372.891101:0:17122:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1790773372.891109:0:17122:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1790773372.891184:0:17122:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+9:15559:x1877761484519680:12345-192.168.202.19@tcp:36:lfs.0 Request processed in 462us (636us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1790773372.891252:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 33 00000100:00100000:1.0:1790773372.903106:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773372.903253:0:17126:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484519936 00000100:00100000:3.0:1790773372.903267:0:17126:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484519936 00000100:00100000:3.0:1790773372.903330:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 2 00000100:00100000:3.0:1790773372.903340:0:17126:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+9:15559:x1877761484519936:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:3.0:1790773372.903595:0:17126:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+10:15559:x1877761484519936:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 255us (497us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1790773372.903604:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 2 00000100:00100000:1.0:1790773372.906767:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773372.908297:0:19912:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484520192 00000100:00100000:2.0:1790773372.908312:0:19912:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484520192 00000100:00100000:2.0:1790773372.908389:0:19912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 34 00000100:00100000:2.0:1790773372.908399:0:19912:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+10:15559:x1877761484520192:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1790773372.908428:0:19912:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773372.908449:0:19912:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527800/0xabf1cc0bc78430ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c0a2 expref: -99 pid: 19912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.908528:0:19912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527c00/0xabf1cc0bc78430d5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.908543:0:19912:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527c00/0xabf1cc0bc78430d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.908554:0:19912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527c00/0xabf1cc0bc78430d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.908565:0:19912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527400/0xabf1cc0bc78430dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.908572:0:19912:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527400/0xabf1cc0bc78430dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.908579:0:19912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527400/0xabf1cc0bc78430dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790773372.908701:0:19912:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1790773372.908781:0:19912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527c00/0xabf1cc0bc78430d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.908789:0:19912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527c00/0xabf1cc0bc78430d5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.908795:0:19912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527c00/0xabf1cc0bc78430d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.908800:0:19912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d241527c00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:2.0:1790773372.908805:0:19912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527c00/0xabf1cc0bc78430d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.908812:0:19912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527c00/0xabf1cc0bc78430d5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.908825:0:19912:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d26ff73500) 00010000:00010000:2.0:1790773372.908828:0:19912:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790773372.908833:0:19912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527c00/0xabf1cc0bc78430d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.908840:0:19912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527c00/0xabf1cc0bc78430d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.908852:0:19912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527400/0xabf1cc0bc78430dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.908858:0:19912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527400/0xabf1cc0bc78430dc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.908875:0:19912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527400/0xabf1cc0bc78430dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.908880:0:19912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d241527400 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:2.0:1790773372.908883:0:19912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527400/0xabf1cc0bc78430dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.908889:0:19912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527400/0xabf1cc0bc78430dc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.908897:0:19912:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93d254e30700) 00010000:00010000:2.0:1790773372.908899:0:19912:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790773372.908903:0:19912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527400/0xabf1cc0bc78430dc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.908908:0:19912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527400/0xabf1cc0bc78430dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.908938:0:19912:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527800/0xabf1cc0bc78430ce lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0a2 expref: 12 pid: 19912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.908947:0:19912:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d26ff73500) 00010000:00010000:2.0:1790773372.908950:0:19912:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790773372.908953:0:19912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527800/0xabf1cc0bc78430ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0a2 expref: 12 pid: 19912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773372.908961:0:19912:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d241527800, rc 0) 00000100:00100000:2.0:1790773372.909053:0:19912:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+11:15559:x1877761484520192:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 655us (2294us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1790773372.909070:0:19912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 34 00000100:00100000:1.0:1790773372.912271:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773372.912402:0:17122:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484520320 00000100:00100000:3.0:1790773372.912412:0:17122:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484520320 00000100:00100000:3.0:1790773372.912469:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 35 00000100:00100000:3.0:1790773372.912480:0:17122:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+11:15559:x1877761484520320:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:3.0:1790773372.912506:0:17122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773372.912528:0:17122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2c00/0xabf1cc0bc78430ea lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c0a9 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.912619:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3600/0xabf1cc0bc78430f1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.912635:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3600/0xabf1cc0bc78430f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.912646:0:17122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3600/0xabf1cc0bc78430f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790773372.912672:0:17122:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1790773372.912675:0:17122:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790773372.912724:0:17122:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3600/0xabf1cc0bc78430f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.912750:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2c00/0xabf1cc0bc78430ea lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0a9 expref: 13 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.912768:0:17122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3600/0xabf1cc0bc78430f1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0a9 expref: 12 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773372.912777:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93d26ff64100) 00010000:00010000:3.0:1790773372.912780:0:17122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790773372.912785:0:17122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26c4a3600, rc 0) 00000100:00100000:3.0:1790773372.912853:0:17122:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+12:15559:x1877761484520320:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 375us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773372.912860:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 35 00000100:00100000:1.0:1790773372.916841:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773372.917597:0:17126:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484520448 00000100:00100000:3.0:1790773372.917610:0:17126:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484520448 00000100:00100000:3.0:1790773372.917668:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 3 00000100:00100000:3.0:1790773372.917734:0:17126:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+12:15559:x1877761484520448:12345-192.168.202.19@tcp:37:lfs.0 00000100:00100000:3.0:1790773372.923310:0:17126:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+12:15559:x1877761484520448:12345-192.168.202.19@tcp:37:lfs.0 Request processed in 5566us (6464us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773372.923326:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 3 00000100:00100000:1.0:1790773372.926353:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773372.926405:0:17125:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484520704 00000100:00100000:0.0:1790773372.926864:0:17125:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484520704 00000100:00100000:0.0:1790773372.926976:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00100000:0.0:1790773372.927002:0:17125:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9fbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+12:15559:x1877761484520704:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:0.0:1790773372.927278:0:17125:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9fbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+13:15559:x1877761484520704:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 278us (936us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1790773372.927285:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00100000:1.0:1790773372.993182:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773372.993327:0:17123:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484520832 00000100:00100000:0.0:1790773372.993339:0:17123:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484520832 00000100:00100000:0.0:1790773372.993523:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 36 00000100:00100000:0.0:1790773372.993538:0:17123:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:332c789e-f22c-433e-a652-7f15822046a7+11:15565:x1877761484520832:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:0.0:1790773372.993635:0:17123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773372.993663:0:17123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5600/0xabf1cc0bc78430f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c0b0 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773372.993955:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5400/0xabf1cc0bc78430ff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773372.993972:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5400/0xabf1cc0bc78430ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773372.994003:0:17123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5400/0xabf1cc0bc78430ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773372.994017:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4a00/0xabf1cc0bc7843106 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773372.994024:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4a00/0xabf1cc0bc7843106 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773372.994031:0:17123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4a00/0xabf1cc0bc7843106 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773372.994115:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4800/0xabf1cc0bc784310d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773372.994125:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4800/0xabf1cc0bc784310d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773372.994132:0:17123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4800/0xabf1cc0bc784310d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790773372.994167:0:17123:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1790773372.994170:0:17123:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790773372.995143:0:17123:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4800/0xabf1cc0bc784310d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773372.995161:0:17123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5400/0xabf1cc0bc78430ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773372.995169:0:17123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5400/0xabf1cc0bc78430ff lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773372.995189:0:17123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5400/0xabf1cc0bc78430ff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773372.995196:0:17123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d2532e5400 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773372.995200:0:17123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5400/0xabf1cc0bc78430ff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773372.995227:0:17123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5400/0xabf1cc0bc78430ff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773372.995243:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d26ff73500) 00010000:00010000:0.0:1790773372.995247:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773372.995251:0:17123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5400/0xabf1cc0bc78430ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773372.995258:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5400/0xabf1cc0bc78430ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773372.995273:0:17123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4a00/0xabf1cc0bc7843106 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773372.995279:0:17123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4a00/0xabf1cc0bc7843106 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773372.995285:0:17123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4a00/0xabf1cc0bc7843106 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773372.995290:0:17123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d2532e4a00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773372.995293:0:17123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4a00/0xabf1cc0bc7843106 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773372.995308:0:17123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4a00/0xabf1cc0bc7843106 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773372.995317:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93d254e30700) 00010000:00010000:0.0:1790773372.995319:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773372.995323:0:17123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4a00/0xabf1cc0bc7843106 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773372.995329:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4a00/0xabf1cc0bc7843106 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773372.995372:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5600/0xabf1cc0bc78430f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0b0 expref: 13 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773372.995387:0:17123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4800/0xabf1cc0bc784310d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0b0 expref: 12 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773372.995393:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93d26ff64100) 00010000:00010000:0.0:1790773372.995396:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1790773372.995398:0:17123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d2532e4800, rc 0) 00000100:00100000:1.0:1790773372.995926:0:17123:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:332c789e-f22c-433e-a652-7f15822046a7+12:15565:x1877761484520832:12345-192.168.202.19@tcp:101:bash.0 Request processed in 2388us (2756us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773372.995936:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 36 00000100:00100000:1.0:1790773373.000614:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773373.000714:0:17133:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484520960 00000100:00100000:2.0:1790773373.000724:0:17133:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484520960 00000100:00100000:2.0:1790773373.000781:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:2.0:1790773373.000792:0:17133:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:332c789e-f22c-433e-a652-7f15822046a7+5:15565:x1877761484520960:12345-192.168.202.19@tcp:900:bash.0 00000100:00100000:2.0:1790773373.000881:0:17133:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:332c789e-f22c-433e-a652-7f15822046a7+5:15565:x1877761484520960:12345-192.168.202.19@tcp:900:bash.0 Request processed in 90us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773373.000890:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:3.0:1790773373.003918:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773373.004098:0:17122:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484521216 00000100:00100000:2.0:1790773373.004110:0:17122:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484521216 00000100:00100000:2.0:1790773373.004173:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 37 00000100:00100000:2.0:1790773373.004184:0:17122:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:332c789e-f22c-433e-a652-7f15822046a7+12:15565:x1877761484521216:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:2.0:1790773373.004252:0:17122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773373.004273:0:17122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527800/0xabf1cc0bc7843114 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c0b7 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773373.004389:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527400/0xabf1cc0bc784311b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773373.004406:0:17122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3600/0xabf1cc0bc78430f1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0a9 expref: 12 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773373.004426:0:17122:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527400/0xabf1cc0bc784311b lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773373.004457:0:17122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3600/0xabf1cc0bc78430f1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0a9 expref: 12 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773373.004490:0:17122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3600/0xabf1cc0bc78430f1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0a9 expref: 12 pid: 17122 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773373.004504:0:17122:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445de680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17122:1877761496129664:192.168.202.19@tcp:104: 00000100:00100000:2.0:1790773373.004584:0:17122:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ef8c000 going to sleep for 11 seconds 00000100:00100000:2.0:1790773373.011522:0:17122:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445de680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17122:1877761496129664:192.168.202.19@tcp:104: 00010000:00010000:2.0:1790773373.011561:0:17122:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527400/0xabf1cc0bc784311b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773373.013291:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773373.014077:0:17107:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484521344 00000100:00100000:2.0:1790773373.014087:0:17107:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484521344 00010000:00010000:2.0:1790773373.014131:0:17107:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3600/0xabf1cc0bc78430f1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0a9 expref: 13 pid: 17122 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773373.014243:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:2.0:1790773373.014253:0:17107:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+13:2398:x1877761484521344:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790773373.014269:0:17107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790773373.014276:0:17107:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3600/0xabf1cc0bc78430f1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0a9 expref: 13 pid: 17122 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773373.014289:0:17107:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3600/0xabf1cc0bc78430f1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0a9 expref: 13 pid: 17122 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773373.014311:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3600/0xabf1cc0bc78430f1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0a9 expref: 13 pid: 17122 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773373.014349:0:17107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93d26ff64100) 00010000:00010000:2.0:1790773373.014371:0:17107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527400/0xabf1cc0bc784311b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773373.014380:0:17107:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527400/0xabf1cc0bc784311b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773373.014388:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527400/0xabf1cc0bc784311b lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773373.014424:0:17107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790773373.014486:0:17107:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+12:2398:x1877761484521344:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 234us (1202us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773373.014494:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 16 00010000:00010000:0.0:1790773373.014554:0:17122:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527400/0xabf1cc0bc784311b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.014563:0:17122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527400/0xabf1cc0bc784311b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.014639:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5600/0xabf1cc0bc7843122 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.014650:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5600/0xabf1cc0bc7843122 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.014665:0:17122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5600/0xabf1cc0bc7843122 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.016332:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4a00/0xabf1cc0bc7843129 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.016367:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4a00/0xabf1cc0bc7843129 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.016379:0:17122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4a00/0xabf1cc0bc7843129 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790773373.016390:0:17122:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1790773373.016570:0:17122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527400/0xabf1cc0bc784311b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.016579:0:17122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527400/0xabf1cc0bc784311b lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.016587:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527400/0xabf1cc0bc784311b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.016592:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d241527400 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773373.016596:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527400/0xabf1cc0bc784311b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.016603:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527400/0xabf1cc0bc784311b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.016613:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93d26ff64100) 00010000:00010000:0.0:1790773373.016616:0:17122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773373.016636:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527400/0xabf1cc0bc784311b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.016642:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527400/0xabf1cc0bc784311b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790773373.016658:0:17122:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f8c10e51 reply state 00000000f004d5b7 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5600/0xabf1cc0bc7843122 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.016668:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5600/0xabf1cc0bc7843122 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.016910:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff93d254e30800) 00010000:00010000:0.0:1790773373.016913:0:17122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790773373.016917:0:17122:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790773373.016956:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527800/0xabf1cc0bc7843114 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0b7 expref: 15 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.016972:0:17122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4a00/0xabf1cc0bc7843129 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0b7 expref: 14 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.016979:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93d254e30200) 00010000:00010000:0.0:1790773373.016992:0:17122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1790773373.016995:0:17122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d2532e4a00, rc 0) 00000100:00100000:0.0:1790773373.017065:0:17122:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:332c789e-f22c-433e-a652-7f15822046a7+15:15565:x1877761484521216:12345-192.168.202.19@tcp:101:bash.0 Request processed in 12884us (13156us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1790773373.017074:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 37 00000100:00100000:3.0:1790773373.042104:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773373.043757:0:19912:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484521472 00000100:00100000:2.0:1790773373.043773:0:19912:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484521472 00000100:00100000:2.0:1790773373.043857:0:19912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 38 00000100:00100000:2.0:1790773373.043868:0:19912:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:332c789e-f22c-433e-a652-7f15822046a7+15:15565:x1877761484521472:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:2.0:1790773373.043892:0:19912:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773373.043914:0:19912:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527c00/0xabf1cc0bc7843137 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c0be expref: -99 pid: 19912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773373.043997:0:19912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527600/0xabf1cc0bc784313e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773373.044013:0:19912:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527600/0xabf1cc0bc784313e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773373.044042:0:19912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527600/0xabf1cc0bc784313e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790773373.044096:0:19912:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1790773373.044100:0:19912:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790773373.044121:0:19912:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527600/0xabf1cc0bc784313e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773373.044132:0:19912:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527600/0xabf1cc0bc784313e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773373.044158:0:19912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527c00/0xabf1cc0bc7843137 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0be expref: 17 pid: 19912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773373.044176:0:19912:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527600/0xabf1cc0bc784313e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0be expref: 16 pid: 19912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773373.044186:0:19912:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93d254e30200) 00010000:00010000:2.0:1790773373.044189:0:19912:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790773373.044192:0:19912:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d241527600, rc 0) 00000100:00100000:2.0:1790773373.045592:0:19912:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:332c789e-f22c-433e-a652-7f15822046a7+16:15565:x1877761484521472:12345-192.168.202.19@tcp:101:bash.0 Request processed in 1715us (3489us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773373.045604:0:19912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 38 00000100:00100000:1.0:1790773373.049913:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773373.050108:0:17126:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484521728 00000100:00100000:3.0:1790773373.050118:0:17126:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484521728 00000100:00100000:3.0:1790773373.050171:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00100000:3.0:1790773373.050193:0:17126:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:332c789e-f22c-433e-a652-7f15822046a7+16:15565:x1877761484521728:12345-192.168.202.19@tcp:35:bash.0 00000100:00100000:3.0:1790773373.050561:0:17126:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:332c789e-f22c-433e-a652-7f15822046a7+17:15565:x1877761484521728:12345-192.168.202.19@tcp:35:bash.0 Request processed in 368us (655us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1790773373.050569:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 5 00010000:00010000:1.0:1790773373.135356:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773373.155004:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773373.157083:0:17124:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484521984 00000100:00100000:3.0:1790773373.157098:0:17124:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484521984 00000100:00100000:3.0:1790773373.157177:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 39 00000100:00100000:3.0:1790773373.157188:0:17124:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:332c789e-f22c-433e-a652-7f15822046a7+17:15575:x1877761484521984:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:3.0:1790773373.157232:0:17124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773373.157255:0:17124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2c00/0xabf1cc0bc7843145 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c0c5 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790773373.159621:0:17124:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1790773373.159753:0:17124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2c00/0xabf1cc0bc7843145 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0c5 expref: 19 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773373.159769:0:17124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d26ff73500) 00010000:00010000:3.0:1790773373.159773:0:17124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790773373.159779:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2c00/0xabf1cc0bc7843145 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0c5 expref: 19 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773373.159794:0:17124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26c4a2c00, rc 0) 00000100:00100000:3.0:1790773373.160686:0:17124:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:332c789e-f22c-433e-a652-7f15822046a7+18:15575:x1877761484521984:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 3494us (5699us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1790773373.160697:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 39 00000100:00100000:1.0:1790773373.166973:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773373.167152:0:17126:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484522240 00000100:00100000:3.0:1790773373.167176:0:17126:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484522240 00000100:00100000:3.0:1790773373.167255:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:3.0:1790773373.167266:0:17126:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:332c789e-f22c-433e-a652-7f15822046a7+18:15575:x1877761484522240:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:3.0:1790773373.169127:0:17126:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:332c789e-f22c-433e-a652-7f15822046a7+19:15575:x1877761484522240:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 1853us (2156us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1790773373.169141:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:1.0:1790773373.219486:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773373.219706:0:17123:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484522496 00000100:00100000:2.0:1790773373.219717:0:17123:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484522496 00000100:00100000:2.0:1790773373.219779:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 40 00000100:00100000:2.0:1790773373.219789:0:17123:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:332c789e-f22c-433e-a652-7f15822046a7+19:15578:x1877761484522496:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1790773373.219820:0:17123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773373.219861:0:17123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527c00/0xabf1cc0bc7843153 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c0cc expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773373.220000:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527200/0xabf1cc0bc784315a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773373.220014:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527200/0xabf1cc0bc784315a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773373.220028:0:17123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527200/0xabf1cc0bc784315a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790773373.220041:0:17123:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790773373.220156:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527c00/0xabf1cc0bc7843153 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0cc expref: 22 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773373.220178:0:17123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527200/0xabf1cc0bc784315a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0cc expref: 21 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773373.220188:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93d254e30200) 00010000:00010000:2.0:1790773373.220191:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790773373.220195:0:17123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d241527200, rc 0) 00000100:00100000:2.0:1790773373.220319:0:17123:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:332c789e-f22c-433e-a652-7f15822046a7+21:15578:x1877761484522496:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 531us (846us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1790773373.220327:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 40 00000100:00100000:1.0:1790773373.229155:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773373.229238:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773373.229505:0:17109:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484522752 00000100:00100000:2.0:1790773373.229516:0:17109:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484522752 00000100:00100000:2.0:1790773373.229629:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:2.0:1790773373.229640:0:17109:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:332c789e-f22c-433e-a652-7f15822046a7+21:2400:x1877761484522752:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790773373.229669:0:17109:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790773373.229696:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527200/0xabf1cc0bc784315a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0cc expref: 21 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773373.229716:0:17109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93d254e30200) 00010000:00010000:2.0:1790773373.229721:0:17109:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790773373.229784:0:17109:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:332c789e-f22c-433e-a652-7f15822046a7+20:2400:x1877761484522752:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 146us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773373.229792:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:0.0:1790773373.229970:0:17122:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484522624 00000100:00100000:0.0:1790773373.229976:0:17122:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484522624 00000100:00100000:0.0:1790773373.230036:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 41 00000100:00100000:0.0:1790773373.230044:0:17122:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:332c789e-f22c-433e-a652-7f15822046a7+20:15578:x1877761484522624:12345-192.168.202.19@tcp:54:lfs.0 00010000:00010000:0.0:1790773373.230117:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5400/0xabf1cc0bc7843168 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.230133:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5400/0xabf1cc0bc7843168 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.230144:0:17122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5400/0xabf1cc0bc7843168 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.230180:0:17122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5400/0xabf1cc0bc7843168 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.230188:0:17122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5400/0xabf1cc0bc7843168 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.230195:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5400/0xabf1cc0bc7843168 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.230202:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d2532e5400 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773373.230235:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5400/0xabf1cc0bc7843168 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.230243:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5400/0xabf1cc0bc7843168 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.230253:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93d254e30200) 00010000:00010000:0.0:1790773373.230256:0:17122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790773373.230260:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5400/0xabf1cc0bc7843168 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.230266:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5400/0xabf1cc0bc7843168 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773373.230325:0:17122:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:332c789e-f22c-433e-a652-7f15822046a7+20:15578:x1877761484522624:12345-192.168.202.19@tcp:54:lfs.0 Request processed in 281us (1181us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773373.230332:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 41 00000100:00100000:1.0:1790773373.234144:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773373.236453:0:17125:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484523008 00000100:00100000:0.0:1790773373.236470:0:17125:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484523008 00000100:00100000:0.0:1790773373.236649:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:0.0:1790773373.236661:0:17125:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:332c789e-f22c-433e-a652-7f15822046a7+20:15578:x1877761484523008:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:0.0:1790773373.236924:0:17125:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:332c789e-f22c-433e-a652-7f15822046a7+21:15578:x1877761484523008:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 265us (2790us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1790773373.236933:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 7 00000040:00080000:3.0:1790773373.519704:0:17158:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1790773373.567271:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773373.567372:0:17123:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484523264 00000100:00100000:2.0:1790773373.567385:0:17123:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484523264 00000100:00100000:2.0:1790773373.567449:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 42 00000100:00100000:2.0:1790773373.567460:0:17123:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:332c789e-f22c-433e-a652-7f15822046a7+21:15609:x1877761484523264:12345-192.168.202.19@tcp:101:cat.0 00010000:00010000:2.0:1790773373.567504:0:17123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773373.567526:0:17123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527200/0xabf1cc0bc784316f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c0d3 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773373.567670:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526c00/0xabf1cc0bc7843176 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773373.567686:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526c00/0xabf1cc0bc7843176 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773373.567699:0:17123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526c00/0xabf1cc0bc7843176 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790773373.567711:0:17123:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790773373.568187:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527200/0xabf1cc0bc784316f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0d3 expref: 24 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773373.568310:0:17123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526c00/0xabf1cc0bc7843176 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0d3 expref: 23 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773373.568321:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93d254e30200) 00010000:00010000:2.0:1790773373.568325:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790773373.568328:0:17123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d241526c00, rc 0) 00000100:00100000:2.0:1790773373.568437:0:17123:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:332c789e-f22c-433e-a652-7f15822046a7+23:15609:x1877761484523264:12345-192.168.202.19@tcp:101:cat.0 Request processed in 979us (1176us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1790773373.568445:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 42 00000100:00100000:2.0:1790773373.574233:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773373.574277:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773373.574301:0:17126:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484523520 00000100:00100000:1.0:1790773373.574313:0:17126:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484523520 00000100:00100000:3.0:1790773373.574380:0:17108:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484523648 00000100:00100000:1.0:1790773373.574384:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 8 00000100:00100000:3.0:1790773373.574387:0:17108:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484523648 00000100:00100000:1.0:1790773373.574399:0:17126:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:332c789e-f22c-433e-a652-7f15822046a7+24:15609:x1877761484523520:12345-192.168.202.19@tcp:35:cat.0 00000100:00100000:3.0:1790773373.574470:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 1 00000100:00100000:3.0:1790773373.574479:0:17108:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:332c789e-f22c-433e-a652-7f15822046a7+24:2397:x1877761484523648:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790773373.574506:0:17108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773373.574531:0:17108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526c00/0xabf1cc0bc7843176 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0d3 expref: 24 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773373.574562:0:17108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93d254e30200) 00010000:00010000:3.0:1790773373.574568:0:17108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790773373.574632:0:17108:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:332c789e-f22c-433e-a652-7f15822046a7+23:2397:x1877761484523648:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 154us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773373.574641:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 1 00000100:00100000:1.0:1790773373.574955:0:17126:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:332c789e-f22c-433e-a652-7f15822046a7+23:15609:x1877761484523520:12345-192.168.202.19@tcp:35:cat.0 Request processed in 560us (762us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1790773373.574963:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 8 00000100:00100000:3.0:1790773373.644177:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773373.646270:0:17122:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484523904 00000100:00100000:0.0:1790773373.646290:0:17122:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484523904 00000100:00100000:0.0:1790773373.646430:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 43 00000100:00100000:0.0:1790773373.646442:0:17122:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:332c789e-f22c-433e-a652-7f15822046a7+23:15615:x1877761484523904:12345-192.168.202.19@tcp:101:dd.0 00010000:00010000:0.0:1790773373.646482:0:17122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773373.646504:0:17122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5200/0xabf1cc0bc7843184 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c0da expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.646619:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5400/0xabf1cc0bc784318b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.646634:0:17122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4a00/0xabf1cc0bc7843129 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0b7 expref: 24 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.646643:0:17122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527600/0xabf1cc0bc784313e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0be expref: 24 pid: 19912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.646664:0:17122:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5400/0xabf1cc0bc784318b lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.646919:0:17122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527600/0xabf1cc0bc784313e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0be expref: 24 pid: 19912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.646935:0:17122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527600/0xabf1cc0bc784313e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0be expref: 24 pid: 19912 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773373.646950:0:17122:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f975180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17122:1877761496129792:192.168.202.19@tcp:104: 00010000:00010000:0.0:1790773373.647142:0:17122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4a00/0xabf1cc0bc7843129 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0b7 expref: 24 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.647152:0:17122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4a00/0xabf1cc0bc7843129 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0b7 expref: 24 pid: 17122 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773373.647161:0:17122:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f975880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17122:1877761496129920:192.168.202.19@tcp:104: 00000100:00100000:0.0:1790773373.647187:0:17122:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2465e0000 going to sleep for 11 seconds 00000100:00100000:3.0:1790773373.659512:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773373.659649:0:17122:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f975180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17122:1877761496129792:192.168.202.19@tcp:104: 00000100:00100000:2.0:1790773373.659663:0:17122:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f975880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17122:1877761496129920:192.168.202.19@tcp:104: 00010000:00010000:2.0:1790773373.659690:0:17122:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5400/0xabf1cc0bc784318b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773373.659781:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773373.660526:0:20148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484524032 00000100:00100000:1.0:1790773373.660539:0:20148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484524032 00010000:00010000:0.0:1790773373.660647:0:20148:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527600/0xabf1cc0bc784313e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0be expref: 25 pid: 19912 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773373.660685:0:20148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484524160 00000100:00100000:0.0:1790773373.660689:0:20148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484524160 00010000:00010000:0.0:1790773373.660711:0:20148:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4a00/0xabf1cc0bc7843129 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0b7 expref: 26 pid: 17122 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773373.660760:0:20148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:0.0:1790773373.660770:0:20148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:332c789e-f22c-433e-a652-7f15822046a7+26:2398:x1877761484524032:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790773373.660788:0:20148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773373.660795:0:20148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527600/0xabf1cc0bc784313e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0be expref: 26 pid: 19912 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.660806:0:20148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527600/0xabf1cc0bc784313e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0be expref: 26 pid: 19912 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.660827:0:20148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527600/0xabf1cc0bc784313e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0be expref: 26 pid: 19912 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.660846:0:20148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93d254e30200) 00010000:00010000:0.0:1790773373.660850:0:20148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5400/0xabf1cc0bc784318b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.660859:0:20148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5400/0xabf1cc0bc784318b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.660865:0:20148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790773373.660924:0:20148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:332c789e-f22c-433e-a652-7f15822046a7+25:2398:x1877761484524032:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 155us (1428us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773373.660933:0:20148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:0.0:1790773373.660952:0:20148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 18 00000100:00100000:0.0:1790773373.660958:0:20148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d280a72450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:332c789e-f22c-433e-a652-7f15822046a7+24:2400:x1877761484524160:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790773373.660989:0:20148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773373.660995:0:20148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4a00/0xabf1cc0bc7843129 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0b7 expref: 24 pid: 17122 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.661004:0:20148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4a00/0xabf1cc0bc7843129 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0b7 expref: 24 pid: 17122 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.661016:0:20148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4a00/0xabf1cc0bc7843129 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0b7 expref: 24 pid: 17122 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.661027:0:20148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93d254e30200) 00010000:00010000:0.0:1790773373.661030:0:20148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5400/0xabf1cc0bc784318b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.661038:0:20148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5400/0xabf1cc0bc784318b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.661045:0:20148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5400/0xabf1cc0bc784318b lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.661071:0:20148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790773373.661091:0:20148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d280a72450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:332c789e-f22c-433e-a652-7f15822046a7+23:2400:x1877761484524160:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 132us (1310us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773373.661098:0:20148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 18 00010000:00010000:0.0:1790773373.661339:0:17122:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5400/0xabf1cc0bc784318b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.661348:0:17122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5400/0xabf1cc0bc784318b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790773373.661685:0:17122:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1790773373.661910:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5200/0xabf1cc0bc7843184 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0da expref: 24 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.661927:0:17122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5400/0xabf1cc0bc784318b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0da expref: 23 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.661934:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93d254e30200) 00010000:00010000:0.0:1790773373.661937:0:17122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790773373.661940:0:17122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d2532e5400, rc 0) 00000100:00100000:0.0:1790773373.661996:0:17122:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:332c789e-f22c-433e-a652-7f15822046a7+23:15615:x1877761484523904:12345-192.168.202.19@tcp:101:dd.0 Request processed in 15557us (17830us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1790773373.662004:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 43 00000100:00100000:3.0:1790773373.665118:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773373.665254:0:19912:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484524288 00000100:00100000:0.0:1790773373.665264:0:19912:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484524288 00000100:00100000:0.0:1790773373.665332:0:19912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 44 00000100:00100000:0.0:1790773373.665342:0:19912:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:332c789e-f22c-433e-a652-7f15822046a7+23:15615:x1877761484524288:12345-192.168.202.19@tcp:101:dd.0 00010000:00010000:0.0:1790773373.665369:0:19912:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773373.665390:0:19912:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5800/0xabf1cc0bc7843199 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c0e1 expref: -99 pid: 19912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.665433:0:19912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030600/0xabf1cc0bc78431a0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.665518:0:19912:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030600/0xabf1cc0bc78431a0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.665544:0:19912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030600/0xabf1cc0bc78431a0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.665665:0:19912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5800/0xabf1cc0bc7843199 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0e1 expref: 25 pid: 19912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.665683:0:19912:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030600/0xabf1cc0bc78431a0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0e1 expref: 24 pid: 19912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.666403:0:19912:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93d254e30200) 00010000:00010000:0.0:1790773373.666409:0:19912:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790773373.666414:0:19912:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d240030600, rc 0) 00000100:00100000:0.0:1790773373.666631:0:19912:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:332c789e-f22c-433e-a652-7f15822046a7+24:15615:x1877761484524288:12345-192.168.202.19@tcp:101:dd.0 Request processed in 1287us (1522us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773373.666640:0:19912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 44 00000100:00100000:1.0:1790773373.669939:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773373.670176:0:17124:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484524544 00000100:00100000:3.0:1790773373.670189:0:17124:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484524544 00000100:00100000:3.0:1790773373.670438:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 45 00000100:00100000:3.0:1790773373.670537:0:17124:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:332c789e-f22c-433e-a652-7f15822046a7+24:15615:x1877761484524544:12345-192.168.202.19@tcp:36:dd.0 00010000:00010000:3.0:1790773373.670778:0:17124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2c00/0xabf1cc0bc78431a7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773373.670796:0:17124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2c00/0xabf1cc0bc78431a7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773373.670807:0:17124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2c00/0xabf1cc0bc78431a7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790773373.670850:0:17124:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1790773373.670873:0:17124:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000040a21872 reply state 00000000166bb0da transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2c00/0xabf1cc0bc78431a7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773373.670885:0:17124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2c00/0xabf1cc0bc78431a7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773373.670893:0:17124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93d254e30200) 00010000:00010000:3.0:1790773373.670895:0:17124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790773373.670899:0:17124:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790773373.671016:0:17124:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:332c789e-f22c-433e-a652-7f15822046a7+27:15615:x1877761484524544:12345-192.168.202.19@tcp:36:dd.0 Request processed in 480us (1086us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1790773373.671654:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 45 00000020:00080000:3.0:1790773373.671662:0:17124:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1790773373.673138:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773373.674021:0:17123:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484524672 00000100:00100000:1.0:1790773373.674034:0:17123:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484524672 00000100:00100000:1.0:1790773373.674151:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 46 00000100:00100000:1.0:1790773373.674163:0:17123:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ff27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:332c789e-f22c-433e-a652-7f15822046a7+27:15615:x1877761484524672:12345-192.168.202.19@tcp:101:dd.0 00010000:00010000:1.0:1790773373.674246:0:17123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773373.674270:0:17123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc78431ae lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c0e8 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773373.674339:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc78431ae lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0e8 expref: 28 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773373.674356:0:17123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc78431ae lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0e8 expref: 28 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773373.674376:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93d254e30200) 00010000:00010000:1.0:1790773373.674379:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790773373.674393:0:17123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12ae00, rc 0) 00000100:00100000:1.0:1790773373.674457:0:17123:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ff27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:332c789e-f22c-433e-a652-7f15822046a7+28:15615:x1877761484524672:12345-192.168.202.19@tcp:101:dd.0 Request processed in 296us (1328us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773373.674465:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 46 00000100:00100000:1.0:1790773373.683618:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773373.683725:0:20148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484524928 00000100:00100000:0.0:1790773373.683737:0:20148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484524928 00000100:00100000:0.0:1790773373.683808:0:20148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 2 00000100:00100000:0.0:1790773373.683821:0:20148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:332c789e-f22c-433e-a652-7f15822046a7+28:15615:x1877761484524928:12345-192.168.202.19@tcp:103:dd.0 00010000:00010000:0.0:1790773373.683839:0:20148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773373.683863:0:20148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc78431ae lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0e8 expref: 28 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.683883:0:20148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93d254e30200) 00010000:00010000:0.0:1790773373.683889:0:20148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790773373.683958:0:20148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:332c789e-f22c-433e-a652-7f15822046a7+27:15615:x1877761484524928:12345-192.168.202.19@tcp:103:dd.0 Request processed in 140us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773373.683993:0:20148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 2 00000100:00100000:2.0:1790773373.686241:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773373.686344:0:17122:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484525056 00000100:00100000:0.0:1790773373.686354:0:17122:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484525056 00000100:00100000:0.0:1790773373.686408:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 47 00000100:00100000:0.0:1790773373.686418:0:17122:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:332c789e-f22c-433e-a652-7f15822046a7+27:15615:x1877761484525056:12345-192.168.202.19@tcp:58:dd.0 00010000:00010000:0.0:1790773373.686530:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030200/0xabf1cc0bc78431b5 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.686547:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030200/0xabf1cc0bc78431b5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.686557:0:17122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030200/0xabf1cc0bc78431b5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790773373.687449:0:17122:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790773373.687846:0:17122:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1790773373.687991:0:17122:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1790773373.688167:0:17122:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:332c789e-f22c-433e-a652-7f15822046a7+27:15615:x1877761484525056:12345-192.168.202.19@tcp:58:dd.0 Request processed in 1746us (1966us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773373.688177:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 47 00000100:00100000:3.0:1790773373.689762:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773373.689905:0:19912:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484525184 00000100:00100000:0.0:1790773373.689918:0:19912:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484525184 00000100:00100000:0.0:1790773373.689991:0:19912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 48 00000100:00100000:0.0:1790773373.690003:0:19912:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ff27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:332c789e-f22c-433e-a652-7f15822046a7+27:15615:x1877761484525184:12345-192.168.202.19@tcp:101:dd.0 00010000:00010000:0.0:1790773373.690102:0:19912:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773373.690125:0:19912:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031a00/0xabf1cc0bc78431bc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c0ef expref: -99 pid: 19912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.690262:0:19912:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030200/0xabf1cc0bc78431b5 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.690274:0:19912:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031a00/0xabf1cc0bc78431bc lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0ef expref: 28 pid: 19912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.690296:0:19912:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030200/0xabf1cc0bc78431b5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.690310:0:19912:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031a00/0xabf1cc0bc78431bc lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0ef expref: 28 pid: 19912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.690325:0:19912:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93d254e30200) 00010000:00010000:0.0:1790773373.690328:0:19912:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790773373.690332:0:19912:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031a00/0xabf1cc0bc78431bc lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0ef expref: 28 pid: 19912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773373.690340:0:19912:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d240031a00, rc 0) 00000100:00100000:0.0:1790773373.690451:0:19912:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ff27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:332c789e-f22c-433e-a652-7f15822046a7+28:15615:x1877761484525184:12345-192.168.202.19@tcp:101:dd.0 Request processed in 449us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773373.690458:0:19912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 48 00010000:00010000:3.0:1790773374.157519:0:20149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790773374.541485:0:17158:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1790773374.541495:0:17158:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790773374.541524:0:17158:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1790773374.541533:0:17158:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1790773374.541696:0:17158:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27ff26d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17158:1877761496130048:192.168.202.19@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790773374.541796:0:17158:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27d818180 going to sleep for 11 seconds 00000100:00100000:2.0:1790773374.546385:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773374.546554:0:17124:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484525312 00000100:00100000:3.0:1790773374.546565:0:17124:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484525312 00000100:00100000:3.0:1790773374.546696:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 49 00000100:00100000:3.0:1790773374.546709:0:17124:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:332c789e-f22c-433e-a652-7f15822046a7+29:15616:x1877761484525312:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 00000100:00080000:1.0:1790773374.546726:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000080:3.0:1790773374.546744:0:17124:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790773374.546877:0:17124:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:332c789e-f22c-433e-a652-7f15822046a7+29:15616:x1877761484525312:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 Request processed in 172us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773374.546885:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 49 00000100:00100000:0.0:1790773374.548833:0:17158:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27ff26d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17158:1877761496130048:192.168.202.19@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790773374.554563:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773374.554655:0:17123:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484525440 00000100:00100000:1.0:1790773374.554682:0:17123:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484525440 00000100:00100000:1.0:1790773374.554748:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 50 00000100:00100000:1.0:1790773374.554758:0:17123:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:332c789e-f22c-433e-a652-7f15822046a7+28:15616:x1877761484525440:12345-192.168.202.19@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1790773374.555156:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc78431c3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.555178:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc78431c3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.555192:0:17123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc78431c3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.555272:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc78431ca lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.555281:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc78431ca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.555288:0:17123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc78431ca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.555312:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc78431d1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.555333:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc78431d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.555340:0:17123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc78431d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790773374.555387:0:17123:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1790773374.555391:0:17123:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790773374.555408:0:17123:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc78431d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.555419:0:17123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc78431c3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.555426:0:17123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc78431c3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.555433:0:17123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc78431c3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.555439:0:17123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12be00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773374.555444:0:17123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc78431c3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.555452:0:17123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc78431c3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.555464:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93d26ff64e00) 00010000:00010000:1.0:1790773374.555467:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790773374.555473:0:17123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc78431c3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.555490:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc78431c3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.555505:0:17123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc78431ca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.555512:0:17123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc78431ca lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.555518:0:17123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc78431ca lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.555523:0:17123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12a800 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773374.555526:0:17123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc78431ca lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.555533:0:17123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc78431ca lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.555540:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff93d14363d800) 00010000:00010000:1.0:1790773374.555542:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790773374.555545:0:17123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc78431ca lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.555551:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc78431ca lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.555566:0:17123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc78431d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.555571:0:17123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc78431d1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.555584:0:17123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc78431d1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.555590:0:17123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12a400 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773374.555592:0:17123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc78431d1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.555598:0:17123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc78431d1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.555606:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93d254e30200) 00010000:00010000:1.0:1790773374.555609:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790773374.555611:0:17123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc78431d1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.555617:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a400/0xabf1cc0bc78431d1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773374.555937:0:17123:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:332c789e-f22c-433e-a652-7f15822046a7+28:15616:x1877761484525440:12345-192.168.202.19@tcp:34:lhsmtool_posix.0 Request processed in 1176us (1384us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773374.555946:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 50 00000100:00100000:1.0:1790773374.558578:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773374.564902:0:17122:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484525696 00000100:00100000:2.0:1790773374.564920:0:17122:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484525696 00000100:00100000:2.0:1790773374.565005:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 51 00000100:00100000:2.0:1790773374.565016:0:17122:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:332c789e-f22c-433e-a652-7f15822046a7+28:15616:x1877761484525696:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790773374.565042:0:17122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773374.565063:0:17122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527200/0xabf1cc0bc78431d8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c0f6 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773374.565258:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526c00/0xabf1cc0bc78431df lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773374.565275:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526c00/0xabf1cc0bc78431df lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773374.565287:0:17122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526c00/0xabf1cc0bc78431df lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790773374.565299:0:17122:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790773374.565382:0:17122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526c00/0xabf1cc0bc78431df lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773374.565390:0:17122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526c00/0xabf1cc0bc78431df lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773374.565397:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526c00/0xabf1cc0bc78431df lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773374.565402:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d241526c00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:2.0:1790773374.565407:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526c00/0xabf1cc0bc78431df lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773374.565414:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526c00/0xabf1cc0bc78431df lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773374.565426:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93d254e30200) 00010000:00010000:2.0:1790773374.565429:0:17122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790773374.565434:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526c00/0xabf1cc0bc78431df lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773374.565451:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526c00/0xabf1cc0bc78431df lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773374.565498:0:17122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527200/0xabf1cc0bc78431d8 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0f6 expref: 30 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773374.565510:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93d26ff64e00) 00010000:00010000:2.0:1790773374.565512:0:17122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790773374.565515:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527200/0xabf1cc0bc78431d8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0f6 expref: 30 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773374.565524:0:17122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d241527200, rc 0) 00000100:00100000:2.0:1790773374.565605:0:17122:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:332c789e-f22c-433e-a652-7f15822046a7+29:15616:x1877761484525696:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 591us (7036us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1790773374.565613:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 51 00000100:00100000:2.0:1790773374.568357:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773374.568425:0:19912:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484525824 00000100:00100000:0.0:1790773374.568435:0:19912:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484525824 00000100:00100000:0.0:1790773374.568489:0:19912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 52 00000100:00100000:0.0:1790773374.568498:0:19912:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:332c789e-f22c-433e-a652-7f15822046a7+29:15616:x1877761484525824:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790773374.568543:0:19912:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790773374.568654:0:19912:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:332c789e-f22c-433e-a652-7f15822046a7+29:15616:x1877761484525824:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 Request processed in 157us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773374.568670:0:19912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 52 00000100:00100000:1.0:1790773374.576037:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773374.576139:0:17122:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484526080 00000100:00100000:2.0:1790773374.576152:0:17122:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484526080 00000100:00100000:2.0:1790773374.576259:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 53 00000100:00100000:2.0:1790773374.576271:0:17122:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:332c789e-f22c-433e-a652-7f15822046a7+29:15616:x1877761484526080:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790773374.576297:0:17122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773374.576321:0:17122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527c00/0xabf1cc0bc78431ed lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c0fd expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790773374.576728:0:17122:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x7:0x0], count =27 00000004:00080000:2.0:1790773374.576735:0:17122:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x7:0x0]+27 in llog 00000004:00080000:2.0:1790773374.576769:0:17122:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:2.0:1790773374.576917:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527800/0xabf1cc0bc78431f4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773374.576934:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527800/0xabf1cc0bc78431f4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773374.576947:0:17122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527800/0xabf1cc0bc78431f4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773374.577011:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527c00/0xabf1cc0bc78431ed lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0fd expref: 32 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773374.577031:0:17122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527800/0xabf1cc0bc78431f4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0fd expref: 31 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773374.577041:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93d26ff73000) 00010000:00010000:2.0:1790773374.577043:0:17122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790773374.577047:0:17122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d241527800, rc 0) 00000100:00100000:2.0:1790773374.577124:0:17122:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:332c789e-f22c-433e-a652-7f15822046a7+31:15616:x1877761484526080:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 857us (1097us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1790773374.577132:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 53 00000100:00100000:3.0:1790773374.580484:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773374.580578:0:17123:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484526336 00000100:00100000:1.0:1790773374.580589:0:17123:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484526336 00000100:00100000:1.0:1790773374.580650:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 54 00000100:00100000:1.0:1790773374.580661:0:17123:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ff27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:332c789e-f22c-433e-a652-7f15822046a7+31:15616:x1877761484526336:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790773374.580841:0:17123:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790773374.580891:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527800/0xabf1cc0bc78431f4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0fd expref: 31 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.580910:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93d26ff73000) 00010000:00010000:1.0:1790773374.580925:0:17123:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790773374.580948:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc7843202 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.580962:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc7843202 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.580984:0:17123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc7843202 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.580998:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7843209 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x37cf1a05 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.581005:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7843209 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x37cf1a05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.581011:0:17123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7843209 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x37cf1a05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.581060:0:17123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc7843202 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.581067:0:17123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc7843202 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.581074:0:17123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc7843202 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.581081:0:17123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12a800 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773374.581091:0:17123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc7843202 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.581099:0:17123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc7843202 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.581108:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93d26ff64100) 00010000:00010000:1.0:1790773374.581110:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790773374.581114:0:17123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc7843202 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.581121:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc7843202 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.581145:0:17123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7843209 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x37cf1a05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.581150:0:17123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7843209 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x37cf1a05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.581156:0:17123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7843209 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x37cf1a05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.581160:0:17123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12be00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773374.581163:0:17123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7843209 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x37cf1a05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.581168:0:17123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7843209 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x37cf1a05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.581174:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x37cf1a05 (ffff93d14363d800) 00010000:00010000:1.0:1790773374.581176:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790773374.581186:0:17123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7843209 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x37cf1a05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.581192:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc7843209 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x37cf1a05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773374.581663:0:17123:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ff27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:332c789e-f22c-433e-a652-7f15822046a7+30:15616:x1877761484526336:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 1001us (1186us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790773374.581680:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 54 00000100:00100000:1.0:1790773374.587551:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773374.587630:0:17122:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484526464 00000100:00100000:2.0:1790773374.587641:0:17122:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484526464 00000100:00100000:2.0:1790773374.587704:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 55 00000100:00100000:2.0:1790773374.587713:0:17122:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:332c789e-f22c-433e-a652-7f15822046a7+30:15616:x1877761484526464:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790773374.587733:0:17122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773374.587755:0:17122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527c00/0xabf1cc0bc7843210 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c104 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773374.587808:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527200/0xabf1cc0bc7843217 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773374.587821:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527200/0xabf1cc0bc7843217 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773374.587832:0:17122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527200/0xabf1cc0bc7843217 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773374.587947:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527c00/0xabf1cc0bc7843210 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c104 expref: 32 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773374.587977:0:17122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527200/0xabf1cc0bc7843217 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c104 expref: 31 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773374.587986:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93d26ff73600) 00010000:00010000:2.0:1790773374.587989:0:17122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790773374.587992:0:17122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d241527200, rc 0) 00000100:00100000:2.0:1790773374.588055:0:17122:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:332c789e-f22c-433e-a652-7f15822046a7+31:15616:x1877761484526464:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 344us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773374.588062:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 55 00000100:00100000:0.0:1790773374.590523:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773374.590780:0:19912:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484526720 00000100:00100000:2.0:1790773374.590790:0:19912:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484526720 00000100:00100000:2.0:1790773374.590848:0:19912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 56 00000100:00100000:2.0:1790773374.590867:0:19912:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:332c789e-f22c-433e-a652-7f15822046a7+31:15616:x1877761484526720:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790773374.590961:0:19912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526c00/0xabf1cc0bc784321e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773374.591008:0:19912:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526c00/0xabf1cc0bc784321e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773374.591020:0:19912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526c00/0xabf1cc0bc784321e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790773374.591279:0:19912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1790773374.591290:0:19912:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 517393084983ns, next at 518393081576ns, rc = 0 00000004:00010000:2.0:1790773374.591341:0:19912:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000098b1f007 reply state 00000000e8509951 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526c00/0xabf1cc0bc784321e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773374.591352:0:19912:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526c00/0xabf1cc0bc784321e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773374.591359:0:19912:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93d26ff73600) 00010000:00010000:2.0:1790773374.591362:0:19912:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1790773374.591365:0:19912:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790773374.591482:0:19912:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:332c789e-f22c-433e-a652-7f15822046a7+33:15616:x1877761484526720:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 617us (968us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1790773374.591489:0:19912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 56 00000100:00100000:1.0:1790773374.593300:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773374.593389:0:17122:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484526848 00000100:00100000:2.0:1790773374.593398:0:17122:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484526848 00000100:00100000:2.0:1790773374.594256:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 57 00000100:00100000:2.0:1790773374.594274:0:17122:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:332c789e-f22c-433e-a652-7f15822046a7+33:15616:x1877761484526848:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790773374.594301:0:17122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773374.594323:0:17122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527c00/0xabf1cc0bc7843225 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c10b expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773374.594399:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527c00/0xabf1cc0bc7843225 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c10b expref: 34 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773374.594413:0:17122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527c00/0xabf1cc0bc7843225 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c10b expref: 34 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773374.594432:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93d26ff73600) 00010000:00010000:2.0:1790773374.594435:0:17122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790773374.594448:0:17122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d241527c00, rc 0) 00000100:00100000:2.0:1790773374.594511:0:17122:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:332c789e-f22c-433e-a652-7f15822046a7+34:15616:x1877761484526848:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 243us (1219us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773374.594518:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 57 00000100:00100000:3.0:1790773374.599406:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773374.599544:0:18630:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484526976 00000100:00100000:2.0:1790773374.599556:0:18630:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484526976 00000100:00100000:2.0:1790773374.599687:0:18630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00100000:2.0:1790773374.599699:0:18630:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ff26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:332c789e-f22c-433e-a652-7f15822046a7+5:2400:x1877761484526976:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1790773374.599954:0:18630:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ff26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:332c789e-f22c-433e-a652-7f15822046a7+6:2400:x1877761484526976:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 Request processed in 257us (567us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1790773374.599962:0:18630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00080000:1.0:1790773374.600550:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790773374.602665:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773374.602773:0:17125:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484527232 00000100:00100000:2.0:1790773374.602784:0:17125:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484527232 00000100:00100000:2.0:1790773374.602951:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:2.0:1790773374.602964:0:17125:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f974700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:332c789e-f22c-433e-a652-7f15822046a7+34:15616:x1877761484527232:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790773374.603401:0:17125:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f974700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:332c789e-f22c-433e-a652-7f15822046a7+35:15616:x1877761484527232:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 Request processed in 439us (746us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1790773374.603424:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:0.0:1790773374.611716:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773374.612326:0:19912:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484527488 00000100:00100000:2.0:1790773374.612339:0:19912:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484527488 00000100:00100000:2.0:1790773374.612428:0:19912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 58 00000100:00100000:2.0:1790773374.612440:0:19912:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:332c789e-f22c-433e-a652-7f15822046a7+35:15616:x1877761484527488:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790773374.612594:0:19912:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:332c789e-f22c-433e-a652-7f15822046a7+35:15616:x1877761484527488:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 156us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773374.612602:0:19912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 58 00000100:00100000:3.0:1790773374.621446:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773374.621598:0:17124:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484527616 00000100:00100000:1.0:1790773374.621609:0:17124:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484527616 00000100:00100000:1.0:1790773374.621680:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 59 00000100:00100000:1.0:1790773374.621691:0:17124:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ff25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:332c789e-f22c-433e-a652-7f15822046a7+35:15616:x1877761484527616:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790773374.621713:0:17124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773374.621734:0:17124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc784322c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c112 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.621810:0:17124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc7843233 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.621827:0:17124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc7843233 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.621839:0:17124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc7843233 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790773374.621888:0:17124:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790773374.621925:0:17124:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc7843233 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.621955:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12be00/0xabf1cc0bc784322c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c112 expref: 37 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.621985:0:17124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc7843233 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c112 expref: 36 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.621996:0:17124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93d26ff73600) 00010000:00010000:1.0:1790773374.621999:0:17124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1790773374.622004:0:17124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12a800, rc 0) 00000100:00100000:1.0:1790773374.622078:0:17124:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ff25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:332c789e-f22c-433e-a652-7f15822046a7+36:15616:x1877761484527616:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 388us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773374.622085:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 59 00000100:00100000:0.0:1790773374.635267:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773374.635402:0:19203:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484527744 00000100:00100000:2.0:1790773374.635416:0:19203:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484527744 00000100:00100000:2.0:1790773374.635503:0:19203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:2.0:1790773374.635515:0:19203:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f976680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:332c789e-f22c-433e-a652-7f15822046a7+6:2398:x1877761484527744:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790773374.635540:0:19203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773374.635565:0:19203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007dc942a/0xabf1cc0bc784323a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c119 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790773374.635591:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abd087e, blocks: 0x0 00010000:00010000:2.0:1790773374.635612:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=517s v=(0 0) 00010000:00010000:2.0:1790773374.635617:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790773374.635627:0:19203:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007dc942a/0xabf1cc0bc784323a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c119 expref: 7 pid: 19203 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773374.635645:0:19203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000007dc942a/0xabf1cc0bc784323a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c119 expref: 7 pid: 19203 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773374.636027:0:19203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d241527400, rc 0) 00000100:00100000:2.0:1790773374.636151:0:19203:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f976680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:332c789e-f22c-433e-a652-7f15822046a7+7:2398:x1877761484527744:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 637us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773374.636158:0:19203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:3.0:1790773374.642075:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773374.642149:0:17123:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484528000 00000100:00100000:1.0:1790773374.642163:0:17123:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484528000 00000100:00100000:1.0:1790773374.642253:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 60 00000100:00100000:1.0:1790773374.642264:0:17123:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ff24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:332c789e-f22c-433e-a652-7f15822046a7+36:15616:x1877761484528000:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1790773374.643816:0:17123:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ff24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:332c789e-f22c-433e-a652-7f15822046a7+36:15616:x1877761484528000:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 1543us (1742us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773374.643829:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 60 00000100:00100000:3.0:1790773374.648766:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773374.649684:0:17124:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484528128 00000100:00100000:1.0:1790773374.649697:0:17124:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484528128 00000100:00100000:1.0:1790773374.649774:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 61 00000100:00100000:1.0:1790773374.649785:0:17124:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ff27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:332c789e-f22c-433e-a652-7f15822046a7+36:15616:x1877761484528128:12345-192.168.202.19@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1790773374.654480:0:17102:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:3.0:1790773374.654496:0:17102:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:3.0:1790773374.654560:0:17102:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:1.0:1790773374.655324:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790773374.655358:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496130176:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1790773374.655432:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773374.655495:0:18628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496130176 00000100:00100000:1.0:1790773374.655503:0:18628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496130176 00000100:00100000:1.0:1790773374.655558:0:18628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790773374.655568:0:18628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496130176:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1790773374.656171:0:18628:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1790773374.656175:0:18628:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1790773374.656178:0:18628:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1790773374.656181:0:18628:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1790773374 -> 1790773374 00002000:00010000:1.0:1790773374.656183:0:18628:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1790773374.656254:0:18628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3605:x1877761496130176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 686us (821us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1790773374.656261:0:18628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1790773374.656284:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1790773374.656315:0:3605:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93d281b9d180/2, rc 0, transno 8589934596 00000100:00100000:1.0:1790773374.656321:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496130176:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1790773374.656432:0:17124:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ff27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:332c789e-f22c-433e-a652-7f15822046a7+19:15616:x1877761484528128:12345-192.168.202.19@tcp:44:lhsmtool_posix.0 Request processed in 6648us (7675us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773374.656441:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 61 00010000:00010000:0.0:1790773374.659338:0:3590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5000/0xabf1cc0bc7843073 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773374.659355:0:3590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5000/0xabf1cc0bc7843073 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773374.659363:0:3590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5000/0xabf1cc0bc7843073 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773374.659370:0:3590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d2532e5000 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773374.659375:0:3590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5000/0xabf1cc0bc7843073 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773374.659382:0:3590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5000/0xabf1cc0bc7843073 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773374.659409:0:3590:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93d254e30700) 00010000:00010000:0.0:1790773374.659412:0:3590:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773374.659417:0:3590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5000/0xabf1cc0bc7843073 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773374.659423:0:3590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5000/0xabf1cc0bc7843073 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773374.659464:0:3590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2400/0xabf1cc0bc784307a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773374.659471:0:3590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2400/0xabf1cc0bc784307a lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773374.659476:0:3590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2400/0xabf1cc0bc784307a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773374.659482:0:3590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a2400 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773374.659485:0:3590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2400/0xabf1cc0bc784307a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773374.659491:0:3590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2400/0xabf1cc0bc784307a lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773374.659500:0:3590:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93d26ff64100) 00010000:00010000:0.0:1790773374.659503:0:3590:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773374.659506:0:3590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2400/0xabf1cc0bc784307a lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773374.659512:0:3590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2400/0xabf1cc0bc784307a lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773374.659529:0:3590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5600/0xabf1cc0bc7843122 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773374.659534:0:3590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5600/0xabf1cc0bc7843122 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773374.659539:0:3590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5600/0xabf1cc0bc7843122 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773374.659549:0:3590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d2532e5600 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773374.659552:0:3590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5600/0xabf1cc0bc7843122 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773374.659558:0:3590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5600/0xabf1cc0bc7843122 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773374.659565:0:3590:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff93d254e30800) 00010000:00010000:0.0:1790773374.659567:0:3590:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773374.659570:0:3590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5600/0xabf1cc0bc7843122 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773374.659574:0:3590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5600/0xabf1cc0bc7843122 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773374.659589:0:3590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2c00/0xabf1cc0bc78431a7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773374.659595:0:3590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2c00/0xabf1cc0bc78431a7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773374.659601:0:3590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2c00/0xabf1cc0bc78431a7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773374.659605:0:3590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a2c00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773374.659607:0:3590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2c00/0xabf1cc0bc78431a7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773374.659613:0:3590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2c00/0xabf1cc0bc78431a7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773374.659629:0:3590:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93d254e30200) 00010000:00010000:0.0:1790773374.659631:0:3590:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773374.659634:0:3590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2c00/0xabf1cc0bc78431a7 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773374.659639:0:3590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2c00/0xabf1cc0bc78431a7 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773374.659649:0:3590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526c00/0xabf1cc0bc784321e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773374.659654:0:3590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526c00/0xabf1cc0bc784321e lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773374.659660:0:3590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526c00/0xabf1cc0bc784321e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773374.659664:0:3590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d241526c00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773374.659667:0:3590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526c00/0xabf1cc0bc784321e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773374.659672:0:3590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526c00/0xabf1cc0bc784321e lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773374.659678:0:3590:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93d26ff73600) 00010000:00010000:0.0:1790773374.659680:0:3590:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790773374.659683:0:3590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526c00/0xabf1cc0bc784321e lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773374.659688:0:3590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526c00/0xabf1cc0bc784321e lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773374.659737:0:3591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3a00/0xabf1cc0bc78430c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773374.659744:0:3591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3a00/0xabf1cc0bc78430c7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773374.659750:0:3591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3a00/0xabf1cc0bc78430c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773374.659755:0:3591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a3a00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773374.659758:0:3591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3a00/0xabf1cc0bc78430c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773374.659763:0:3591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3a00/0xabf1cc0bc78430c7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773374.659771:0:3591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93d26ff64100) 00010000:00010000:0.0:1790773374.659773:0:3591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1790773374.659776:0:3591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3a00/0xabf1cc0bc78430c7 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773374.659781:0:3591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3a00/0xabf1cc0bc78430c7 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773374.662185:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773374.662375:0:19515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484528256 00000100:00100000:2.0:1790773374.662459:0:19515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484528256 00000100:00100000:2.0:1790773374.662521:0:19515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 23 00000100:00100000:2.0:1790773374.662530:0:19515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ff24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:332c789e-f22c-433e-a652-7f15822046a7+7:2400:x1877761484528256:12345-192.168.202.19@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1790773374.662769:0:19515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ff24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:332c789e-f22c-433e-a652-7f15822046a7+7:2400:x1877761484528256:12345-192.168.202.19@tcp:16:lhsmtool_posix.0 Request processed in 239us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773374.662777:0:19515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 23 00000100:00100000:3.0:1790773374.668625:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773374.668810:0:19912:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484528512 00000100:00100000:0.0:1790773374.668821:0:19912:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484528512 00000100:00100000:0.0:1790773374.668980:0:19912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 62 00000100:00100000:0.0:1790773374.668991:0:19912:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ff25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:332c789e-f22c-433e-a652-7f15822046a7+15:15616:x1877761484528512:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790773374.669171:0:19912:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773374.669202:0:19912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a800/0xabf1cc0bc7843233 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c112 expref: 15 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773374.669545:0:19912:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93d26ff73600) 00010000:00010000:0.0:1790773374.669551:0:19912:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790773374.669583:0:19912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031800/0xabf1cc0bc7843241 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773374.669597:0:19912:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031800/0xabf1cc0bc7843241 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773374.669606:0:19912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031800/0xabf1cc0bc7843241 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790773374.669804:0:19912:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002aad4220 reply state 0000000091dd98ca transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031800/0xabf1cc0bc7843241 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773374.669816:0:19912:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031800/0xabf1cc0bc7843241 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773374.669823:0:19912:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93d26ff73600) 00010000:00010000:0.0:1790773374.669825:0:19912:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790773374.669828:0:19912:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790773374.670136:0:19912:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ff25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:332c789e-f22c-433e-a652-7f15822046a7+16:15616:x1877761484528512:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 1146us (1519us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1790773374.670145:0:19912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 62 00000100:00100000:3.0:1790773374.673714:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773374.673825:0:18629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484528640 00000100:00100000:1.0:1790773374.673838:0:18629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484528640 00000100:00100000:1.0:1790773374.673914:0:18629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 24 00000100:00100000:1.0:1790773374.673924:0:18629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ff25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:332c789e-f22c-433e-a652-7f15822046a7+7:2397:x1877761484528640:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1790773374.674102:0:18629:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1790773374.674106:0:18629:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1790773373 00002000:00010000:1.0:1790773374.674108:0:18629:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1790773373 00002000:00010000:1.0:1790773374.674125:0:18629:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1790773374 -> 1790773373 00002000:00010000:1.0:1790773374.674128:0:18629:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1790773374.674198:0:18629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ff25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:332c789e-f22c-433e-a652-7f15822046a7+8:2397:x1877761484528640:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 Request processed in 275us (551us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1790773374.674232:0:18629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 24 00000100:00100000:1.0:1790773374.678096:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773374.678279:0:18630:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484528768 00000100:00100000:3.0:1790773374.678290:0:18630:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484528768 00000100:00100000:3.0:1790773374.678348:0:18630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 25 00000100:00100000:3.0:1790773374.678359:0:18630:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d244324050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:332c789e-f22c-433e-a652-7f15822046a7+8:2400:x1877761484528768:12345-192.168.202.19@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1790773374.678500:0:18630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ac34cf05/0xabf1cc0bc7843248 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773374.678534:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773374.678538:0:18630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773374.678544:0:18630:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac34cf05/0xabf1cc0bc7843248 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773374.678558:0:18630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac34cf05/0xabf1cc0bc7843248 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773374.678583:0:18630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ac34cf05/0xabf1cc0bc7843248 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773374.678591:0:18630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac34cf05/0xabf1cc0bc7843248 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773374.678599:0:18630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac34cf05/0xabf1cc0bc7843248 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773374.678605:0:18630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a3e00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:3.0:1790773374.678610:0:18630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac34cf05/0xabf1cc0bc7843248 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773374.678618:0:18630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac34cf05/0xabf1cc0bc7843248 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773374.678630:0:18630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac34cf05/0xabf1cc0bc7843248 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773374.678642:0:18630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac34cf05/0xabf1cc0bc7843248 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773374.678812:0:18630:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d244324050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:332c789e-f22c-433e-a652-7f15822046a7+8:2400:x1877761484528768:12345-192.168.202.19@tcp:1:lhsmtool_posix.0 Request processed in 454us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773374.678820:0:18630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 25 00000100:00100000:0.0:1790773374.689903:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773374.690082:0:17122:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484529024 00000100:00100000:2.0:1790773374.690094:0:17122:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484529024 00000100:00100000:2.0:1790773374.690250:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 63 00000100:00100000:2.0:1790773374.690263:0:17122:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:332c789e-f22c-433e-a652-7f15822046a7+16:15616:x1877761484529024:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1790773374.690350:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526000/0xabf1cc0bc784324f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773374.690372:0:17122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030600/0xabf1cc0bc78431a0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0e1 expref: 16 pid: 19912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773374.690382:0:17122:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526000/0xabf1cc0bc784324f lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773374.690436:0:17122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030600/0xabf1cc0bc78431a0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0e1 expref: 16 pid: 19912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773374.690470:0:17122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030600/0xabf1cc0bc78431a0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0e1 expref: 16 pid: 19912 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773374.690486:0:17122:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445dca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17122:1877761496130304:192.168.202.19@tcp:104: 00000100:00100000:2.0:1790773374.690578:0:17122:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d251cfd000 going to sleep for 11 seconds 00000100:00100000:2.0:1790773374.694289:0:17122:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445dca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17122:1877761496130304:192.168.202.19@tcp:104: 00010000:00010000:2.0:1790773374.694321:0:17122:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526000/0xabf1cc0bc784324f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773374.695922:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773374.697888:0:17107:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484529152 00000100:00100000:3.0:1790773374.697907:0:17107:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484529152 00010000:00010000:3.0:1790773374.697961:0:17107:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030600/0xabf1cc0bc78431a0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0e1 expref: 17 pid: 19912 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773374.698020:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 19 00000100:00100000:3.0:1790773374.698030:0:17107:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f974380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:332c789e-f22c-433e-a652-7f15822046a7+17:2397:x1877761484529152:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790773374.698046:0:17107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773374.698053:0:17107:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030600/0xabf1cc0bc78431a0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0e1 expref: 17 pid: 19912 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773374.698065:0:17107:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030600/0xabf1cc0bc78431a0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0e1 expref: 17 pid: 19912 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773374.698086:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030600/0xabf1cc0bc78431a0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0e1 expref: 17 pid: 19912 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773374.698105:0:17107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93d254e30200) 00010000:00010000:3.0:1790773374.698110:0:17107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031a00/0xabf1cc0bc78431bc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0ef expref: 16 pid: 19912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773374.698136:0:17107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526000/0xabf1cc0bc784324f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773374.698144:0:17107:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526000/0xabf1cc0bc784324f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773374.698151:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526000/0xabf1cc0bc784324f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773374.698190:0:17107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790773374.698299:0:17107:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f974380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:332c789e-f22c-433e-a652-7f15822046a7+16:2397:x1877761484529152:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 270us (2385us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773374.698306:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 19 00010000:00010000:0.0:1790773374.698638:0:17122:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526000/0xabf1cc0bc784324f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773374.698649:0:17122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526000/0xabf1cc0bc784324f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773374.698856:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030c00/0xabf1cc0bc7843256 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773374.698870:0:17122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527c00/0xabf1cc0bc7843225 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c10b expref: 16 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773374.698879:0:17122:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030c00/0xabf1cc0bc7843256 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773374.698923:0:17122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527c00/0xabf1cc0bc7843225 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c10b expref: 16 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773374.698937:0:17122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527c00/0xabf1cc0bc7843225 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c10b expref: 16 pid: 17122 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773374.698951:0:17122:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f975c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17122:1877761496130432:192.168.202.19@tcp:104: 00000100:00100000:0.0:1790773374.699020:0:17122:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2465e0240 going to sleep for 11 seconds 00000100:00100000:3.0:1790773374.705567:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773374.705755:0:17108:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484529280 00000100:00100000:1.0:1790773374.705767:0:17108:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484529280 00000100:00100000:0.0:1790773374.705803:0:17122:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f975c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17122:1877761496130432:192.168.202.19@tcp:104: 00010000:00010000:1.0:1790773374.705816:0:17108:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527c00/0xabf1cc0bc7843225 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c10b expref: 17 pid: 17122 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773374.705831:0:17122:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030c00/0xabf1cc0bc7843256 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773374.705863:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00100000:1.0:1790773374.705875:0:17108:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ff26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:332c789e-f22c-433e-a652-7f15822046a7+17:2398:x1877761484529280:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790773374.705893:0:17108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790773374.705900:0:17108:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527c00/0xabf1cc0bc7843225 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c10b expref: 17 pid: 17122 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.705913:0:17108:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527c00/0xabf1cc0bc7843225 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c10b expref: 17 pid: 17122 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.705938:0:17108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527c00/0xabf1cc0bc7843225 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c10b expref: 17 pid: 17122 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.705957:0:17108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93d26ff73600) 00010000:00010000:1.0:1790773374.705975:0:17108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030c00/0xabf1cc0bc7843256 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.705989:0:17108:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030c00/0xabf1cc0bc7843256 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.706020:0:17108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030c00/0xabf1cc0bc7843256 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.706052:0:17108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790773374.706112:0:17108:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ff26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:332c789e-f22c-433e-a652-7f15822046a7+16:2398:x1877761484529280:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 239us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773374.706120:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 20 00010000:00010000:0.0:1790773374.706933:0:17122:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030c00/0xabf1cc0bc7843256 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773374.706947:0:17122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030c00/0xabf1cc0bc7843256 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790773374.707084:0:17122:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1790773374.707262:0:17122:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1790773374.707297:0:17122:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1790773374.707385:0:17122:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f975c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17122:1877761496130560:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1790773374.707559:0:17122:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773374.707599:0:17122:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2465e0000 going to sleep for 11 seconds 00000100:00100000:3.0:1790773374.707618:0:17127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496130560 00000100:00100000:3.0:1790773374.707626:0:17127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496130560 00000100:00100000:3.0:1790773374.707675:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790773374.707684:0:17127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17122:x1877761496130560:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1790773374.707772:0:17127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17122:x1877761496130560:12345-0@lo:1000:mdt00_000.0 Request processed in 88us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773374.707780:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790773374.707911:0:17122:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f975c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17122:1877761496130560:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1790773374.708116:0:17122:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1790773374.708163:0:17122:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17122:1877761496130688:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1790773374.708193:0:17122:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773374.708239:0:17122:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d14465a600 going to sleep for 11 seconds 00000100:00100000:3.0:1790773374.708252:0:17127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496130688 00000100:00100000:3.0:1790773374.708258:0:17127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496130688 00000100:00100000:3.0:1790773374.708290:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790773374.708297:0:17127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17122:x1877761496130688:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1790773374.708399:0:17127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17122:x1877761496130688:12345-0@lo:1000:mdt00_000.0 Request processed in 103us (205us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1790773374.708416:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790773374.709573:0:17122:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17122:1877761496130688:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1790773374.709619:0:17122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030c00/0xabf1cc0bc7843256 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.709630:0:17122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030c00/0xabf1cc0bc7843256 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.709637:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030c00/0xabf1cc0bc7843256 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.709653:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d240030c00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773374.709658:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030c00/0xabf1cc0bc7843256 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.709682:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030c00/0xabf1cc0bc7843256 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.709698:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93d26ff73600) 00010000:00010000:1.0:1790773374.709701:0:17122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790773374.709705:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030c00/0xabf1cc0bc7843256 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.709711:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030c00/0xabf1cc0bc7843256 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.709746:0:17122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030200/0xabf1cc0bc78431b5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.709752:0:17122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030200/0xabf1cc0bc78431b5 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.709759:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030200/0xabf1cc0bc78431b5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.709764:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d240030200 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773374.709766:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030200/0xabf1cc0bc78431b5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.709772:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030200/0xabf1cc0bc78431b5 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.709780:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93d254e30200) 00010000:00010000:1.0:1790773374.709782:0:17122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790773374.709788:0:17122:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031a00/0xabf1cc0bc78431bc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0ef expref: 19 pid: 19912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.709810:0:17122:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031a00/0xabf1cc0bc78431bc lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0ef expref: 19 pid: 19912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.709818:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031a00/0xabf1cc0bc78431bc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0ef expref: 19 pid: 19912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.709875:0:17122:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031a00/0xabf1cc0bc78431bc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0ef expref: 19 pid: 19912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773374.709887:0:17122:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17122:1877761496130816:192.168.202.19@tcp:105: 00000100:00100000:1.0:1790773374.709997:0:17122:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d14465a180 going to sleep for 11 seconds 00000100:00100000:3.0:1790773374.712438:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773374.712539:0:17126:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484529408 00000100:00100000:2.0:1790773374.712548:0:17126:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484529408 00000100:00100000:2.0:1790773374.712605:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:2.0:1790773374.712616:0:17126:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9fb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:332c789e-f22c-433e-a652-7f15822046a7+20:15615:x1877761484529408:12345-192.168.202.19@tcp:49:dd.0 00000100:00100000:1.0:1790773374.712725:0:17122:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17122:1877761496130816:192.168.202.19@tcp:105: 00010000:00010000:1.0:1790773374.712752:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030200/0xabf1cc0bc78431b5 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773374.712761:0:17126:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9fb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:332c789e-f22c-433e-a652-7f15822046a7+20:15615:x1877761484529408:12345-192.168.202.19@tcp:49:dd.0 Request processed in 143us (330us total) trans 0 rc 0/0 00010000:00010000:1.0:1790773374.712766:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d240030200/0xabf1cc0bc78431b5 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773374.712773:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 10 00010000:00010000:1.0:1790773374.712809:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc784325d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.712824:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc784325d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.712835:0:17122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc784325d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.712845:0:17122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc784325d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.712865:0:17122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc784325d lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.712872:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc784325d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.712877:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12a200 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773374.712881:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc784325d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.712888:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc784325d lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.712898:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93d254e30200) 00010000:00010000:1.0:1790773374.712902:0:17122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790773374.712905:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc784325d lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.712910:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12a200/0xabf1cc0bc784325d lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.712920:0:17122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526000/0xabf1cc0bc784324f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.712925:0:17122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526000/0xabf1cc0bc784324f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.712930:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526000/0xabf1cc0bc784324f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.712935:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d241526000 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773374.712944:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526000/0xabf1cc0bc784324f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.712950:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526000/0xabf1cc0bc784324f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.712960:0:17122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93d254e30200) 00010000:00010000:1.0:1790773374.712963:0:17122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790773374.712977:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526000/0xabf1cc0bc784324f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.712983:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526000/0xabf1cc0bc784324f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773374.713127:0:17122:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:332c789e-f22c-433e-a652-7f15822046a7+19:15616:x1877761484529024:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 22867us (23285us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1790773374.713135:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 63 00000020:00080000:1.0:1790773374.713139:0:17122:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1790773374.713261:0:17158:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1790773374.713266:0:17158:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790773374.713283:0:17158:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1790773374.713290:0:17158:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1790773374.716460:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773374.717549:0:17123:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484529536 00000100:00100000:1.0:1790773374.717564:0:17123:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484529536 00000100:00100000:1.0:1790773374.717646:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 64 00000100:00100000:1.0:1790773374.717667:0:17123:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ff24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:332c789e-f22c-433e-a652-7f15822046a7+19:15615:x1877761484529536:12345-192.168.202.19@tcp:101:dd.0 00010000:00010000:1.0:1790773374.717695:0:17123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773374.717721:0:17123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc7843264 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c120 expref: -99 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.717769:0:17123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc784326b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.717786:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc784326b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.717815:0:17123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc784326b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.717946:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ae00/0xabf1cc0bc7843264 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c120 expref: 21 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.717981:0:17123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc784326b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c120 expref: 20 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.717989:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93d254e30200) 00010000:00010000:1.0:1790773374.717992:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790773374.717996:0:17123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12ac00, rc 0) 00000100:00100000:1.0:1790773374.718075:0:17123:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ff24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:332c789e-f22c-433e-a652-7f15822046a7+20:15615:x1877761484529536:12345-192.168.202.19@tcp:101:dd.0 Request processed in 419us (1632us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773374.718083:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 64 00000100:00100000:3.0:1790773374.718847:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773374.724789:0:17126:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484529792 00000100:00100000:2.0:1790773374.724806:0:17126:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484529792 00000100:00100000:2.0:1790773374.724878:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00100000:2.0:1790773374.724890:0:17126:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ff25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:332c789e-f22c-433e-a652-7f15822046a7+20:15616:x1877761484529792:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1790773374.725395:0:17126:0:(mdd_object.c:4189:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1790773374.725437:0:17126:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1790773374.725479:0:17126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526400/0xabf1cc0bc7843272 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773374.725519:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526400/0xabf1cc0bc7843272 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773374.725533:0:17126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526400/0xabf1cc0bc7843272 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773374.725544:0:17126:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526400/0xabf1cc0bc7843272 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773374.725550:0:17126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526400/0xabf1cc0bc7843272 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773374.725557:0:17126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526400/0xabf1cc0bc7843272 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773374.725576:0:17126:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790773374.725818:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790773374.725826:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526400/0xabf1cc0bc7843272 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773374.725833:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d241526400 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:3.0:1790773374.725838:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526400/0xabf1cc0bc7843272 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773374.725846:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526400/0xabf1cc0bc7843272 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773374.725860:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93d26ff73600) 00010000:00010000:3.0:1790773374.725863:0:17110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790773374.725868:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526400/0xabf1cc0bc7843272 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773374.725874:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526400/0xabf1cc0bc7843272 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773374.725887:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773374.725889:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773374.725891:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773374.725980:0:17126:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ff25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:332c789e-f22c-433e-a652-7f15822046a7+22:15616:x1877761484529792:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 Request processed in 1090us (7133us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1790773374.725990:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 11 00000020:00080000:2.0:1790773374.725995:0:17126:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1790773374.948101:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773374.948194:0:18633:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484529920 00000100:00100000:2.0:1790773374.948229:0:18633:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484529920 00000100:00100000:2.0:1790773374.948303:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:2.0:1790773374.948316:0:18633:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f974a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:332c789e-f22c-433e-a652-7f15822046a7+8:2398:x1877761484529920:12345-192.168.202.19@tcp:4:dd.0 00010000:00010000:2.0:1790773374.948353:0:18633:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ea94366/0xabf1cc0bc7843279 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773374.948373:0:18633:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000007dc942a/0xabf1cc0bc784323a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c119 expref: 8 pid: 19203 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773374.948402:0:18633:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790773374.948407:0:18633:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790773374.948412:0:18633:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ea94366/0xabf1cc0bc7843279 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773374.948450:0:18633:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000007dc942a/0xabf1cc0bc784323a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c119 expref: 8 pid: 19203 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773374.948465:0:18633:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000007dc942a/0xabf1cc0bc784323a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c119 expref: 8 pid: 19203 timeout: 617 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773374.948481:0:18633:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445de680 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:18633:1877761496130944:192.168.202.19@tcp:104: 00000100:00100000:2.0:1790773374.948575:0:18633:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d251cfdb40 going to sleep for 11 seconds 00000100:00100000:0.0:1790773374.953388:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773374.953586:0:17107:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484530176 00000100:00100000:3.0:1790773374.953596:0:17107:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484530176 00010000:00010000:3.0:1790773374.953643:0:17107:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000007dc942a/0xabf1cc0bc784323a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c119 expref: 9 pid: 19203 timeout: 617 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773374.953722:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:3.0:1790773374.953733:0:17107:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f976a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:332c789e-f22c-433e-a652-7f15822046a7+9:2400:x1877761484530176:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790773374.953751:0:17107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773374.953774:0:17107:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000007dc942a/0xabf1cc0bc784323a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c119 expref: 9 pid: 19203 timeout: 617 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773374.953790:0:17107:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000007dc942a/0xabf1cc0bc784323a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c119 expref: 9 pid: 19203 timeout: 617 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773374.953819:0:17107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773374.953823:0:17107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773374.953829:0:17107:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007ea94366/0xabf1cc0bc7843279 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773374.953839:0:17107:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ea94366/0xabf1cc0bc7843279 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773374.953875:0:17107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790773374.953942:0:17107:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f976a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:332c789e-f22c-433e-a652-7f15822046a7+9:2400:x1877761484530176:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 210us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773374.953950:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 21 00010000:00010000:2.0:1790773374.954184:0:18633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007dc942a/0xabf1cc0bc784323a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c119 expref: 8 pid: 19203 timeout: 617 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773374.954247:0:18633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445de680 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:18633:1877761496130944:192.168.202.19@tcp:104: 00010000:00010000:2.0:1790773374.954275:0:18633:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007ea94366/0xabf1cc0bc7843279 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773374.954286:0:18633:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007ea94366/0xabf1cc0bc7843279 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773374.954293:0:18633:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ea94366/0xabf1cc0bc7843279 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773374.957295:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773374.957600:0:18635:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1790773374.957609:0:18635:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1790773374.958077:0:18635:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484530048 00000100:00100000:3.0:1790773374.958088:0:18635:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484530048 00000100:00100000:1.0:1790773374.959090:0:20263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 1 00000100:00100000:1.0:1790773374.959105:0:20263:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f974700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:332c789e-f22c-433e-a652-7f15822046a7+8:2398:x1877761484530048:12345-192.168.202.19@tcp:4:dd.0 00010000:00010000:1.0:1790773374.959143:0:20263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4f57677/0xabf1cc0bc7843280 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.959164:0:20263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790773374.959168:0:20263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790773374.959174:0:20263:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4f57677/0xabf1cc0bc7843280 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773374.959189:0:20263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4f57677/0xabf1cc0bc7843280 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790773375.080048:0:19441:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:1.0:1790773375.080068:0:19441:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:2.0:1790773375.080647:0:18633:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:2.0:1790773375.080664:0:18633:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1790773373 -> 1790773375 00002000:00010000:2.0:1790773375.080666:0:18633:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1790773373 -> 1790773375 00002000:00010000:2.0:1790773375.080669:0:18633:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:2.0:1790773375.080687:0:18633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ea94366/0xabf1cc0bc7843279 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773375.080700:0:18633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ea94366/0xabf1cc0bc7843279 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773375.080709:0:18633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ea94366/0xabf1cc0bc7843279 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773375.080716:0:18633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d241526800 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:2.0:1790773375.080722:0:18633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ea94366/0xabf1cc0bc7843279 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773375.080732:0:18633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ea94366/0xabf1cc0bc7843279 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773375.080752:0:18633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ea94366/0xabf1cc0bc7843279 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773375.080760:0:18633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ea94366/0xabf1cc0bc7843279 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773375.081774:0:18633:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f974a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:332c789e-f22c-433e-a652-7f15822046a7+7:2398:x1877761484529920:12345-192.168.202.19@tcp:4:dd.0 Request processed in 133453us (133674us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1790773375.081786:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 0 00000001:00080000:0.0:1790773375.147610:0:19441:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:1.0:1790773375.147971:0:20263:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:1.0:1790773375.147977:0:20263:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:1.0:1790773375.148004:0:20263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4f57677/0xabf1cc0bc7843280 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773375.148019:0:20263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4f57677/0xabf1cc0bc7843280 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773375.148028:0:20263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4f57677/0xabf1cc0bc7843280 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773375.148036:0:20263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12ae00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:1.0:1790773375.148041:0:20263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4f57677/0xabf1cc0bc7843280 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773375.148051:0:20263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4f57677/0xabf1cc0bc7843280 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773375.148070:0:20263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4f57677/0xabf1cc0bc7843280 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773375.148077:0:20263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4f57677/0xabf1cc0bc7843280 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773375.148258:0:20263:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f974700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:332c789e-f22c-433e-a652-7f15822046a7+5:2398:x1877761484530048:12345-192.168.202.19@tcp:4:dd.0 Request processed in 189152us (190966us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1790773375.148269:0:20263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 1 00010000:00010000:1.0:1790773375.182097:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773375.822026:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790773375.822058:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496131072:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790773375.822146:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773375.822391:0:18631:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496131072 00000100:00100000:2.0:1790773375.822400:0:18631:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496131072 00000100:00100000:2.0:1790773375.822483:0:18631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790773375.822496:0:18631:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f975c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496131072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790773375.822533:0:18631:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1790773375.822598:0:18631:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f975c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496131072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773375.822605:0:18631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1790773375.822751:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790773375.822832:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496131072:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1790773376.206443:0:20149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790773376.535821:0:20300:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:1.0:1790773376.845509:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27ff25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496131200:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790773376.845585:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773376.845683:0:17127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496131200 00000100:00100000:2.0:1790773376.845692:0:17127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496131200 00000100:00100000:2.0:1790773376.845753:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790773376.845760:0:17127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496131200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790773376.845797:0:17127:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1790773376.848247:0:17127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496131200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2477us (2653us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773376.848261:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790773376.850507:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27ff25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496131200:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1790773377.230388:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773377.357396:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790773377.357424:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496131328:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790773377.357506:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773377.361496:0:18631:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496131328 00000100:00100000:2.0:1790773377.361507:0:18631:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496131328 00000100:00100000:2.0:1790773377.361564:0:18631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790773377.361578:0:18631:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496131328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790773377.361610:0:18631:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1790773377.361721:0:18631:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496131328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 147us (4214us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773377.361729:0:18631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790773377.361796:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496131456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790773377.361811:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790773377.361839:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773377.361839:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496131712:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790773377.361872:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790773377.361881:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496131584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790773377.361887:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773377.361918:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773377.361930:0:17128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496131712 00000100:00100000:1.0:1790773377.361935:0:17128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496131712 00000100:00080000:2.0:1790773377.361958:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790773377.361985:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790773377.361987:0:18632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496131456 00000100:00100000:2.0:1790773377.361993:0:18632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496131456 00000100:00100000:1.0:1790773377.361995:0:17128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496131712:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790773377.362022:0:18632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496131584 00000004:00000024:1.0:1790773377.362024:0:17128:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790773377.362026:0:18632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496131584 00000100:00100000:2.0:1790773377.362045:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790773377.362054:0:18632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496131456:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790773377.362069:0:17128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496131712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (185us total) trans 0 rc 0/0 00002000:00000024:2.0:1790773377.362078:0:18632:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1790773377.362079:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790773377.362123:0:18632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496131456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773377.362130:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496131712:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790773377.362134:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790773377.362153:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790773377.362162:0:18632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496131584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790773377.362173:0:18632:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1790773377.362199:0:18632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496131584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773377.362229:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1790773377.362248:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790773377.362251:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790773377.362281:0:3604:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:2.0:1790773377.362286:0:3604:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93d281b9d180, transno 8589934596 00000004:00080000:2.0:1790773377.362294:0:3604:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:2.0:1790773377.362313:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496131584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790773377.362328:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496131456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790773377.362367:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496131328:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790773377.362380:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790773377.362389:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27ff26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3606:1877761496131840:0@lo:400:kworker.0 00000100:00100000:2.0:1790773377.362429:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773377.362465:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27ff24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496132096:0@lo:400:kworker.0 00000100:00100000:2.0:1790773377.362471:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27ff26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496132224:0@lo:400:kworker.0 00000100:00100000:3.0:1790773377.362510:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773377.362513:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773377.362536:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27ff25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3605:1877761496132608:0@lo:400:kworker.0 00000100:00100000:2.0:1790773377.362542:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27ff26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3606:1877761496132736:0@lo:400:kworker.0 00000100:00100000:3.0:1790773377.362568:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773377.362585:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496131840 00000100:00100000:2.0:1790773377.362590:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496131840 00000100:00100000:3.0:1790773377.362596:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1790773377.362603:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27ff25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3605:1877761496131968:0@lo:400:kworker.0 00000100:00100000:3.0:1790773377.362629:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773377.362629:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1790773377.362643:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+24:3606:x1877761496131840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773377.362649:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27ff24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3605:1877761496132480:0@lo:400:kworker.0 00000100:00100000:3.0:1790773377.362683:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773377.362690:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdd0c180-4c21-4c72-90c1-0147a5902c2f+24:3606:x1877761496131840:12345-0@lo:400:kworker.0 Request processed in 50us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773377.362699:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1790773377.362743:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773377.362781:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27ff26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3606:1877761496131840:0@lo:400:kworker.0 00000100:00100000:2.0:1790773377.362794:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1790773377.362800:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27ff24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3606:1877761496132352:0@lo:400:kworker.0 00000100:00100000:2.0:1790773377.362825:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773377.362844:0:19912:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496132608 00000100:00100000:3.0:1790773377.362850:0:19912:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496132608 00000100:00100000:2.0:1790773377.362852:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143cc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3606:1877761496132864:0@lo:400:kworker.0 00000100:00100000:3.0:1790773377.362883:0:19912:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496131968 00000100:00100000:2.0:1790773377.362885:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773377.362888:0:19912:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496131968 00000100:00100000:3.0:1790773377.362907:0:19912:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496132480 00000100:00100000:3.0:1790773377.362909:0:19912:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496132480 00000100:00080000:2.0:1790773377.362911:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790773377.362916:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790773377.362924:0:19912:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496132736 00000100:00100000:3.0:1790773377.362928:0:19912:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496132736 00000100:00080000:2.0:1790773377.362959:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790773377.362989:0:19912:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496132352 00000100:00100000:2.0:1790773377.362993:0:19912:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496132352 00000100:00100000:2.0:1790773377.363019:0:19912:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496132864 00000100:00100000:2.0:1790773377.363022:0:19912:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496132864 00000100:00100000:2.0:1790773377.363056:0:19912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790773377.363063:0:19912:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3605:x1877761496132608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773377.363105:0:19912:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3605:x1877761496132608:12345-0@lo:400:kworker.0 Request processed in 43us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773377.363112:0:19912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790773377.363126:0:19912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790773377.363132:0:19912:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3605:x1877761496131968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773377.363162:0:19912:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3605:x1877761496131968:12345-0@lo:400:kworker.0 Request processed in 30us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773377.363167:0:19912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790773377.363180:0:19912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790773377.363186:0:19912:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3605:x1877761496132480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773377.363236:0:19912:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3605:x1877761496132480:12345-0@lo:400:kworker.0 Request processed in 51us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773377.363242:0:19912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790773377.363256:0:19912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790773377.363262:0:19912:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3606:x1877761496132736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773377.363296:0:19912:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3606:x1877761496132736:12345-0@lo:400:kworker.0 Request processed in 35us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773377.363309:0:19912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790773377.363323:0:19912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790773377.363328:0:19912:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1877761496132352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773377.363361:0:19912:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1877761496132352:12345-0@lo:400:kworker.0 Request processed in 33us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773377.363367:0:19912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790773377.363377:0:19912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790773377.363383:0:19912:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3606:x1877761496132864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773377.363405:0:19912:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3606:x1877761496132864:12345-0@lo:400:kworker.0 Request processed in 23us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773377.363410:0:19912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790773377.363437:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27ff25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3605:1877761496131968:0@lo:400:kworker.0 00000100:00100000:2.0:1790773377.363447:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27ff24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3605:1877761496132480:0@lo:400:kworker.0 00010000:00080000:2.0:1790773377.363458:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27ff25880 x1877761496132608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773377.363467:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27ff25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3605:1877761496132608:0@lo:400:kworker.0 00000100:00100000:2.0:1790773377.363492:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27ff24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3606:1877761496132352:0@lo:400:kworker.0 00010000:00080000:2.0:1790773377.363501:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d143cc4380 x1877761496132864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773377.363509:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143cc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3606:1877761496132864:0@lo:400:kworker.0 00000100:00100000:2.0:1790773377.363519:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27ff26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3606:1877761496132736:0@lo:400:kworker.0 00000100:00100000:1.0:1790773377.363825:0:19203:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496132224 00000100:00100000:1.0:1790773377.363849:0:19203:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496132224 00000100:00100000:1.0:1790773377.363886:0:19203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790773377.363893:0:19203:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496132224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773377.363938:0:19203:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496132224:12345-0@lo:400:kworker.0 Request processed in 46us (1431us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773377.363959:0:19203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790773377.363989:0:17128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496132096 00000100:00100000:1.0:1790773377.363993:0:17128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496132096 00000100:00100000:1.0:1790773377.364015:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790773377.364022:0:17128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496132096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773377.364061:0:17128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496132096:12345-0@lo:400:kworker.0 Request processed in 40us (1556us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773377.364067:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790773377.364107:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27ff24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496132096:0@lo:400:kworker.0 00000100:00100000:1.0:1790773377.364132:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27ff26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496132224:0@lo:400:kworker.0 00000100:00080000:3.0:1790773377.364142:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790773377.364145:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790773377.582374:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773377.582460:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773377.582489:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773377.582525:0:18628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484530688 00000100:00100000:3.0:1790773377.582535:0:18628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484530688 00000100:00100000:3.0:1790773377.582604:0:18628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 19 00000100:00100000:3.0:1790773377.582614:0:18628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f975880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:332c789e-f22c-433e-a652-7f15822046a7+5:2398:x1877761484530688:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1790773377.582694:0:18628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f975880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:332c789e-f22c-433e-a652-7f15822046a7+5:2398:x1877761484530688:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 80us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773377.582701:0:18628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 19 00000100:00080000:1.0:1790773377.582759:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790773377.583116:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773377.583144:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773377.583167:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773377.583301:0:19912:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484530432 00000100:00100000:2.0:1790773377.583313:0:19912:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484530432 00000100:00100000:2.0:1790773377.583353:0:19912:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484530944 00000100:00100000:2.0:1790773377.583356:0:19912:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484530944 00000100:00100000:2.0:1790773377.583378:0:19912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 66 00000100:00100000:2.0:1790773377.583385:0:19912:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:332c789e-f22c-433e-a652-7f15822046a7+22:2398:x1877761484530432:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1790773377.583431:0:19912:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:332c789e-f22c-433e-a652-7f15822046a7+22:2398:x1877761484530432:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 47us (1069us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773377.583438:0:19912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 66 00000100:00100000:2.0:1790773377.583452:0:19912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 67 00000100:00100000:2.0:1790773377.583458:0:19912:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+6:2398:x1877761484530944:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1790773377.583483:0:19912:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+6:2398:x1877761484530944:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 25us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773377.583489:0:19912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 67 00000100:00100000:3.0:1790773377.583583:0:18630:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484531200 00000100:00100000:3.0:1790773377.583587:0:18630:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484531200 00000100:00100000:3.0:1790773377.583682:0:18630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00100000:3.0:1790773377.583689:0:18630:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f977800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+5:2398:x1877761484531200:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1790773377.583716:0:18630:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f977800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+5:2398:x1877761484531200:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 29us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773377.583723:0:18630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00100000:1.0:1790773377.583923:0:17116:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484530304 00000100:00100000:1.0:1790773377.583928:0:17116:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484530304 00000100:00100000:1.0:1790773377.583967:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 168 00000100:00100000:1.0:1790773377.583974:0:17116:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+13:2398:x1877761484530304:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773377.584130:0:17116:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+13:2398:x1877761484530304:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 155us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773377.584137:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 168 00000100:00080000:1.0:1790773377.584175:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790773377.584179:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790773377.584368:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773377.584401:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773377.584422:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773377.584468:0:19912:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484530560 00000100:00100000:2.0:1790773377.584472:0:19912:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484530560 00000100:00100000:2.0:1790773377.584502:0:19912:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484531072 00000100:00100000:2.0:1790773377.584505:0:19912:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484531072 00000100:00100000:2.0:1790773377.584526:0:19912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 68 00000100:00100000:2.0:1790773377.584532:0:19912:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:332c789e-f22c-433e-a652-7f15822046a7+5:2398:x1877761484530560:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773377.584588:0:18629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484530816 00000100:00100000:1.0:1790773377.584600:0:18629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484530816 00000100:00100000:1.0:1790773377.584625:0:18629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484531328 00000100:00100000:1.0:1790773377.584627:0:18629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484531328 00000100:00100000:1.0:1790773377.584645:0:18629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:1.0:1790773377.584652:0:18629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:332c789e-f22c-433e-a652-7f15822046a7+5:2398:x1877761484530816:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1790773377.585010:0:19912:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:332c789e-f22c-433e-a652-7f15822046a7+5:2398:x1877761484530560:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 476us (1840us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773377.585018:0:19912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 68 00000100:00100000:2.0:1790773377.585033:0:19912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 69 00000100:00100000:2.0:1790773377.585041:0:19912:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+5:2398:x1877761484531072:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773377.585133:0:18629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:332c789e-f22c-433e-a652-7f15822046a7+5:2398:x1877761484530816:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 479us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773377.585140:0:18629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:1.0:1790773377.585155:0:18629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 22 00000100:00100000:1.0:1790773377.585161:0:18629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+5:2398:x1877761484531328:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773377.585188:0:18629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+5:2398:x1877761484531328:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 28us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773377.585194:0:18629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 22 00000100:00100000:2.0:1790773377.585560:0:19912:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+5:2398:x1877761484531072:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 519us (1157us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773377.585573:0:19912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 69 00000100:00080000:2.0:1790773377.585733:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790773377.585737:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 Debug log: 42036 lines, 42036 kept, 0 dropped, 0 bad.